Comparison of Research Methods
affects the test subjects and may skew experimental data.
4. It has already been noted that an advantage of the experimental method is the amount of control which experimenters have over variables. It must however also be noted that it is impossible to control completely all variables. There may other relevant variables which the experimenter is unaware of. It is, in particular, unrealistic to control completely the thought processes of subjects taking part in an experiment.
5. Since the acceptability of experimental results is theory-dependent, judgments about the adequacy of experimental results are not straightforward. Experiments are adequate only if the experimental set-up is appropriate and disturbing factors have been eliminated. This in turn requires knowledge of what those disturbing factors are and how they can be discarded. Any inadequacies in the relevant knowledge about these factors could lead to inappropriate experimental measures and faulty conclusions. Experimental facts and theory are therefore considerably interrelated. Experimental results can be faulty if the conditions producing them are deficient. It must be acknowledged, then, that the relationship between theory and experiment may involve a circular argument.
¢ò.The Questionnaire
Questionnaires are one of the most important quantitative research tools available. It is ¡°a form that people fill out, used to obtain demographic information and views and interests of those questioned¡± [Brehob, 2001] or, in a more structural way, ¡°a method for the elicitation, and recording and collecting information¡± [Kirakowski, 1998]. There are two main types of questionnaires: mail questionnaires and online questionnaires.
Mail questionnaires are sent to respondents via postal service. They carry the following advantages:
1. Questionnaires are cost-effective compared to face-to-face interviews. This is especially true for studies involving large sampling populations and large geographic areas. Written questionnaires become even more cost-effective as the number of research questions increases.
2. Questionnaires are easy to analyze. Data entry and tabulation for nearly all surveys can be easily done with many commercial software packages.
3. Questionnaires are familiar to most people. Nearly everyone has had some experience completing questionnaires, and they generally do not make people apprehensive.
4. Questionnaires reduce bias. There is a uniform presentation format so researchers¡¯ opinions will not bias a respondent¡¯s answers. There are no verbal or visual clues to influence the respondent.
5. Questionnaires are less intrusive than telephone or face-to-face surveys. Mail questionnaires allow subjects to respond at leisure, whereas phone or personal interviews obligate respondents to answer within the timeframe provided by the interviewer.
Disadvantages of Questionnaire
1. One major disadvantage of written questionnaires is the possibility of low response rates. Low response rates can destroy statistical analysis. They can dramatically lower our confidence in the results. Response rates vary widely from one questionnaire to another (10% - 90%); well-designed studies, however, consistently produce high response rates.
2. Another disadvantage of questionnaires is the inability to ¡°probe¡± responses. Questionnaires are structured instruments; they allow respondents little flexibility with respect to response format. As such, they often lose the "flavor of the response" (i.e., respondents often want to qualify their answers). By allowing extended [next page]