COMPUTER FAMILIARITY AMONG TOEFL EXAMINEES

Abstract

The growing use of computer-based testing raises concerns about access and equity. Specifically, many in the field of language testing are concerned that the introduction of a computer-based TOEFL test in 1998 may introduce bias by confounding the measurement of English-language proficiency with computer familiarity. As the first study in a series of research efforts to address this question, a 23-item questionnaire focusing on examinees' access to, attitude toward, and experience using computers as well as related technologies was developed and administered to TOEFL test takers in April and May of 1996 as part of a TOEFL test administration. The examinee response rate for the survey was over 90%, and the sample of respondents was determined to be highly similar to the annual TOEFL examinee population in terms of gender, native language, test center region, TOEFL test score ranges, and reason for taking the test. Factor analysis procedures (specifically, a principal factors approach with varimax rotation) were used to determine the dimensionality of the survey questionnaire. The first factor from a two-factor common factor solution consisted of 11 items and had a reliability of.91. This factor was used to classify TOEFL examinees into one of three groups according to their level of familiarity with computers: low, moderate, or high. Overall, some 16% of the TOEFL population was judged to have low computer familiarity, another 34% to have moderate familiarity, and approximately 50% to have high familiarity. In terms of background characteristics, computer familiarity was found to be unrelated to age, but was related to gender, native language, region of the world where the examinee was born, and test-center region. Computer familiarity was also shown to be related to individuals' TOEFL test scores and their reason for taking the test but unrelated to whether or not they had taken the test previously. Analyses of variance were conducted to investigate the relationships among proficiency as measured by the paper-and-pencil TOEFL test, computer familiarity, and selected background characteristics, including gender, age, native language, and reason for taking the test. Effect sizes for each variable as well as for the interactions among the variables are discussed herein. The study results are also considered in light of existing research relating to various aspects of computer familiarity as well as in terms of their implications for professionals in universities and intensive language programs who will need to serve the needs of this diverse set of learners.