Can the National Center Test in Japan be replaced by commercially available private English tests of four skills? In the case of TOEFL Junior Comprehensive

Abstract

Background: The National Center Test is a test that high school graduates take in order to be matriculated into the majority of universities in Japan. Its English section (NCT), though, is scheduled to be replaced by commercially available private English tests of four skills (reading, listening, speaking, writing) due to the fact that NCT currently measures only the receptive skills of reading and listening. A concern has been raised, however, regarding the score comparability between NCT and those tests of four skills. Thus, this study was conducted in order to examine to what extent the score of NCT and TOEFL Junior Comprehensive (JC)—one of the commercially available private English tests of four skills—correlate with each other and to what extent their test constructs overlap from the viewpoint of L2 competence structure. Methods: One hundred forty-four twelfth graders in Japan took NCT and JC. Pearson’s correlations and an exploratory factor analysis (maximum likelihood) were conducted. Moreover, confirmatory factor analyses and chi-square difference tests were performed in order to compare several models. Results: The results show that the scores of the two tests are highly correlated with each other, indicating that JC can be a proper candidate to replace NCT. Moreover, an exploratory factor analysis revealed that all of the six scores can be subsumed under a single factor. According to the results of a series of confirmatory factor analyses and chi-square difference tests, the correlated skill model was shown to be the best fit model, but the unitary model was almost equally a good fit as well. Conclusions: The results overall indicate that, regardless of tests and skills to measure, English proficiency as a general construct may determine the major portion of these scores. This poses the question of whether, in order to assess learners’ English proficiency, all four skills need to be measured separately.