Assessing bilingual language proficiency with a yes/no vocabulary test: the role of form-meaning vocabulary knowledge

• Soon Tat Lee ^[2] ; Walter J. B. van Heuven ^[1] ; Jessica M. Price ^[2] ; Christine X. R. Leong ^[2]
  1. [1] University of Nottingham

     University of Nottingham

     Reino Unido

     
  2. [2] University of Nottingham, Selangor, Malaysia
• Localización: Bilingualism: Language and cognition, ISSN 1366-7289, Vol. 28, Nº 4, 2025, págs. 1100-1116
• Idioma: inglés
• DOI: 10.1017/S1366728924001007
• Texto completo no disponible (Saber más ...)
• Resumen

  • Validated yes/no vocabulary tests that measure bilinguals’ language proficiency based on vocabulary knowledge have been widely used in psycholinguistic research. However, it is unclear what aspects of test takers’ vocabulary knowledge are employed in these tests, which makes the interpretation of their scores problematic. The present study investigated the contribution of bilinguals’ form-meaning knowledge to their item accuracy on a Malay yes/no vocabulary test. Word knowledge of Malay first- (N = 80) and second-language (N = 80) speakers were assessed using yes/no, meaning recognition, form recognition, meaning recall and form recall tests. The findings revealed that 59% of the variance in the yes/no vocabulary test score was explained by the accuracy of the meaning recognition, form recognition and meaning recall tests. Importantly, the item analysis indicated that yes/no vocabulary tests assess primarily knowledge of form recognition, supporting its use as a lexical proficiency measure to estimate bilinguals’ receptive language proficiency.

• Referencias bibliográficas
  • Amenta, S., Badan, L., & Brysbaert, M. (2021). LexITA: A quick and reliable assessment tool for Italian L2 receptive vocabulary size....
  • Anderson, R. C., & Freebody, P. (1983). Reading comprehension and the assessment and acquisition of word knowledge. Advances in Reading...
  • Aviad-Levitzky, T., Laufer, B., & Goldstein, Z. (2019). The New Computer Adaptive Test of Size and Strength (CATSS): Development and validation....
  • Bates, D., Mächler, M., Bolker, B., Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1),...
  • Brysbaert, M. (2013). Lextale_FR: A fast, free, and efficient test to measure language proficiency in French. Psychologica Belgica, 53(1),...
  • Brysbaert, M., Lagrou, E., & Stevens, M. (2017). Visual word recognition in a second language: A test of the lexical entrenchment hypothesis...
  • Brysbaert, M., Stevens, M., Mandera, P., & Keuleers, E. (2016). How many words do we know? Practical estimates of vocabulary size dependent...
  • Brysbaert, M., Mandera, P., & Keuleers, E. (2018). The Word Frequency Effect in Word Processing: An Updated Review. Current Directions...
  • Chan, I. L., & Chang, C. B. (2018). LEXTALE_CH: A quick, characterbased proficiency test for Mandarin Chinese. Proceedings of the Annual...
  • Diedenhofen, B. & Musch, J. (2015). cocor: A comprehensive solution for the statistical comparison of correlations. PLOS ONE, 10(4): e0121945....
  • Diependaele, K., Lemhöfer, K., & Brysbaert, M. (2013). The word frequency effect in first- and second-language word recognition: A lexical...
  • Elgort, I. (2013). Effects of LI definitions and cognate status of test items on the Vocabulary Size Test. Language Testing, 30(2), 253–272....
  • Fromont, L., Royle, P., & Steinhauer, K. (2020). Growing Random Forests reveals that exposure and proficiency best account for individual...
  • González-Fernández, B. (2022). Conceptualizing L2 vocabulary knowledge. Studies in Second Language Acquisition, 44(4), 1124–1154. https://doi.org/10.1017/S0272263121000930CrossRefGoogle...
  • González-Fernández, B., & Schmitt, N. (2020). Word knowledge: Exploring the relationships and order of acquisition of vocabulary knowledge...
  • Harrington, M. (2018). L2 word recognition skill and its measurement. In Lexical facility: Size, recognition speed and consistency as dimensions...
  • Holmes, V. M. (2009). Bottom-up processing and reading comprehension in experienced adult readers. Journal of Research in Reading, 32(3),...
  • Hulstijn, J. H. (2012). The construct of language proficiency in the study of bilingualism from a cognitive perspective. Bilingualism: Language...
  • Hulstijn, J. H. (2015). Language proficiency in native and non-native speakers: Theory and research. John Benjamins.CrossRefGoogle Scholar
  • Ibrahim, S. (Ed.). (2002). Kamus Dwibahasa: Bahasa Inggeris-Bahasa Melayu (Edisi Kedua). Dewan Bahasa dan Pustaka.Google Scholar
  • Izura, C., Cuetos, F., & Brysbaert, M. (2014). Lextale-Esp: A test to rapidly and efficiently assess the Spanish vocabulary size. Psicológica...
  • Jeon, E. H., & Yamashita, J. (2014). L2 reading comprehension and its correlates: A meta-analysis. Language Learning, 64(1), 160–212....
  • Lalkhen, A. G., & McCluskey, A. (2008). Clinical tests: Sensitivity and specificity. Continuing Education in Anaesthesia, Critical Care...
  • Laufer, B., & Aviad-Levitzky, T. (2017). What type of vocabulary knowledge predicts reading comprehension: Word meaning recall or word...
  • Laufer, B., & Goldstein, Z. (2004). Testing vocabulary knowledge: Size, strength, and computer adaptiveness. Language Learning, 54(3),...
  • Lee, L. C., Rickard Liow, S. J., & Wee, M.-L. O. (2007). Morphological structure of Malay: Using psycholinguistic analyses of rated familiarity....
  • Lee, S. T., van Heuven, W. J., Price, J. M., & Leong, C. X. R. (2022). Translation norms for Malay and English words: The effects of word...
  • Lee, S. T., van Heuven, W. J. B., Price, J. M., & Leong, C. X. R. (2023). LexMAL: A quick and reliable lexical test for Malay speakers....
  • Lemhöfer, K., & Broersma, M. (2012). Introducing LexTALE: A quick and valid lexical test for advanced learners of English. Behavior Research...
  • Lenth, R. V. (2023). emmeans: Estimated Marginal Means, aka least-squares means. R package version 1.8.5. https://CRAN.R-project.org/package=emmeansGoogle...
  • Li, P., Zhang, F., Yu, A., & Zhao, X. (2019). Language History Questionnaire (LHQ3): An enhanced tool for assessing multilingual experience....
  • Mainz, N., Shao, Z., Brysbaert, M., & Meyer, A. S. (2017). Vocabulary knowledge predicts lexical processing: Evidence from a group of...
  • Masrai, A. (2022). The development and validation of a Lemma-based yes/no vocabulary size test. SAGE Open, 12(1), 215824402210743. https://doi.org/10.1177/21582440221074355CrossRefGoogle...
  • Mazlan, I. R., Hassnan, N. M., & Rusli, Y. A. (2024). A comparison of narrative abilities in Malay school-age typically developing children...
  • McLean, S., Stewart, J., & Batty, A. O. (2020). Predicting L2 reading proficiency with modalities of vocabulary knowledge: A bootstrapping...
  • Meara, P., & Miralpeix, I. (2016). Tools for Researching Vocabulary. Multilingual Matters. https://doi.org/10.21832/9781783096473CrossRefGoogle...
  • Meara, P. M., & Jones, G. (1988). Vocabulary size as a placement indicator. In Grunwell, P. (Ed.), Applied linguistics in society (pp....
  • Mochida, A., & Harrington, M. (2006). The yes/no test as a measure of receptive vocabulary knowledge. Language Testing, 23(1), 73–98....
  • Mohamed, M. M., & Jared, D. (2024). Malay Lexicon Project 3: The impact of orthographic–semantic consistency on lexical decision latencies....
  • Mohamed, M. M., Yap, M. J., Chee, Q. W., & Jared, D. (2023). Malay Lexicon Project 2: Morphology in Malay word recognition. Memory &...
  • Nation, I. S. P. (1983). Testing and teaching vocabulary. Guidelines, 5(1), 12–25.Google Scholar
  • Nation, I. S. P. (2012). The BNC/COCA word family lists. http://www.victoria.ac.nz/lals/about/staff/paul-nationGoogle Scholar
  • Nation, I. S. P. (2013). Learning vocabulary in another language (2nd ed.). Cambridge University Press.CrossRefGoogle ScholarPubMed
  • Nation, I. S. P. (2020). The different aspects of vocabulary knowledge. In The Routledge handbook of vocabulary studies (1st ed., pp. 15–29)....
  • Nation, I. S. P. (2022). Learning vocabulary in another language. Cambridge University Press.Google Scholar
  • Nation, I. S. P., & Beglar, D. (2007) A vocabulary size test. The Language Teacher, 31(7), 9–13.Google Scholar
  • Nation, I. S. P., & Webb, S. A. (2011). Researching and analyzing vocabulary. Heinle, Cengage Learning.Google Scholar
  • Nomoto, H., Choi, H., Moeljadi, D., & Bond, F. (2018). MALINDO Morph: Morphological dictionary and analyser for Malay/Indonesian. In Proceedings...
  • Park, H., Solon, M., Dehghan-Chaleshtori, M., & Ghanbar, H. (2022). Proficiency reporting practices in research on second language acquisition:...
  • Puig-Mayenco, E., Chaouch-Orozco, A., Liu, H., & Martín-Villena, F. (2023). The LexTALE as a measure of L2 global proficiency: A cautionary...
  • Qian, D. D., & Lin, L. H. F. (2020). The relationship between vocabulary knowledge and language proficiency. In The Routledge handbook...
  • Rahman, A., Yap, N. T., & Darmi, R. (2018). The association between vocabulary size and language dominance of bilingual Malay-English...
  • Raven, J. (2000). The Raven’s progressive matrices: Change and Stability over Culture and time. Cognitive Psychology, 41(1), 1–48. https://doi.org/10.1006/cogp.1999.0735CrossRefGoogle...
  • Read, J. A. S. (2000). Assessing vocabulary. Cambridge University Press.CrossRefGoogle Scholar
  • Read, J. P., Haas, A. L., Radomski, S., Wickham, R. E., & Borish, S. E. (2015). Identification of hazardous drinking with the young adult...
  • Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J. C., & Muller, M. (2011). pROC: An open-source package for R and...
  • R Core Team (2021). R: A language and environment for statistical computing. Published online 2020. Supplemental Information References S,...
  • Rusli, A. G., Mohamed Husin, N., & Chin, L. Y. (2006). Pangkalan data korpus DBP: Perancangan, pembinaan dan pemanfaatan. In Ahmad, Z....
  • Salmela, R., Lehtonen, M., Garusi, S., & Bertram, R. (2021). Lexize: A test to quickly assess vocabulary knowledge in Finnish. Scandinavian...
  • Sarrett, M., Shea, C., & McMurray, B. (2022). Within- and between-language competition in adult second language learners: Implications...
  • Schmitt, N. (2010). Issues of vocabulary acquisition and use. In: Researching vocabulary. Research and practice in applied linguistics. Palgrave...
  • Schmitt, N., Cobb, T., Horst, M., & Schmitt, D. (2015). How much vocabulary is needed to use English? Replication of van Zeeland &...
  • Schmitt, N., Nation, P., & Kremmel, B. (2019). Moving the field of vocabulary assessment forward: The need for more rigorous test development...
  • Schmitt, N., Schmitt, D., & Clapham, C. (2001). Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test....
  • Singh, A., Wang, M., & Faroqi-Shah, Y. (2022). The influence of romanizing a non-alphabetic L1 on L2 reading: the case of Hindi–English...
  • Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87(2), 245–251. https://doi.org/10.1037/0033-2909.87.2.245CrossRefGoogle...
  • Stewart, J., Gyllstad, H., Nicklin, C., & McLean, S. (2023). Establishing meaning recall and meaning recognition vocabulary knowledge...
  • Surrain, S., & Luk, G. (2019). Describing bilinguals: A systematic review of labels and descriptions used in the literature between 2005–2015....
  • Tosun, S., Filipović, L. (2022). Lost in translation, apparently: Bilingual language processing of evidentiality in a Turkish–English Translation...
  • Treffers-Daller, J. (2019). What defines language dominance in bilinguals? Annual Review of Linguistics, 5(1), 375–393. https://doi.org/10.1146/annurev-linguistics-011817-045554CrossRefGoogle...
  • Tremblay, A. (2011). Proficiency assessment standards in second language acquisition research: “Clozing” the gap. Studies in Second Language...
  • van Heuven, W. J. B., Mandera, P., Keuleers, E., & Brysbaert, M. (2014). SUBTLEX-UK: A new and improved word frequency database for British...
  • Webb, S., Sasao, Y., & Ballance, O. (2017). The updated Vocabulary Levels Test: Developing and validating two new forms of the VLT. ITL...
  • Wen, Y., Qiu, Y., Leong, C. X. R., & van Heuven, W. J. B. (2023). LexCHI: A quick lexical test for estimating language proficiency in...
  • Wen, Y., & van Heuven, W. J. B. (2017). Non-cognate translation priming in masked priming lexical decision experiments: A meta-analysis....
  • Yap, M. J., Liow, S. J. R., Jalil, S. B., & Faizal, S. S. B. (2010). The Malay Lexicon Project: A database of lexical statistics for 9,592...
  • Zhang, X., Liu, J., & Ai, H. (2020). Pseudowords and guessing in the yes/no format vocabulary test. Language Testing, 37(1), 6–30. https://doi.org/10.1177/0265532219862265CrossRefGoogle...
  • Zhou, C., & Li, X. (2022). LextPT: A reliable and efficient vocabulary size test for L2 Portuguese proficiency. Behavior Research Methods,...