Conducting psycholinguistic research online: Comparable evidence of second language lexical and sentence-level processing in web-based versus lab-based studies

• Gastmann, Freya ^[1] ; Schimke, Sarah ^[1] ; Poarch, Gregory J. ^[2]
  1. [1] Ludwig Maximilian University of Munich

     Ludwig Maximilian University of Munich

     Kreisfreie Stadt München, Alemania

     
  2. [2] University of Groningen

     University of Groningen

     Países Bajos

     
• Localización: Bilingualism: Language and cognition, ISSN 1366-7289, Vol. 29, Nº 3, 2026, págs. 615-628
• Idioma: inglés
• DOI: 10.1017/s136672892510028x
• Texto completo no disponible (Saber más ...)
• Resumen

  • Although web-based data collection has become increasingly popular in (linguistic) research over the past years, many researchers are still cautious about collecting data via the internet. Thus, this study aims at comparing web-based and lab-based testing of linguistic manipulations that have resulted in robust findings in previous lab-based research on bilingual language processing. A total of 134 L1 German students of L2 English participated in two experiments in a web-based ( n  = 78) or lab-based setting ( n  = 56). The study examined potential language co-activation through cognates in an English Lexical Decision Task (Experiment 1) and the use of L2 lexical and syntactic information in English relative clause processing in a Self-paced Reading Task (Experiment 2). We found comparable evidence of lexical and syntactic processing in both groups in both experiments. Critically, this paper provides important methodological implications for web-based data collections with second language learners.

• Referencias bibliográficas
  • Anderson, J. A. E., Mak, L., Keyvani Chahi, A., & Bialystok, E. (2018). The language and social background questionnaire: Assessing degree...
  • Anwyl-Irvine, A., Dalmaijer, E. S., Hodges, N., & Evershed, J. K. (2021). Realistic precision and accuracy of online experiment platforms,...
  • Balota, D. A., Yap, M. J., Hutchison, K. A., Cortese, M. J., Kessler, B., Loftis, B., Neely, J. H., Nelson, D. L., Simpson, G. B., & Treiman,...
  • Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software,...
  • Ben-Shachar, M. S., Lüdecke, D., & Makowski, D. (2020). Effectsize: Estimation of effect size indices and standardized parameters. Journal...
  • Berger, C., Crossley, S., & Skalicky, S. (2019). Using lexical features to investigate second language lexical decision performance. Studies...
  • Bever, T. G. (1970). The cognitive basis for linguistic structures. In Hayes, R. (Ed.), Cognition and language development (pp. 279–362)....
  • Bridges, D., Pitiot, A., MacAskill, M. R., & Peirce, J. W. (2020). The timing mega-study: Comparing a range of experiment generators,...
  • Brysbaert, M., & New, B. (2009). Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction...
  • Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon’s mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives...
  • Bultena, S., Dijkstra, T., & Van Hell, J. G. (2014). Cognate effects in sentence context depend on word class, L2 proficiency, and task....
  • De Leeuw, J. R., & Motz, B. A. (2016). Psychophysics in a web browser? Comparing response times collected with JavaScript and psychophysics...
  • Dijkstra, T., Miwa, K., Brummelhuis, B., Sappelli, M., & Baayen, H. (2010). How cross-language similarity and task demands affect cognate...
  • Dijkstra, T., Van Hell, J. G., & Brenders, P. (2015). Sentence context effects in bilingual word recognition: Cognate status, sentence...
  • Dirix, N., Brysbaert, M., & Duyck, W. (2019). How well do word recognition measures correlate? Effects of language context and repeated...
  • Ellis, R. (2004). Individual differences in second language learning. In Davies, & Elder, C. (Eds.), The handbook of applied linguistics...
  • Ferreira, F. (2003). The misinterpretation of noncanonical sentences. Cognitive Psychology, 47(2), 164–203. https://doi.org/10.1016/S0010-0285(03)00005-7.
  • Gagné, N., & Franzen, L. (2023). How to run behavioural experiments online: Best practice suggestions for cognitive psychology and neuroscience....
  • Garcia, R., Roeser, J., & Kidd, E. (2022). Online data collection to address language sampling bias: Lessons from the COVID-19 pandemic....
  • Germine, L., Nakayama, K., Duchaine, B. C., Chabris, C. F., Chatterjee, G., & Wilmer, J. B. (2012). Is the web as good as the lab? Comparable...
  • Gibson, E. (1998). Linguistic complexity: Locality of syntactic dependencies. Cognition, 68(1), 1–76. https://doi.org/10.1016/S0010-0277(98)00034-1.
  • He, J., Meyer, A. S., Creemers, A., & Brehm, L. (2021). Conducting language production research online: A web-based study of semantic...
  • Hilbig, B. E. (2016). Reaction time effects in lab- versus web-based research: Experimental evidence. Behavior Research Methods, 48, 1718–1724....
  • Hopp, H. (2017). Cross-linguistic lexical and syntactic co-activation in L2 sentence processing. Linguistic Approaches to Bilingualism, 7(1),...
  • Kim, D., Lowder, M. W., & Choi, W. (2023). Emotionality effects in Korean visual word recognition: Evidence from lab-based and web-based...
  • Klassen, R., Kolb, N., Hopp, H., & Westergaard, M. (2022). Interactions between lexical and syntactic L1-L2 overlap: Effects of gender...
  • Kochari, A. R. (2019). Conducting web-based experiments for numerical cognition research. Journal of Cognition, 2(1). https://doi.org/10.5334/joc.85.
  • Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest package: Tests in linear mixed effects models. Journal of Statistical...
  • Lange, K., Kühn, S., & Filevich, E. (2015). Just another tool for online studies” (JATOS): An easy solution for setup and management of...
  • Lau, E., & Tanaka, N. (2021). The subject advantage in relative clauses: A review. Glossa, 6(1), 1–34. https://doi.org/10.5334/gjgl.1343.
  • Lauro, J., & Schwartz, A. I. (2017). Bilingual non-selective lexical access in sentence contexts: A meta-analytic review. Journal of Memory...
  • Lemhöfer, K., & Broersma, M. (2012). Introducing LexTALE: A quick and valid lexical test for advanced learners of English. Behavior Research...
  • Lemhöfer, K., Huestegge, L., & Mulder, K. (2018). Another cup of TEE? The processing of second language near-cognates in first language...
  • Levenshtein, V. I. (1966). Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady, 10, 707–710.
  • Lim, J. H., & Christianson, K. (2013). Second language sentence processing in reading for comprehension and translation. Bilingualism:...
  • Mathôt, S., & March, J. (2022). Conducting linguistic experiments online with OpenSesame and OSWeb. Language Learning, 72(4), 1017–1048....
  • Mathôt, S., Schreij, D., & Theeuwes, J. (2012). OpenSesame: An open-source, graphical experiment builder for the social sciences. Behavior...
  • Miller, A. K. (2014). Accessing and maintaining referents in L2 processing of WH-dependencies. Linguistic Approaches to Bilingualism, 4(2),...
  • Miller, R., Schmidt, K., Kirschbaum, C., & Enge, S. (2018). Comparability, stability, and reliability of internet-based mental chronometry...
  • Neath, I., Earle, A., Hallett, D., & Surprenant, A. M. (2011). Response time accuracy in Apple Macintosh computers. Behavior Research...
  • Patterson, A. S., & Nicklin, C. (2023). L2 self-paced reading data collection across three contexts: In-person, online, and crowdsourcing....
  • Peeters, D., Dijkstra, T., & Grainger, J. (2013). The representation and processing of identical cognates by late bilinguals: RT and ERP...
  • Pronk, T., Wiers, R. W., Molenkamp, B., & Murre, J. (2020). Mental chronometry in the pocket? Timing accuracy of web applications on touchscreen...
  • Reimers, S., & Stewart, N. (2015). Presentation and response timing accuracy in adobe flash and HTML5/JavaScript web experiments. Behavior...
  • Rodd, J. M. (2024). Moving experimental psychology online: How to obtain high quality data when we can’t see our participants. Journal of...
  • Sauter, M., Draschkow, D., & Mack, W. (2020). Building, hosting and recruiting: A brief introduction to running behavioral experiments...
  • Sauter, M., Stefani, M., & Mack, W. (2022). Equal quality for online and lab data: A direct comparison from two dual-task paradigms. Open...
  • Schepens, J., Dijkstra, T., & Grootjen, F. (2012). Distributions of cognates in Europe as based on Levenshtein distance. Bilingualism:...
  • Semmelmann, K., & Weigelt, S. (2017). Online psychophysics: Reaction time effects in cognitive experiments. Behavior Research Methods,...
  • Stanners, R. F., Jastrzembski, J. E., & Westbrook, A. (1975). Frequency and visual quality in a word-nonword classification task. Journal...
  • Team, R. C. (2024). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
  • Tiffin-Richards, S. P. (2024). Cognate facilitation in bilingual reading: The influence of orthographic and phonological similarity on lexical...
  • van der Ploeg, M., Lowie, W., & Keijzer, M. (2023). The effects of language teaching pedagogy on cognitive functioning in older adults....
  • VanPatten, B. (2015). Input processing in adult SLA. In VanPatten, B. & Williams, J. (Eds.), Theories in second language acquisition (pp....
  • Voeten, C. C. (2021). Buildmer: Stepwise elimination and term reordering for mixed-effects regression [Computer software]. R Foundation for...
  • Weydmann, G., Palmieri, I., Simões, R. A., Centurion Cabral, J. C., Eckhardt, J., Tavares, P., Moro, C., Alves, P., Buchmann, S., Schmidt,...
  • Williams, J. N. (2006). Incremental interpretation in second language sentence processing. Bilingualism: Language and Cognition, 9(1), 71–88....
  • Yetano, A., & Royo, S. (2017). Keeping citizens engaged: A comparison between online and offline participants. Administration & Society,...