Evaluating short-term changes in L2 complexity development

• Bulté, Bram ^[1] ; Housen, Alex ^[1]
  1. [1] Vrije Universiteit Brussel

     Vrije Universiteit Brussel

     Arrondissement Brussel-Hoofdstad, Bélgica

     
• Localización: Círculo de lingüística aplicada a la comunicación, ISSN-e 1576-4737, Nº. 63, 2015, págs. 43-76
• Idioma: inglés
• DOI: 10.5209/rev_CLAC.2015.v63.50169
• Enlaces
  • Texto completo
• Dialnet Métricas: 1 Cita
• Resumen

  • This paper reports on a study on the nature and extent of the development of English L2 writing proficiency of 45 adult ESL learners over the time of an intensive short-term EAP program as evaluated by means of objective measures targeting different components of lexical and syntactic complexity. In addition, we compare the scores on these measures with more holistic and subjective ratings of learners' overall writing quality. Results reveal that some measures, but not necessarily the most popular linguistic complexity measures (e.g., subordination ratios and lexical richness measures), can indeed adequately and validly capture development in L2 writing in short-term ESL courses. Results further suggest that different subcomponents of syntactic and lexical complexity in L2 writing develop at different rates, which stressed the importance of calculating a sufficiently wide range of complexity measures in order to obtain a comprehensive picture of L2 development.

• Referencias bibliográficas
  • Alderson, J.C. (2000). Testing in EAP: Progress? Achievement? Proficiency? In G.M. Blue, J. Milton, & J. Saville (Eds.), Assessing English...
  • Bachman, L. (2005). Statistical Analysis for Language Assessment. Oxford: Oxford University Press.
  • Bulté, B. (2007). Measure for Measure: Why Type/Token ratio based measures are not valid to assess lexical complexity/richness as a dimension...
  • Bulté, B. (2013). The development of complexity in second language acquisition. A dynamic systems approach. Unpublished doctoral dissertation,...
  • Bulté, B., & Housen, A. (2012). Defining and Operationalising L2 Complexity. In A. Housen, F. Kuiken, & I. Vedder (Eds), Dimensions...
  • Bulté, B., Housen A., Pierrard, M., & Van Daele, S. (2008). Investigating lexical proficiency development over time: the case of Dutch-speaking...
  • Byrnes, H., Maxim H., & Norris, J.M. (2010). Realizing advanced foreign language writing development in collegiate education: Curricular...
  • Coxhead, A. (2000). A new academic word list. TESOL Quarterly, 34, 213-238.
  • Crystal, D. (1997). The Cambridge Encyclopedia of Language. Cambridge: Cambridge University Press.
  • Cumming, A. (1995). Fostering writing expertise in ESL composition instruction: Modeling and evaluation. In D. Belcher, & G. Braine (Eds.),...
  • Dahl, Ö. (2004). The Growth and Maintenance of Linguistic Complexity. Amsterdam: John Benjamins.
  • Daller, H., Van Hout, R., & Treffers-Daller, J. (2003). Lexical richness in the spontaneous speech of bilinguals. Applied Linguistics,...
  • Ehret, K., & Szmrecsanyi, B. (in press). An information-theoretic approach to assess linguistic complexity. In R. Baechler, & G. Seiler...
  • Ellis. R. (2008). The Study of Second Language Acquisition. Oxford: Oxford University Press.
  • Ellis. R. (2009). The differential effects of three types of task planning on the fluency, complexity, and accuracy in L2 oral production....
  • Ellis, R., & Barkhuizen, G. (2005). Analysing Learner Language. Oxford: Oxford University Press.
  • Engelhard, G. Jr. (1994). Examining rater errors in the assessment of written composition with a many-faceted Rasch model. Journal of Educational...
  • Foster, P., & Tavakoli, P. (2009). Lexical diversity and lexical selection: a comparison of native and non-native speaker performance....
  • Given, L.M. (2008). The Sage encyclopedia of qualitative research methods. Los Angeles, CA: Sage Publications.
  • Givon, T. (2009). The Genesis of Syntactic Complexity: Diachrony, Ontogeny, Neuro-Cognition, Evolution. Amsterdam: John Benjamins.
  • Guiraud, P. (1959). Problèmes et méthodes de la statistique linguistique. Dordrecht: Reidel.
  • Halliday, M.A.K. (1998). Things and relations: Regrammaticising experience as technical knowledge. In J.R. Martin, & R. Veel (Eds.), Reading...
  • Hartshorn, K.J., Evans, N.W., Merrill, P.F., Sudweeks, R.R., Strong-Krause, D., & Anderson, N. J. (2010). Effects of dynamic corrective...
  • Heatley, A., Nation, I. S. P., & Coxhead, A. (2002). Range [Computer software]. Retrieved from http://www.victoria.ac.nz/lals/staff/paul-nation/nation.aspx
  • Housen, A., & Kuiken F. (2009). Complexity, accuracy and fluency in second language acquisition. Applied Linguistics, 30(4), 461-473.
  • Housen, A., Kuiken, V., & Vedder, I. (2012). Complexity, accuracy and fluency: Definitions, measurement and research. In A. Housen, F....
  • Huddleston, R., & Pullum, G. (2002). The Cambridge grammar of the English language. New York: Cambridge University Press.
  • Jarvis, S. (2013). Capturing the Diversity in Lexical Diversity. Language Learning, 63 (Suppl. 1), 87-106.
  • Juola, P. (2008). Assessing linguistic complexity. In M. Miestamo, K. Sinnemäki, & F. Karlsson (Eds.), Language Complexity: Typology,...
  • Knoch, U., Read, J., & von Randow, J. (2007). Re-training writing raters online: How does it compare with face-to-face training? Assessing...
  • Kozaki, Y. (2004). Using GENOVA and FACETS to set multiple standards on performance assessment for certification in medical translation from...
  • Kuiken, F., & Vedder, I. (2011). Task complexity and linguistic performance in L2 writing and speaking: the effect of mode. In P. Robinson...
  • Kuiken, F., Vedder, I., & Gilabert, R. (2010). Communicative adequacy and linguistic complexity in L2 writing. In I. Bartning, M. Martin,...
  • Larsen-Freeman, D. (2006). The emergence of complexity, fluency, and accuracy in the oral and written production of five Chinese learners...
  • Larsen-Freeman, D. (2012). In A. Mackey and S. Gass (Eds.), Handbook of Second Language Acquisition (pp. 73-88). New York: Routledge.
  • Larsen-Freeman, D., & Cameron, L. (2008). Complex Systems and Applied Linguistics. Oxford: Oxford University Press.
  • Larsen-Freeman, D., & Strom, V. (1977). The construction of a second language acquisition index of development. Language Learning, 27,...
  • Leaver, B. L., & Shekhtman, B. (2002). Principles and practices in teaching superior-level language skills: Not just more of the same....
  • Lennon, P. (1995). Assessing short-term change in advanced oral proficiency: Problems of reli-ability and validity in four case studies. ITL...
  • Levelt, W.J. (1989). Speaking: From intention to articulation. Cambridge: MIT Press.
  • MacWhinney, B. (2000). The CHILDES project: Tools for analyzing talk. Mahwah, NJ: Lawrence Erlbaum Associates.
  • Malvern, D., Chipere, N., Richards, B., & Durán, P. (2004). Lexical Diversity and Language Development: Quantification and Assessment....
  • McCarthy, P., & Jarvis, S. (2007). Vocd: A theoretical and empirical evaluation. Language Testing, 24(4), 459-488.
  • McCarthy, P., & Jarvis, S. (2010). MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment....
  • McWhorter, J. (2001). The world's simplest grammars are creole grammars. Linguistic Typology 5(2/3), 125-167.
  • McWorther, J. (2011). Linguistic Simplicity and Complexity: Why Do Languages Undress? Boston/Berlin: Walter De Gruyter.
  • Miestamo, M. (2008). Grammatical complexity in a cross-linguistic perspective. In M. Miestamo, K. Sinnemäki, & F. Karlsson (Eds), Language...
  • Mitchell, M. (2009). Complexity-A Guided Tour. Oxford: Oxford University Press.
  • Nation, P. (2006). How large a vocabulary is needed for reading and listening? Canadian Modern Language Review, 63(1), 59-81.
  • Norris, J. M., & Ortega, L. (2009). Measurement for understanding: An organic approach to investigating complexity, accuracy, and fluency...
  • Ortega, L. (2003). Syntactic complexity measures and their relationship to L2 proficiency: a research synthesis of college-level L2 writing....
  • Ortega, L. (2012). Interlanguage complexity: A construct in search of theoretical renewal. In B. Kortmann, & B. Szmrecsanyi (Eds.), Linguistic...
  • Pallotti, G. (2009). CAF: Defining, refining and differentiating constructs. Applied Linguistics, 30(4), 590-601.
  • Polio, C. (2001). Research methodology in second language writing: The case of text-based studies. In T. Silva, & P. Matsuda (Eds.), On...
  • Politzer, R. L., & McGroarty, M. (1985). An exploratory study of learning behaviors and their relationship to gains in linguistic and...
  • Rifkin, B. (2005). A ceiling effect in traditional classroom foreign language instruction: Data from Russian. Modern Language Journal, 89(1),...
  • Rimmer, W. (2006). Measuring grammatical complexity: the Gordian knot. Language Testing, 23(4), 497-519.
  • Robinson, P. (2001). Task complexity, task difficulty, and task production: Exploring interactions in a componential framework. Applied Linguistics...
  • Sampson, G., Gil, D., & Trudgill, P. (2009). Language Complexity as an Evolving Variable. Oxford: Oxford University Press.
  • Serrano, R., Tragant, E., & Llanes, A. (2012). A longitudinal analysis of the effects of one year abroad. Canadian Modern Language Review,...
  • Skehan, P. (1998). A Cognitive Approach to Language Learning. Oxford: Oxford University Press.
  • Skehan, P. (2003). Task-based instruction. Language Teaching, 36, 1-14.
  • Skehan, P. (2009a). Lexical performance by native and non-native speakers on language learning tasks. In B. Richards, H.M. Daller, D. Malvern,...
  • Skehan, P. (2009b). Modelling Second Language Performance: Integrating complexity, accuracy, fluency and lexis. Applied Linguistics, 30, 510-532.
  • Skehan, P. and Foster, P. (1997) Task type and processing conditions as influences on foreign language performance. Language Teaching Research...
  • Skehan, P., & Foster, P. (2001). Cognition and tasks. In P. Robinson (Ed.), Cognition and second language instruction (pp. 183-205). Cambridge:...
  • Skehan, P., & Foster, P. (2012). Complexity, accuracy, fluency and lexis in task-based performance. In A. Housen, F. Kuiken, & I....
  • Spoelman, M., & Verspoor, M. (2010). Dynamic Patterns in Development of Accuracy and Complexity: A Longitudinal Case Study in the Acquisition...
  • Storch, N. (2009). The impact of studying in a second language (L2) medium university on the development of L2 writing. Journal of Second...
  • Thomas, M. (1994). Assessment of L2 proficiency in second language acquisition research. Language Learning, 44, 307-336.
  • Tonkyn, A. (2012). Measuring and perceiving changes in oral complexity, accuracy and fluency: Examining instructed learners' short-term...
  • Verspoor, M., Lowie, W., & van Dijk, M. (2008). Variability in Second Language Development From a Dynamic Systems Perspective. Modern...
  • Verspoor, M., & Sauter, K. (2000). English Sentence Analysis: an introductory course. Amsterdam: John Benjamins.
  • Verspoor, M., Schmidt, M., & Xu, J. (2012). A dynamic usage based perspective on L2 writing. Journal of Second Language Writing, 21(3),...
  • Vyatkina, N. (2012). The Development of Second Language Writing Complexity in Groups and Individuals: A Longitudinal Learner Corpus Study....
  • Westaway, G., Alderson, J.C., & Clapham, C.M. (1990). Directions in Testing for Specific Purposes. In J.H.A.L. de Jong, & D.K. Stevenson...
  • Wette, R. (2010). Evaluating student learning in a university-level EAP unit on writing using sources. Journal of Second Language Writing,...
  • White, E. (1994). Teaching and assessing writing. (2nd ed.). San Francisco: Jossey-Bass Publishers.
  • Wolfe-Quintero, K., Inagaki, S., & Kim, H.-Y. (1998). Second Language Development in Writing: Measures of Fluency, Accuracy, and Complexity....
  • Yorozuya, R., & Oller, J.W. Jr. (1980). Oral proficiency scales: Construct validity and the halo effect. Language Learning, 30(1), 135-153.