Consideraciones de validez prioritaria para la evaluación formativa y de rendición de cuentas

• Autores: Eva Baker
• Localización: Revista de educación, ISSN 0034-8082, Nº 348, 2009 (Ejemplar dedicado a: El valor añadido en educación), págs. 91-110
• Idioma: español
• Títulos paralelos:
  • Priority validity considerations for formative and accountability assessment
• Enlaces
  • Texto completo
• Resumen
  • español

    Este artículo se centra en la validez de los sistemas de evaluación (Baker, 2007a) usados en las escuelas con la intención de mejorar la instrucción, bien a través de evaluaciones formativas o de evaluaciones para la rendición de cuentas. El argumento que se presenta apoya la necesidad de estudios de la sensibilidad instructiva de los tests, necesitando medidas mejores y más equiparadas con la enseñanza en el aula. La agenda de investigación caracteriza a estas preocupaciones como extensas y esenciales.A través de la presentación de los trabajos que se realizan en el CRESST (Center for Research on Evaluation, Standards and Student Testing), de la Universidad de California en los Ángeles, su directora, Eva Baker, expone la importancia de la sensibilidad instructiva y los aspectos que se derivan de ella para, posteriormente, pasar a exponer una serie de cuestiones relativas al diseño de pruebas referidas a criterio (CRT). Finalmente, se comenta la situación en la actualidad en los Estados Unidos, donde se realizan evaluaciones con base normativa. Planteadas estas cuestiones, se pone en relación dos importantes aspectos relacionados con la evaluación de los aprendizajes, a saber, la sensibilidad instructiva y las pruebas que persiguen objetivos múltiples. Como conclusión del artículo presentado se presenta un resumen,de modo provisional,sobre las cuestiones que se asumen para la sensibilidad de la instrucción, así como argumentos a favor y en contra de la misma. Se concluye presentando las experiencias del CRESST en el tema.

  • English

    This paper focuses on validity of testing systems (Baker, 2007a) used in schools intended to improve instruction, either through formative or accountability-based assessments. The argument put forward supports the need for studies of the instructional sensitivity of tests to assure that they are actually measuring school effects.The research agenda suggested by these concerns is extensive and essential. Eva L. Baker presents CRESST (Center for Research on Evaluation, Standards and Student Testing, University of California, Los Angeles) research jobs related to instructional validity and main issues related to Criterion Referenced Test (CRT). Finally, in order to conduct such studies, better and more scalable measures of classroom instruction are needed.

• Referencias bibliográficas
  • AMERICAN EDUCATIONAL RESEARCH ASSOCIATION (2008). Unleashing the power of formative assessment: A strategy for integrating cognitive research,...
  • AMERICAN EDUCATIONAL RESEARCH ASSOCIATION, AMERICAN PSYCHOLOGICAL ASSOCIATION, & NATIONAL COUNCIL ON MEASUREMENT IN EDUCATION. (1999)....
  • AGUIRRE-MUÑOZ, Z., BOSCARDIN, C. K., JONES, B., PARK, J. E., CHINEN, M., SHIN, H. S., LEE, J., AMABISCA, A.A. Y & BENNER, A. (2006). Opportunity...
  • ASCHBACHER, P. R. (1999). Developing indicators of classroom practice to monitor and support school reform (CSE Rep. 513). Los Angeles: University...
  • BAKER, E. L. (in press). Learning and assessment in an accountability context. In K. Ryan & L.A. Shepard (Eds.), The future of test-based...
  • BAKER, E. L. (1997). Model-based performance assessment. Theory Into Practice, 36, 247-254.
  • BAKER, E. L. (2005). Aligning curriculum, standards, and assessments: Fulfilling the promise of school reform. In C.A.DWYER (Ed.), Measurement...
  • BAKER, E. L. (2007). Model-based assessments to support learning and accountability: The evolution of CRESST's research on multiple-purpose...
  • BAKER, E. L. (2008). Empirically determining the instructional sensitivity of an accountability test. Paper presented at the annual meeting...
  • BAKER, E.L. (2008).Empirically determining the instructional sensitivity of an accountability test. Artículo presentado en la reunión anual...
  • BAKER, E., GOLDSCHMID T,P., MARTÍNEZ, F. & SWIGERT, S. (February, 2002). In search of school quality and accountability: Moving beyond...
  • BAKER, E. L., GRIFFIN, N. C. & CHOI, K. (in press). The achievement gap in California: Context, status, and approaches for improvement....
  • BAKER, E. L. & LINN, R. L. (2004). Validity issues for accountability systems. In S. H. Fuhrman & R.F.Elmore (Eds.), Redesigning accountability...
  • BAKER, E. L., NIEMI, D., HERL, H., AGUIRRE-MUÑOZ, Z., STALEY, L., LINN, R. L. & ROGOSA, D. (1996). Report on the content area performance...
  • BAKER, E. L., ONEIL, H. F. J. R. & LINN, R. L. (1993). Policy and validity prospects for performance-based assessment. American Psychologist,...
  • BAKER, E. L., PHELAN, J., CHOI, K., NIEMI, D., VENDLINSKI, T., GRIFFIN, N., HERMAN, J.L. & HOWARD, K. (in progress). Design and validation...
  • BERLINER, D.C. & CAHEN, L. S. (1973).Trait-treatment interaction and learning. Review of Research in Education, 1, 58-94.
  • BLACK, P. & WILIAM, D. (2003). In praise of educational research: formative assessment. British Educational Research Journal, 29, 623-637.
  • BOSCARDIN, C. K., AGUIRRE-MUÑOZ, Z., CHINEN, M., LEON, S. & SHIN, H. S. (2004). Consequences and validity of performance assessment for...
  • CHI, M.T. H., GLASER, R.& FARR, M. (Eds.). (1988). The nature of expertise. Hillsdale, NJ: Erlbaum.
  • CLARE, L. & ASCHBACHER, P.R. (2001). Exploring the technical quality of using assignments and student work as indicators of classroom...
  • CRONBACH, L. J. & SNOW, R. E. (1977).Aptitudes and instructional methods: A handbook for research on interactions. New York: Irvington.
  • GLASER, R. (1963). Instructional technology and the measurement of learning outcomes: Some questions. American Psychologist, 18, 519-521.
  • GOLDSCHMIDT, P., MARTINEZ, J.F., NIEMI, D. & BAKER, E.L. (2007). Relationships among measures as empirical evidence of validity: Incorporating...
  • HERMAN, J. L. & ABEDI, J. (2004). Issues in assessing English language learners' opportunity to learn mathematics (CSE Rep. 633)....
  • HERMAN, J. L. & BAKER, E. L. (2003). The Los Angeles Annenberg Metropolitan Project: Evaluation findings (CSE Tech. Rep. No. 591). Los...
  • HERMAN, J. L. & KLEIN, D. C. D. (1997). Assessing opportunity to learn: A California example (CSE Rep. 453). Los Angeles: University of...
  • HERMAN, J. L. & WEBB, N. M. (2007).Alignment methodologies. Applied Measurement in Education, 20, 1-5.
  • HIVELY, W., PATTERSON, H. L. & PAGE, S.H. (1968).A «universe-defined» system of arithmetic achievement tests. Journal of Educational Measurement,...
  • LINN, R. L., BAKER, E.L. & DUNBAR, S.B. (1991).Complex, performance-based assessment: Expectations and validation criteria. Educational...
  • LUMSDAINE, A.A. & GLASER, R. (Eds.). (1960). Teaching machines and programmed learning: A source book. Washington, DC: National Education...
  • MATSUMURA, L. C., GARNIER, H. E., PASCAL, J. & VALDES, R. (2002). Measuring instructional quality in accountability systems: Classroom...
  • MATSUMURA, L. C. & PASCAL, J. (2003). Teachers' assignments and student work: Opening a window on classroom practice (CSE Rep.602)....
  • MATSUMURA, L. C., SLATER, S. C., WOLF, M. K., CROSSON, A., LEVISON, A., PETERSON, M., RESNICK, L. & JUNKER, B.W. (2006). Using the instructional...
  • MESSICK, S. (1989).Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York: MacMillan.
  • NATIONAL COUNCIL ON EDUCATION STANDARDS AND TESTING. (1992). Raising standards for American education. Washington, DC: U.S. Government Printing...
  • NIEMI, D., WANG, J., STEINBERG, D. H., BAKER, E. L. & WANG, H. (2007). Instructional sensitivity of a complex language arts performance...
  • NO CHILD LEFT BEHIND ACT OF 2001, Pub. L. No. 107-110, § 115 Stat. 1425 (2002).
  • PELLEGRINO, J. P., CHUDOWSKY, N. & GLASER, R. (Eds.). (2001). Knowing what students know: The science and design of educational assessment....
  • POPHAM, W. J. & BAKER, E. L. (1970). Systematic instruction. Englewood Cliffs, NJ: Prentice-Hall.
  • POPHAM, W. J. & HUSEK, T. R. (1969). Implications of criterion-referenced measurement. Journal of Educational Measurement, 6, 1-9.
  • ROGOSA, D. (1999a). Accuracy of individual scores expressed in percentile ranks: Classical test theory calculations (CSE Tech.Rep.No.509)....
  • ROGOSA, D. (1999b). Accuracy of Year-1, Year-2 comparisons using individual percentile rank scores: Classical test theory calculations (CSE...
  • ROGOSA, D. (1999c).How accurate are the STAR national percentile rank scores for individual students? An interpretive guide. Palo Alto, CA:...
  • STECHER, B., BORKO, H., KUFFNER, K. L., MARTINEZ, F., ARNOLD, S. C., BARNES, D., CREIGHTON, L. & GILBERT, M. L. (2007). Using artifacts...
  • SWELLER, J. (1999). Instructional design in technical areas. Camberwell, Australia: ACER Press.
  • TOBIAS, S. (1976). Achievement treatment interactions. Review of Educational Research, 46, 61-74.
  • VENDLINSKI, T. P., BAKER, E. L. & NIEMI, D. (2008). Templates and objects in authoring problem-solving assessments. In E. BAKER, J. DICKIESON,...
  • VENDLINSKI, T. & STEVENS, R. (2000).The use of artificial neural nets (ANN) to help evaluate student problem solving strategies. In B....
  • WEBB, N. L. (1999). Research Monograph No. 18: Alignment of science and mathematics standards and assessments in four states. Madison,WI:...
  • YOON, B. & RESNICK, L. (1998). Instructional validity, opportunity to learn and equity: New standards examinations for the California...