Evaluareed: desarrollo de una herramienta para la evaluación de la calidad de los recursos educativos electrónicos

• Autores: María Pinto Molina , Carmen Gómez Camarero , Andrés Fernández Ramos, Anne-Vinciane Doucet
• Localización: Investigación bibliotecológica, ISSN 0187-358X, ISSN-e 2448-8321, Vol. 31, Nº. 72, 2017, págs. 227-248
• Idioma: español
• DOI: 10.22201/iibi.0187358xp.2017.72.57831
• Títulos paralelos:
  • Evaluareed: Development of an online educational resources assessment instrument
• Enlaces
  • Texto completo
• Dialnet Métricas: 8 Citas
• Resumen
  • español

    Resumen: El objetivo de este trabajo es presentar el desarrollo de la herramienta Evaluareed, diseñada para evaluar recursos electrónicos educativos, en especial aquellos orientados a la enseñanza superior. A partir de la revisión de la literatura científica relativa a esta cuestión y utilizando una metodología con un doble enfoque cualitativo-cuantitativo, se definen un conjunto de criterios y subcriterios que conforman el checklist. Los indicadores de calidad son los siguientes: 1) calidad del contenido, 2) objetivos y metas de aprendizaje, 3) feedback, 4) usabilidad, 5) motivación, 6) accesibilidad, 7) requerimientos técnicos, 8) propiedad intelectual, y 9) efectividad del recurso desde el punto de vista del aprendizaje. El instrumento permite la evaluación de los recursos y genera un informe con la valoración de la calidad de los mismos y recomendaciones sobre su mejora. Se encuentra disponible en un portal web que proporciona además un repositorio de OCW’s evaluados de universidades españolas, una selección bibliográfica especializada e información relativa al desarrollo del proyecto.

  • English

    Abstract: The aim of this paper is to present the development of the Evaluareed instrument, designed to evaluate electronic educational resources, especially those oriented to higher education. From a review of the relevant scientific literature and using a qualitative-quantitative methodology, a set of criteria and sub-criteria are defined. The quality indicators of the checklist are: 1) quality of content, 2) learning aims and goals, 3) feedback, 4) usability, 5) motivation, 6) accessibility, 7) technical requirements, 8) intellectual property and 9) effectiveness of the resource in terms of learning. The instrument allows the evaluation of resources and generates a quality assessment report, showing data and improvement recommendations. It is available at a web site that also provides a repository of Open Course Ware (OCW) assessed from Spanish universities, a selection of literature and specialized information concerning project design.

• Referencias bibliográficas
  • Albion, P. R.. (1999). Heuristic evaluation of educational multimedia: from theory to practice. 16thAnnual Conference of the Australasian...
  • Barnes, S., Vidgen, R.. (2002). An integrative approach to the assessment of e-commerce quality. Journal of Electronic Commerce Research....
  • Benson, L., Elliott, D., Grant, M., Holschuh, D., Kim, B., Kim, H., Lauber, E., Loh, S., Reeves, T. C.. (2002). Proceedings of the World Conference...
  • Blummer, B. A., Kritskaya, O.. (2009). Best Practices for Creating an Online Tutorial: A Literature Review. Journal of Web Librarianship....
  • Bottentuit Junior, J. B., Coutinho, C. P.. (2008). The Conception of a Rubric to Evaluate Educational Portals on the Web. VIIIInternational...
  • (2002). Evaluating, selecting and managing learning resources.
  • Brodahl, C., Smestad, B. A.. (2009). A taxonomy as a Vehicle for Learning. Interdisciplinary Journal of E-Learning and Learning Objects. 5....
  • Coll, C., Mauri, T. Y., Onrubia, J.. (2008). Cómo valorar la calidad de la enseñanza basada en las TIC: Pautas e instrumentos de análisis....
  • Codina, L.. (2000). Evaluación de recursos digitales en línea: conceptos, indicadores y métodos. Revista Española de Documentación Científica....
  • Colomina, R., Onrubia, J. Y., Rochera, M. J.. (2001). Interactividad, mecanismos de influencia educativa y construcción del conocimiento en...
  • Davids, M. R., Chikte, U. M., Halperin, M. L.. (2014). Effect of improving the usability of an e-learning resource: a randomized trial. Advances...
  • Downes, S.. (2011). Open educational resources: A definition.
  • El Mhouti, A., Nasseh, A., Erradi, M.. (2013). Development of a Tool for Quality Assessment of Digital Learning Resources. International Journal...
  • Ho, W., Higson, H. E., Dey, P. K., Xu, X., Bahsoon, R.. (2009). Measuring performance of virtual learning environment system in higher education....
  • Horila, M., Nokelainen, P., Syvänen, A.. (2002). Criteria for the pedagogical usability, version 1.0.. Häme Polytechnic and University of...
  • (1998). Ergonomic requirements for visual display terminals. ISO/IEC 9241.
  • Keller, J. M.. (2010). Motivational design for learning and performance. Springer. New York.
  • Krauss, F., Ally, M.. (2005). A Study of the Design and Evaluation of a Learning Object and Implications for Content Development. Interdisciplinary...
  • Kukulska-Hume, A., Shield, L.. (2004). Usability and Pedagogical Design: are Language Learning Websites Special?. ED-MEDIA 2004.
  • Laurillard, D.. (2002). Rethinking University Teaching: A Conversational Framework for the Effective Use of Learning Technologies. 2. Routledge....
  • Lera, E., Fernández, C., Almirall, M.. (2009). Emotions: the forgotten key success in online learning. 13thUNESCO-APEID International Conference...
  • (2010). The Delivery Guide: Evaluating learning resources.
  • Marzal, M. A., Calzada-Prado, J., Viannello, M.. (2008). Criterios para la evaluación de la usabilidad de los recursos educativos virtuales:...
  • Morales Morgado, E., Gómez Aguilar, D. A., García Penalvo, F. J.. (2008). X Simposio Internacional de Informática Educativa. Universidad de...
  • Nesbit, J. C., Belfer, K., Leacock, T.. (2003). Learning object review instrument (LORI). User Manual.
  • Nesbit, J. C., Belfer, K. Y., Vargo, J.. (2002). A convergent participation model for evaluation of learning objects. Canadian Journal of...
  • Nielsen, J.. (1993). Usability engineering. Academic Press. New York.
  • Nokelainen, P.. (2004). Proceedings of Society for Information Technology & Teacher Education International Conference 2004. AACE. Chesapeake,...
  • Nokelainen, P.. (2006). An empirical assessment of pedagogical usability criteria for digital learning material with elementary school students....
  • Olive, J., Makar, K., Hoyos, V., Kor, L. K., Kosheleva, O., Sträßer, R.. (2010). Mathematics Education and Technology-Rethinking the Terrain....
  • Oliver, R.. (2005). Quality assurance and e-learning: blue skies and pragmatism. ALT-J, Research in Learning Technology. 13. 173
  • Picard, R. W., Papert, S., Bender, W., Blumberg, B., Breazeal, C., Cavallo, D., Machover, T., Resnick, M., Roy, D., Strohecker, C.. (2004)....
  • Pinto, M., Gómez-Camarero, C., Fernández-Ramos, A.. (2012). Los recursos educativos electrónicos: perspectivas y herramientas de evaluación....
  • Preece, J., Rogers, Y., Sharp, H.. (2002). Interaction Design: Beyond Human-Computer Interaction. John Wiley & Sons. New York.
  • Quinn, C. N.. (1996). Pragmatic evaluation: lessons from usability. 13th Annual Conference of the Australasian Society for Computers in Learning...
  • Reeves, T. C.. (1997). Evaluating What Really Matters in Computer-Based Education.
  • Richter, T., McPherson, M.. (2012). Open Educational Resources: Education for the World?. Distance Education. 33. 201
  • Richter, T., Veith, P.. (2014). Fostering the Exploitation of Open Educational Resources. Open Praxis. 6. 205
  • Scanlon, E.. (2014). Scholarship in the digital age: Open educational resources, publication and public engagement. British Journal of Educational...
  • Shneiderman, B.. (1998). Designing the user interface: strategies for effective human-computer interaction. Addison-Wesley. Reading.
  • Squires, D.. (1999). Usability and Educational Software Design: Special Issue of Interacting with Computers. Interacting with Computers. 11....
  • Squires, D., Preece, J.. (1996). Usability and learning: evaluating the potential of educational software. Computers and Education. 27. 15-22
  • Squires, D., Preece, J.. (1999). Predicting quality in educational software: Evaluating for learning, usability and the synergy between them....
  • (2007). Checklist for Evaluating SREB-SCORE Learning Objects.
  • (2008). Evaluation Criteria for SREB-SCORE Assets.
  • Toll, Y. C., Ril, Y.. (2013). Aspectos e indicadores para evaluar la calidad de los objetos de aprendizaje creados en la Universidad de las...
  • Tramullas, J.. (2004). El diseño centrado en el usuario para la creación de productos y servicios de información digital. Revista iberoamericana...
  • (2002). Forum on the impact of open courseware for higher education in developing countries: final report.
  • Wang, Y., Chen, N. S.. (2009). Criteria for evaluating synchronous learning management systems: arguments from the distance language classroom....
  • Zaharias, P., Poylymenakou, A.. (2009). Developing a Usability Evaluation Method for E-learning Applications: From Functional Usability to...