Indicators of pedagogical quality for the design of a Massive Open Online Course for teacher training

Lorena Aleman de la Garza, Teresa Sancho Vinuesa, Marcela Georgina Gomez Zermeño

Abstract


Massive Open Online Courses (MOOCs) have generated high expectations and revolutionized some educational practices by providing open educational resources for reference, usage and adaptation; therefore, their pedagogical quality is often questioned. The objective of this study is to identify indicators related to pedagogical, functional, technological and time factors in order to assess the quality of the MOOC entitled “Liderazgo en gestión educativa estratégica a través del uso de la tecnología” (Leadership in strategic educational management through the use of technology), offered as a teacher training program through Coursera to 10.161 participants. Via the Delphi method, a group of 55 experts agreed that time is a key factor to be considered in the design of learning activities. It was concluded that without measuring results, the success of a MOOC could not be evaluated; thus, institutions and consortia must establish evaluation indicators to focus their efforts on the enhancement of pedagogical quality. By providing relevant information, the learning potential of educational resources based on connectivist principles can be evaluated, and so can the quality of MOOCs. The goal is to contribute to a vision of a future in which everyone has access to a world-class education.


Keywords


Massive Open Online Courses, MOOC, evaluation, pedagogical quality, teacher training

References


Aceto, S., Borotis, S., Devine, J., & Fischer T. (2014). Mapping and Analysing Prospective Technologies for Learning. Seville, Spain: Joint Research Centre, Institute for Prospective Technological Studies.

Arias, J. (2007). Evaluación de la calidad de Cursos Virtuales: Indicadores de Calidad y construcción de un cuestionario de medida (Doctoral dissertation). University of Extremadura, Extremadura, Spain.

Astigarraga, E. (2003). El método delphi. San Sebastián, Spain: Universidad de Deusto.

Barbera, E., Gros, B., & Kirschner, P. (2012). Temporal issues in e-learning research: A literature review. British Journal of Educational Technology, 43(2), 53-55. doi: 10.1111/j.1467-8535.2011.01255.x

Bell, M. (2012). Massive open online courses moving ahead with MOOCs. Internet@Schools, 19(5). Retrieved from http://www.internetatschools.com/Articles/Column/Belltones/BELLTONES-Massive-Open-Online-Courses--Moving-Ahead-With-MOOCs-85936.aspx

Bernal, Y., Molina, M., & Pérez, M. (2013). La Calidad de la Educación a Distancia: El caso de los MOOC. Revista Iberoamericana para la Investigación y el Desarrollo Educativo, 3(10), 1-13. Retrieved from http://www.ride.org.mx/docs/publicaciones/10/psicologia_y_educacion/E06_.pdf

Boven, D. (2013). The Next Game Changer: The Historical Antecedents of the MOOC Movement in Education. eLearning Papers, 33, 1-7. Retrieved from http://www.openeducationeuropa.eu/en/download/file/fid/26967

Breslow, L., Pritchard, D., DeBoer, J., Stump, G., Ho, A., & Seaton, D. (2013). Studying learning in the worldwide classroom: Research into edX’s first MOOC. Research & Practice in Assessment Journal, 8, 13-25. Retrieved from http://www.rpajournal.com/dev/wp-content/uploads/2013/05/SF2.pdf

Brown, S. (2013). Back to the future with MOOCs. ICICTE 2013 Proceedings, 237-246. Retrieved from http://www.icicte.org/Proceedings2013/Papers%202013/06-3-Brown.pdf

Cabero, J., & Romero, R. (2007). Diseño y producción de TIC para la formación. Barcelona, Spain: UOC.

Chiecher, A., & Donolo, D. (2013). Trabajo grupal mediado por foros. Aportes para el análisis de la presencia social, cognitiva y didáctica en la comunicación asincrónica. In A. C. Chiecher, D. S. Donolo, & J. L. Córica (Eds.), Entornos virtuales y aprendizaje. Nuevas perspectivas de estudio e investigaciones (pp. 151-198). Mendoza, Argentina: Editorial Virtual Argentina.

Cross, S. (2013). Evaluation of the OLDS MOOC curriculum design course: participant perspectives, expectations and experiences. OLDS MOOC Project, Milton Keynes, United Kingdom.

Domingo, M., & Marquès, P. (2011). Classroom 2.0 Experiences and Building on the Use of ICT in Teaching. Comunicar, 18(37), 169-174. http://dx.doi.org/10.3916/C37-2011-03-09

EDUCAUSE (2011). 7 things you should know about MOOCs. EDUCAUSE Learning Initiative.

European Foundation for Quality in e-Learning [EFQUEL] (2013). The MOOC Quality Project. Retrieved from http://mooc.efquel.org/the-mooc-quality-project/

Franco-Casamitjana, M., Barbera, E., & Romero, M. (2013). A Methodological Definition for Time Regulation Patterns and Learning Efficiency in Collaborative Learning Contexts. eLC Research Paper Series, 6, 52-62. Retrieved from http://journals.uoc.edu/index.php/elcrps/article/download/1871/n6-franco-casamitjana

Friedman, T. (2013, January 26). Revolution hits the universities. The New York Times, The opinion pages. Retrieved from http://www.nytimes.com/

Garrido, A. (2003). El aprendizaje como identidad de participación en la práctica de una comunidad virtual (Doctoral dissertation). Universitat Oberta de Catalunya, Barcelona.

Gómez-Zermeño, M. G. (2012). Bibliotecas digitales: recursos bibliográficos electrónicos en educación básica. Comunicar, 20(39), 119-128. Retrieved from http://www.revistacomunicar.com/index.php?contenido=detalles&numero=39&articulo=39-2012-14

Gómez-Zermeño, M. G., & Alemán, L. Y. (2012). Administración de proyectos de capacitación basados en tecnología. Monterrey, Mexico: Editorial Digital del Tecnológico de Monterrey.

Gómez-Zermeño, M. G., Rodríguez, J. A., & Márquez, S. (2013). Estudio Exploratorio-Descriptivo “Curso Híbrido: Contabilidad V”. Revista de Investigación Educativa de la Escuela de Graduados en Educación, 4(7), 70-79. Retrieved from http://rieege.tecvirtual.mx/index.php/rieege/article/view/126

Gros, B., Barbera, E., & Kirschner, P. (2010). Time factor in e-Learning: impact literature review. eLC Research Paper Series, 0, 16-31. Retrieved from http://journals.uoc.edu/index.php/elcrps/article/download/issue0-gros-barbera-kirshner/issue0-gros-barbera-kirshner

Guitert, M. (2011). Time management in virtual collaborative learning: the case of the Universitat Oberta de Catalunya (UOC). eLC Research Paper Series, 2, 5-16. Retrieved from http://journals.uoc.edu/index.php/elcrps/article/download/n2-guitert-catasus/n2-guitert-catasus

ITESM (2014). Formación que transforma vidas. Monterrey, Mexico: Tecnológico de Monterrey.

Liyanagunawardena, T., Adams, A., & Williams, S. (2013). MOOCs: A systematic study of the published literature 2008-2012. The International Review of Research in Open and Distance Learning, 14(3), 202-227. Retrieved from http://www.irrodl.org/index.php/irrodl/article/download/1455/2602

McAuley, A., Stewart, B., Siemens, G., & Cormier, D. (2010). The MOOC model for digital practice. Digital ways of knowing and learning. Charlottetown, Canada: University of Prince Edward.

Menéndez, L. (2013). Estudiar ‘online’ y gratis. Escritura Pública, 80, 18-21. Retrieved from http://www.notariado.org/liferay/c/document_library/get_file?folderId=12092&name=DLFE-89971.pdf

Moore, M. G. (1983). Theory of transactional distance. In D. Keegan (Ed.), Theoretical Principles of Distance Education (pp. 22-38). New York, USA: Routledge.

Moore, M. G. (2013). The theory of transactional distance. In M. G. Moore (Ed.), Handbook of distance education (3rd ed., pp. 66-85). New York, USA: Routledge.

Observatorio de Innovación Educativa (May, 2014). Reporte Edu Trends. Monterrey, Mexico: Tecnológico de Monterrey. Retrieved from http://www.observatorioedu.com/redutrends

Penn GSE (2013). Study shows MOOCs have relatively few active users, with only a few persisting to course end. University of Pennsylvania: Graduate School of Education. Retrieved from http://www.gse.upenn.edu/pressroom/press-releases/2013/12/penn-gse-study-shows-moocs-have-relatively-few-active-users-only-few-persisti

Rodriguez, O. (2012). MOOCs and the AI-Stanford like Courses: two successful and distinct course formats for massive open online courses. European Journal of Open, Distance, and E-Learning, 2012(2), 1-13. Retrieved from http://www.eurodl.org/materials/contrib/2012/Rodriguez.pdf

Roig, R., Flores, C., Álvarez, J., Blasco, J., Grau, S., Guarinos, I., Tortosa, M. (2013). Características de los ambientes de aprendizaje on-line para una práctica docente de calidad. Indicadores de evaluación. Alicante, Spain: Universidad de Alicante.

Romero, M. (2011). The time factor in an online group course from the point of view of its students. eLC Research Paper Series, 2, 17-28. Retrieved from http://journals.uoc.edu/index.php/elcrps/article/download/n2-romero/n2-romero

Sangrà, A., & Wheeler, S. (2013). New Informal Ways of Learning: Or Are We Formalising the Informal? RUSC. Universities and Knowledge Society Journal, 10(1), 286-293. http://dx.doi.org/10.7238/rusc.v10i1.1689

Schmelkes, S. (2001). La investigación en la innovación educativa. Mexico: CINVESTAV.

SCOPEO (2013). MOOC: Estado de la situación actual, posibilidades, retos y futuro. SCOPEO Report No 2, June 2013. Retrieved from http://scopeo.usal.es/wp-content/uploads/2013/06/scopeoi002.pdf

Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, USA: Houghton Mifflin.

Siemens, G. (2004). Connectivism. A learning theory for the digital age. International Journal of Instructional Technology and Distance learning, 2(1), 3-10. Retrieved from http://www.itdl.org/journal/jan_05/Jan_05.pdf

Skiba, D. (2013). MOOCs and the Future of Nursing. Nursing Education Perspectives, 34(3), 202-204. doi: 10.5480/1536-5026-34.3.202

The New Media Consortium & Universitat Oberta de Catalunya (2012). Perspectivas tecnológicas: educación superior en Iberoamérica 2012-2017: Un Análisis Regional del Informe Horizon del NMC y la UOC. Barcelona, Spain: UOC.

Tschofen, C., & Mackness, J. (2012). Connectivism and dimensions of individual experience. The International Review of Research in Open and Distance Learning, 13(1), 124-143. Retrieved from http://www.irrodl.org/index.php/irrodl/article/download/1143/2117

UNESCO (2012). 2012 Paris OER Declaration. 2012 World Open Educational Resources (OER) Congress. Paris, France: UNESCO.

Zapata-Ros, M. (2013). MOOCs, una visión crítica y una alternativa complementaria: La individualización del aprendizaje y de la ayuda pedagógica. Universidad de Alcalá de Henares, Spain. Retrieved from http://eprints.rclis.org/18658/7/MOOC_zapata_preprint.pdf




DOI: http://dx.doi.org/10.7238/rusc.v12i1.2260

Refbacks

  • There are currently no refbacks.




 Universitat Oberta de Catalunya. eLearn Center

RUSC. Universities and Knowledge Society Journal is an e-journal edited by the Universitat Oberta de Catalunya (Barcelona).

Creative Commons
The texts published in this journal are – unless indicated otherwise – covered by the Creative Commons Spain Attribution 3.0 licence. You may copy, distribute, transmit and adapt the work, provided you attribute it (authorship, journal name, publisher) in the manner specified by the author(s) or licensor(s). The full text of the licence can be consulted here: http://creativecommons.org/licenses/by/3.0/es/deed.en.