e-Learning Quality: Identification of its Dimensions, Proposal and Validation of a Model for its Assessment in Higher Education
DOI:
https://doi.org/10.5944/ried.24.2.29073Keywords:
assessment, quality of teaching, education technology, higher education, teaching method, model buildingAbstract
Quality assessment in higher education institutions is a non-standardised process and it depends on each university. The digitalisation of teaching and the situations, which have occurred in recent times, have led to a notable increase in the interest and relevance of e-Learning in both the teaching as well as the learning processes, with quality also being understood as a fundamental element in its evaluation and improvement.
This research proposes the identification of the dimensions related to the e-Learning quality, noting the need of a new evaluative framework according to the analysis of the literature and, also, generating a new model. After its construction, this study focused on the validation of its content by four expert judges in the quality evaluation and e-Learning fields. This validation process included the development of a tool for the evaluation of its dimensions and items, as well as a presentation of the model. On the other hand, both a qualitative evaluation (content analysis and suggestions) as well as a quantitative evaluation (analysed through descriptive statistics and the CVC calculation) were carried out for evaluating the outcomes. This validation showed a high level of acceptance and conformity of the judges with the model, the dimensions and the proposed items.
Based on this validation, the final model was developed consisting of four main dimensions, 14 sub-dimensions and a total of 80 indicators that attempt to assess each relevant quality factor in e-Learning. Limitations and future avenues of research derived from the proposal are presented in the final conclusions.
FULL ARTICLE:
https://revistas.uned.es/index.php/ried/article/view/29073/23184
Downloads
References
Aguas-Díaz, C. J., Flores-Flores, J. L., Sarmiento-Sarmiento, I. K., y Aguirre-Robalino, D. F. (2020). Aprendizaje móvil (m-learning) como método educativo en Educación Superior. Revista Arbitrada Interdisciplinaria Koinonía, 5(Extra 1), 867-879. https://doi.org/10.35381/r.k.v5i1.887
Almenara, J. (2006). La calidad educativa en el e-Learning: Sus bases pedagógicas. Educación Médica, 9, 9-14. https://doi.org/10.4321/S1575-18132006000700003
Cerdas-Montano, V., Mora-Espinoza, Á., y Salas-Soto, S. E. (2020). Educación remota en el contexto universitario: Necesidad del trabajo colaborativo para la mediación pedagógica docente en tiempos de COVID. Revista Electrónica Educare, 24(Extra 0), 3. https://doi.org/10.15359/ree.24-S.9
Chiang, M. T., Díaz, C., Rivas, A., y Martínez, P. (2013). Validación del cuestionario estilos de enseñanza (CEE): Un instrumento para el docente de Educación Superior. Revista de estilos de aprendizaje, 6(12), 30-45.
Choi, C.-R., y Jeong, H.-Y. (2019). Quality evaluation for multimedia contents of e-learning systems using the ANP approach on high speed network. Multimedia Tools and Applications, 78(4), 28853–28875. https://doi.org/10.1007/s11042-019-7351-8
Colás, M. P., Jiménez, R., y Rodríguez, M. (2005). Evaluación de e-learning. Indicadores de calidad desde el enfoque sociocultural. Education in the knowledge society (EKS), 6(2), 3.
Córdova, L. C., Solis, M. E., y Solis, L. A. (2017). Aplicación de los sistemas e-Learning en las Universidades [Tesis Doctoral, Universidad Estatal de Milagro]. http://repositorio.unemi.edu.ec//handle/123456789/3605
Fernández, B., Alonso, E., Rebolloso, E., y Pozo, C. (1999). Evaluación de la calidad en la educación superior. Papeles del psicólogo, 74, 1886-1415.
Galicia, L. A., Balderrama, J. A., y Edel, R. (2017). Validez de contenido por juicio de expertos: Propuesta de una herramienta virtual. Apertura: Revista de Innovación Educativa, 9(2), 42-53. https://doi.org/10.32870/Ap.v9n2.993
García, P. A., y González, M. S. (2015). Validación de escala para evaluación de la calidad docente en entornos virtuales. Opción: Revista de Ciencias Humanas y Sociales, 31(5), 394-406.
García-Llorente, H. J., Martínez-Abad, F., y Rodríguez-Conde, M. J. (2019). Validación de un instrumento de evaluación de competencias informacionales autopercibidas en educación secundaria obligatoria. Anales de Documentación, 22(1), Article 1. https://doi.org/10.6018/analesdoc.22.1.305641
García-Peñalvo, F. J. (2005). Estado actual de los sistemas e-learning. Education in the knowledge society (EKS), 6(2).
Hansson, H., Westman, P., Åström, E., y Johansson, M. (2009). Un modelo para la evaluación de la calidad e-learning. Revista de Investigaciones UNAD, 8(1), 11-29. https://doi.org/10.22490/25391887.619
Hernández-Nieto, R. A. (2002), Contributions to Statistical Analysis. Mérida, Venezuela: Universidad de Los Andes.
Kurilovas, E., y Vinogradova, I. (2016). Improved fuzzy AHP methodology for evaluating quality of distance learning courses. The International journal of engineering education, 32(4), 1618-1624.
La Rotta, D., Usuga, O. C., y Clavijo, V. (2019). Perceived service quality factors in online higher education. Learning Enviroments Research, 23, 251-267. https://doi.org/10.1007/s10984-019-09299-6
Mahdiuon, R., Masoumi, D., y Farasatkhah, M. (2017). Quality improvement in virtual higher education: A grounded theory approach. Turkish Online Journal of Distance Education, 18(1), 111-131. https://doi.org/10.17718/tojde.285720
Marciniak, R. (2015). Methodological proposal for the application of international benchmarking in order to assess the quality of virtual higher education. RUSC. Universities and Knowledge Society Journal, 12(3), 46-60. https://doi.org/10.7238/rusc.v12i3.2163
Marciniak, R. (2018). Quality Assurance for Online Higher Education Programmes: Design and Validation of an Integrative Assessment Model Applicable to Spanish Universities. The International Review of Research in Open and Distributed Learning, 19(2), 126-154. https://doi.org/10.19173/irrodl.v19i2.3443
Marciniak, R., y Gairín-Sallán, J. (2017). Un modelo para la autoevaluación de la calidad de programas de educación universitaria virtual. Revista de Educación a Distancia (RED), 54. https://doi.org/10.6018/red/54/2
Margalina, V., De Pablos-Heredero, C., y Montes, J. L. (2017). Achieving quality in e-Learning through relational coordination. Studies in Higher Education, 42(9), 1655-1670. https://doi.org/10.1080/03075079.2015.1113953
Martínez, N. (2015). Aprendizaje y evaluación con TIC: Un estado del arte. Revista Científica Universidad Don Bosco, 12.
Martínez-Argüelles, M., y Batalla-Busquets, J.-M. (2016). Perceived Service Quality and Student Loyalty in an Online University. The International Review of Research in Open and Distributed Learning, 17(4), 264-276. https://doi.org/10.19173/irrodl.v17i4.2518
Martínez-Caro, E., Cegarra-Navarro, J. G., y Cepeda-Carrión, G. (2015). An application of the performance-evaluation model for e-learning quality in higher education. Total Quality Management & Business Excellence, 26(5-6), 632-647. https://doi.org/10.1080/14783363.2013.867607
Mejía, J. F., y López, D. (2016). Modelo de Calidad de E-learning para Instituciones de Educación Superior en Colombia. Formación Universitaria, 9(2), 59-72. https://doi.org/10.4067/S0718-50062016000200007
Mixnahuatl, A., Santamaría, J., Urbina, A., Calleja, J. de la, y Auxilio, M. (2013). Diseño del curso análisis de sistemas aplicando el modelo de calidad para e-learning. Educación Handbook T-I: Congreso Interdisciplinario de Cuerpos Académicos, 143-152.
Moreno-Correa, S. M. (2020). La innovación educativa en los tiempos del Coronavirus. Salutem Scientia Spiritus, 6(1), 14-26.
Ortiz-López, A., Olmos-Migueláñez, S., y Sánchez-Prieto, J. C. (2020). e-Learning quality assessment in higher education: A mapping study. Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality, 833-838. https://doi.org/10.1145/3434780.3436602
Park, Y., y Lim, K. (2015). Effects of Environmental and Human Constructs on E-learning Effectiveness in Online University Settings. Indian Journal of Science and Technology, 8(1), 103-109. https://doi.org/10.17485/ijst/2015/v8iS1/57729
Pecori, R., Suraci, V., y Ducange, P. (2019). Efficient computation of key performance indicators in a distance learning university. Information Discovery and Delivery, 47(2), 96-105. https://doi.org/10.1108/IDD-09-2018-0050
Pedrosa, I., Suárez-Álvarez y García-Cueto, E. (2014). Evidencias sobre la Validez de Contenido: Avances Teóricos y Métodos para su Estimación. Acción Psicológica, 10(2), 3-20. https://doi.org/10.5944/ap.10.2.11820
Pham, L., Limbu, Y. B., Bui, T. K., Nguyen, H. T., y Pham, H. T. (2019). Does e-learning service quality influence e-learning student satisfaction and loyalty? Evidence from Vietnam. International Journal of Educational Technology in Higher Education, 16(7), 1-26. https://doi.org/10.1186/s41239-019-0136-3
Prieto-Rodríguez, E., Gore, J., & Holmes, K. (2016). Exploring Quality Teaching in the Online Environment Using an Evidence-Based Approach. Australian Journal of Teacher Education, 41(8), 22-39. https://10.14221/ajte.2016v41n8.2
Raspopovic, M., y Jankulovic, A. (2017). Performance measurement of e-learning using student satisfaction analysis. Information Systems Frontiers, 19(4), 869-880. https://doi.org/10.1007/s10796-016-9636-z
Rubio, M. J. (2003). Enfoques y modelos de evaluación del e-learning. RELIEVE - Revista Electrónica de Investigación y Evaluación Educativa, 9(2), Article 2. https://doi.org/10.7203/relieve.9.2.4332
Santelices-Etchegaray, M. V., y Valenzuela-Rojas, F. (2015). Importancia de las características del profesor y de la escuela en la calidad docente: Una aproximación desde la Teoría de Respuesta del Ítem. Estudios pedagógicos (Valdivia), 41(2), 233-254. https://doi.org/10.4067/S0718-07052015000200014
Seoane Pardo, A. M., y García-Peñalvo, F. (2010). Introducción al eLearning. Universidad de Salamanca.
Serrano, E. L., Ceballos, S. P., Cordero, G., y Cisneros-Cohernour, E. (2018). Marco para evaluar las condiciones institucionales de la enseñanza en línea. Revista Electrónica de Investigación Educativa, 20(2), 1-14. https://doi.org/10.24320/redie.2018.20.2.2072
Tarí, J. J., de Juana, S. A., y Mora, J. (2007). Evaluación de la calidad: Importancia de la evaluación externa y del seguimiento. Avances en Supervisión Educativa, 5, Article 5.
Torres-Barzabal, L., Ortiz, P., y Barcia-Tirado, D. (2018). Quality Indicators for Auditing on-Line Teaching in European Universities. TechTrends, 63(3), 330-340. https://doi.org/10.1007/s11528-018-0365-7
Velasteguí, P. (2017). Plataformas virtuales y su impacto en la Educación Superior. Explorador Digital, 1(2), 5-21 https://doi.org/10.33262/exploradordigital.v1i2.318
Verdezoto-Rodríguez, R. H., y Chávez-Vaca, V. A. (2018). Importancia de las herramientas y entornos de aprendizaje dentro de la plataforma e-learning en las universidades del Ecuador. Edutec. Revista Electrónica de Tecnología Educativa, 65, 68-92. https://doi.org/10.21556/edutec.2018.65.1067
Waheed, M., y Kaur, K. (2017). Students’ perceptual quality standards for judging knowledge quality: Development and validation of a knowledge quality scale. Information Development, 35(2), 319-332. https://doi.org/10.1177/0266666917744370
Waheed, M., Kaur, K., y Qazi, A. (2016). Students’ Perspective on Knowledge Quality in eLearning Context: A Qualitative Assessment. Internet Research, 26(1), 120-145. https://doi.org/10.1108/IntR-08-2014-0199
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 RIED. Revista Iberoamericana de Educación a Distancia
This work is licensed under a Creative Commons Attribution 4.0 International License.
The articles that are published in this journal are subject to the following terms:
1. The authors grant the exploitation rights of the work accepted for publication to RIED, guarantee to the journal the right to be the first publication of research understaken and permit the journal to distribute the work published under the license indicated in point 2.
2. The articles are published in the electronic edition of the journal under a Creative Commons Attribution 4.0 International (CC BY 4.0) license. You can copy and redistribute the material in any medium or format, adapt, remix, transform, and build upon the material for any purpose, even commercially. You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
3. Conditions for self-archiving. Authors are encouraged to disseminate electronically the OnlineFirst version (assessed version and accepted for publication) of its articles before publication, always with reference to its publication by RIED, favoring its circulation and dissemination earlier and with this a possible increase in its citation and reach among the academic community.
