Jelena Ruso, Ana Rakić, Sanela Arsić, Isidora Milošević

DOI Number
First page
Last page


The pandemic resulted in lockdown measures worldwide, which forced humanity to seek online alternatives to almost every human activity, including the education system. This research aims to develop a new integrated model to determine the predictors of the quality of E-learning during the pandemic disruption. This paper provides the development of the traditional approach based on Structural Equation Modelling (SEM) into the prediction method based on the Artificial Neural Network (ANN). This research was conducted on a sample comprising 1,254 students of the University of Belgrade. The results show that Authority initiative had the most important influence and significance in predicting the perception of the Quality of E-learning during the pandemic. At the same time, the Information Security predictor had the most negligible impact. The findings contribute to the raising the academic community and policy-makers awareness to the necessity of dealing with quality in E-education to a greater extent, especially in emergencies such as pandemics. The suggested combination of constructs that predict the Quality of E-learning has never been analysed in previous research by applying SEM-ANN methodology, which represents the additional contribution of this study.


quality, E-learning, pandemic, higher education, SEM-ANN.

Full Text:



Agariya, A., & Singh, D. (2012). E-Learning quality: Scale development and validation in Indian context. Knowledge Management & E-Learning: An International Journal, 4(4), 500-517.

Ahmad, A., & Love, S. (2013). Factors influencing students’ acceptance of mlearning: An investigation in higher education. The International Review of Research in Open and Distance Learning, 14(5), 83-107.

Alla, M. M. S. O., & Faryadi, Q. (2013). The effect of information quality in e-learning system. International Journal of Applied Science and Technology, 3(6), 24-33.

Alsabawy, A. Y., Cater-Steel, A., & Soar, J. (2016). Determinants of perceived usefulness of e-learning systems. Computers in Human Behavior, 64, 843-858.

Ameen, N., Willis, R., Abdullah, M. N., & Shah, M. (2019). Towards the successful integration of e-learning systems in higher education in Iraq: A student perspective. British Journal of Educational Technology, 50(3), 1434-1446.

Anderson, J. C., & Gerbing, D. W. (1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103(3), 411-423.

Arsić, S., Vuković, M., Manasijević, D. & Urošević, S. (2019). Cultural participation of citizens: the case of Bor”, International May Conference on Strategic Management – IMCSM19, 5(2), 272-285.

Asadi, S., Abdullah, R., Safaei, M., & Nazir, S. (2019). An Integrated SEM-Neural Network Approach for Predicting, Determinants of Adoption of Wearable Healthcare Devices, Mobile Information Systems, 9.

Basar, Z. M., Mansor, A. N., Jamaludin, K. A., & Alias, B. S. (2021). The effectiveness and challenges of online learning for secondary school students–A case study. Asian Journal of University Education, 17(3), 119-129.

Bayar, S., Demir, I., & Engin, G. O. (2009). Modeling leaching behavior of solidified wastes using back-propagation neural networks. Ecotoxicology and environmental safety, 72(3), 843-850.

Biškupić, I. O., Lacković, S., & Jurina, K. (2015). Successful and Proactive e-learning Environment Fostered by Teachers’ Motivation in Technology Use. Procedia - Social and Behavioral Sciences, 174, 3656-3662.

Bond, M., Buntins, K., Bedenlier, S., Zawacki-Richter, O., & Kerres, M. (2020). Mapping research in student engagement and educational technology in higher education: A systematic evidence map. International Journal of Educational Technology in Higher Education, 17(1), 1-30.

Brosser L., & Vrabie C. (2015). The quality initiative of E-Learning in Germany (QEG)- Management for Quality and Standards in E-Learning, Procedia - Social and Behavioral Sciences, 186, 1146-1151.

Chong, A. Y. L. (2013). Predicting m-commerce adoption determinants: A neural network approach, Expert Systems with Applications, 40, 523-530.

Cidral, W. A., Oliveira, T., Di Felice, M., & Aparicio, M. (2018). E-learning success determinants: Brazilian empirical study. Computers & Education, 122, 273-290.

Cvetković, B. N., Stanojević, D., & Milanović, A. (2021). Application of Computers in Teaching and Learning from the Teacher’s Point of View. Teme, 1231-1244.

Das De, S., Puhaindran, M. E., Sechachalam, S., Wong, K. J. H., Chong, C. W., & Chin, A. Y. H. (2020). Sustaining a national surgical training programme during the COVID-19 pandemic. Bone & Joint Open, 1(5), 98-102.

Dehghani, A., Kojuri, J., Dehghani, M. R., Keshavarzi, A., & Najafipour, S. (2019). Experiences of students and faculty members about using virtual social networks in education: A qualitative content analysis. Journal of Advances in Medical Education & Professionalism, 7(2), 86.

Delva, S., Nkimbeng, M., Chow, S., Renda, S., Han, H.-R., & D’Aoust, R. (2019). Views of regulatory authorities on standards to assure quality in online nursing education. Nurs Outlook, 67(6), 747759.

Farid, S., Ahmad, R., Alam, M., Akbar, A. & Chang, V. (2018). A sustainable quality assessment model for the information delivery in E-learning systems. Information Discovery and Delivery, 46(1), 1-25.

Favale, T., Soro, F., Trevisan, M., Drago, I., & Mellia, M. (2020). Campus traffic and e-Learning during COVID-19 pandemic. Computer Networks, 176, 107290.

Foo, P.-Y., Lee V.-H., Tan, G. W.-H., & Ooi, K.-B. (2018). A gateway to realizing sustainability performance via green supply chain management practices: A PLS-ANN approach, Expert Systems with Applications, 107, 1-14.

Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50.

Gil-Madrona, P., Hinojosa, L. M. M., Perez-Segura, J. J., Saez-Sanchez, M. B., & Poblete, G. Z. (2020). Scale of Pedagogical Authority Meanings in the classroom (ESAPA) for Ibero-America built on the opinions of teaching students. Teaching and Teacher Education, 93, 103079.

Goh, A. T. (1995). Back-propagation neural networks for modeling complex systems. Artificial Intelligence in Engineering, 9, 143-151.

Hamid, A. A., Razak, F. Z. A., Bakar, A. A., & Abdullah, W. S. W. (2016). The effects of perceived usefulness and perceived ease of use on continuance intention to use e-government. Procedia Economics and Finance, 35, 644-649.

Hammerstrom, D. (1993). Working with neural networks. IEEE Spectrum, 30(70), 46-53.

Haykin, S. (1994). Neural networks: A comprehensive foundation, MacMillan College, New York.

Hooper, D., Coughlan, J. & Mullen, M. R. (2008). Structural Equation Modelling: Guidelines for Determining Model Fit. Electronic Journal of Business Research Methods, 6(1), 53-60.

ISO 27000:2018 - Information technology - Security techniques - Information security management systems - Overview and vocabulary, (2020). International Organization for Standardization, Switzerland. Retrieved from

Jerman-Blažić, B., & Klobučar, T. (2005). Privacy provision in e-learning standardized systems: Status and improvements. Computer Standards & Interfaces, 27(6), 561-578.

Jung, I. (2010). The dimensions of e-learning quality: from the learner’s perspective. Educational Technology Research and Development, 59(4), 445-464.

Larmuseau, C., Desmet, P., & Depaepe, F. (2019). Perceptions of instructional quality: impact on acceptance and use of an online learning environment. Interactive Learning Environments, 27(7), 953-964.

Lee, J. K., & Lee, W. K. (2008). The relationship of e-Learner’s self-regulatory efficacy and perception of e-Learning environmental quality. Computers in Human Behavior, 24(1), 32-47.

Levinsen, K. T. (2007). Qualifying online teachers - Communicative skills and their impact on e-learning quality. Education and Information Technologies, 12(1), 41-51.

Mahdizadeh, H., Biemans, H., & Mulder, M. (2008). Determining factors of the use of e-learning environments by university teachers. Computers & Education, 51(1), 142-154.

Martínez-Caro, E., Cegarra-Navarro, J. G., & Cepeda-Carrión, G. (2014). An application of the performance-evaluation model for e-learning quality in higher education. Total Quality Management & Business Excellence, 26(5-6), 632-647.

Milošević, I., Živković, D., Arsić, S. and Manasijević, D. (2015b). Facebook as virtual classroom – Social networking in learning and teaching among Serbian students, Telematics and Informatics, 32, 576-585.

Milošević, I., Živković, D., Manasijević, D. and Nikolić, D. (2015a). The effects of the intended behavior of students in the use of M-learning, Computers in Human Behavior, 51, 207-215.

Misut, M., & Pribilova K. (2015). Measuring of quality in the context of e-learning. Procedia- Social and Behavioral Sciences, 177, 312-319.

Mohammadi, H. (2015). Investigating users’ perspectives on e-learning: An integration of TAM and IS success model. Computers in Human Behavior, 45, 359-374.

Neroni, J., Meijs, C., Gijselaers, H. J. M., Kirschner, P. A., & de Groot R. H. M. (2019). Learning strategies and academic performance in distance education, Learning and Individual Differences, 73, 1-7.

Nikolić, V., Kaljevic, J., Jović, S., Petković, D., Milovančević, M., Dimitrov, L., & Dachkinov, P. (2018). Survey of quality models of e-learning systems. Physica A: Statistical Mechanics and its Applications, 511(C), 324-330.

Nourani, V., & Fard, M. S. (2012). Sensitivity analysis of the artificial neural network outputs in simulation of the evaporation process at different climatologic regimes. Advances in Engineering Software, 47(1), 127-146.

Nunnally, J. C., Bernstein, I., & Berge, J. T. (1967). Psychometric theory. New York: McGraw-Hill.

Özakın, A. N., & Kaya, F. (2020). Experimental thermodynamic analysis of air-based PVT system using fins in different materials: Optimization of control parameters by Taguchi method and ANOVA. Solar Energy, 197, 199-211.

Pham, L., Limbu, Y. B., Bui, T. K., Nguyen, H. T., & Pham, H. T. (2019). Does e-learning service quality influence e-learning student satisfaction and loyalty? Evidence from Vietnam. International Journal of Educational Technology in Higher Education, 16(1), 7.

Pour, M. J., Mesrabadi, J., & Hosseinzadeh, M. (2019). A comprehensive framework to rank cloud-based e-learning providers using best-worst method (BWM). Online Information Review, 44(1), 114-138.

Randjelovic, B., Karalic, E., Djukic, D., & Aleksic, K. (2022). Distance Learning in Serbia–The Experience in Primary Education During the Covid-19 Crisis. Teme, 377-397.

Sabah, N. M. (2016). Exploring students' awareness and perceptions: Influencing factors and individual differences driving m-learning adoption. Computers in Human Behavior, 65, 522-533.

Samat, M. F., Awang, N. A., Hussin, S. N. A. & Nawi, F. A. M. (2020). Online Distance Learning Amidst Covid-19 Pandemic Among University Students: A Practicality of Partial Least Squares Structural Equation Modelling Approach. Asian Journal of University Education, 16(3), 220-233.

Seddon, P., Kiew, M.-Y., & Patry, M. (1994). A Partial Test and Development of the DeLone and McLean Model of IS Success. ICIS 1994 Proceedings, 2. Retrieved from

Sharma, S. K., Gaur, A., Saddikuti, V., & Rastogi, A. (2017). Structural equation model (SEM)-neural network (NN) model for predicting quality determinants of E-learning management systems. Behaviour & Information Technology, 36(10), 1053-1066.

Sheykhfard, A., & Haghighi, F. (2020). Driver distraction by digital billboards? Structural equation modeling based on naturalistic driving study data: A case study of Iran. Journal of Safety Research, 72, 1-8.

Siemens, L., Althaus, C., & Stange, C. (2013). Balancing students’ privacy concerns while increasing student engagement in E-learning environments. In Wankel, C. & Blessinger, P. (Eds.) Increasing Student Engagement and Retention in e-learning Environments: Web 2.0 and Blended Learning Technologies (Cutting-Edge Technologies in Higher Education, 6(G), Emerald Group Publishing Limited (pp. 339-357).

Sohaib, O., Hussain, W., Asif, M., Ahma, M., & Mazzara, M. (2020). A PLS-SEM Neural Network Approach for understanding cryptocurrency adoption, IEEE ACCESS, 8, 13138- 13150.

Sørebø, Ø., Halvari, H., Gulli, V. F., & Kristiansen, R. (2009). The role of self-determination theory in explaining teachers’ motivation to continue to use e-learning technology. Computers & Education, 53(4), 1177-1187.

Stanković, Z. B. (2020). Individualization Models of Teaching using Educational Software–Methodological Realization. Teme, 301-317.

Sutherland, K. A. & Hall, M. (2018). The ‘impact’ of academic development, International Journal of Academic Development, 23(2), 69-71.

Tan, G. W. H., Ooi, K. B., Leong, L. Y., & Lin, B. (2014). Predicting the drivers of behavioral intention to use mobile learning: A hybrid SEM-Neural Networks approach. Computers in Human Behavior, 36, 198-213.

Tretter, J. T., Windram, J., Faulkner, T., Hudgens, M., Sendzikaite, S., Blom, N. A., & Kumar, R. K. (2020). Heart University: a new online educational forum in paediatric and adult congenital cardiac care. The future of virtual learning in a post-pandemic world. Cardiology in the Young, 30(4), 560-567.

Uppal, M. A., Ali, S., & Gulliver, S. R. (2017). Factors determining e-learning service quality. British Journal of Educational Technology, 49(3), 412-426.

Xu, Y., Zhang, W., Bao, H., Zhang, S., & Xiang, Y. (2019). A SEM-Neural Network Approach to Predict Customers’ Intention to Purchase Battery Electric Vehicles in China’s Zhejiang Province, Sustainability, 11, 3164.

Yakubu, M. N., Dasuki, S. I., Abubakar, A. M., & Kah, M. M. O. (2020). Determinants of learning management systems adoption in Nigeria: A hybrid SEM and artificial neural network approach. Education and Information Technologies.

Yallop, A., & Aliasghar, O. (2020). No business as usual: a case for data ethics and data governance in the age of coronavirus. Online Information Review, ahead-of-print (ahead-of-print).

Zabukovsek, S. S., Kalinic, Z., Bobek, S., & Tominc, P. (2018). SEM–ANN based research of factors’ impact on extended use of ERP systems. Central Europian Journal of Operational Research, 27, 703-735.



  • There are currently no refbacks.

© University of Niš, Serbia
Creative Commons licence CC BY-NC-ND
Print ISSN: 0353-7919
Online ISSN: 1820-7804