MCDM METHODS-BASED ASSESSMENT OF LEARNING MANAGEMENT SYSTEMS

Đorđe Pucar, Gabrijela Popović, Goran Milovanović

DOI Number
https://doi.org/10.22190/TEME230209058P
First page
939
Last page
956

Abstract


The paper proposes a Multiple-Criteria Decision-Making (MCDM) methods-based approach to assess Learning Management Systems (LMS). The proposed approach includes the objective weighting method MEREC, used to determine the criteria weights, and CRADIS, applied in assessing alternatives and choosing the optimal one. It is revealed that the objectivity degree decreases when the qualitative type of criteria, which strongly depends on the subjective opinion of decision-makers, is used. The proposed approach gave adequate results, confirmed by conducting a sensitivity analysis based on the TOPSIS, ARAS, and MARCOS methods, and by comparing the results with similar research studies.


Keywords

MCDM, MEREC, CRADIS, LMS, objective weighting method

Full Text:

PDF

References


Ayouni, S., Menzli, L. J., Hajjej, F., Maddeh, M., & Al-Otaibi, S. (2021). Fuzzy Vikor application for learning management systems evaluation in higher education. International Journal of Information and Communication Technology Education (IJICTE), 17(2), 17–35. DOI: 10.4018/IJICTE.2021040102

Dordevic, M., Tešić, R., Todorović, S., Jokić, M., Das, D. K., Stević, Ž., & Vrtagic, S. (2022). Development of Integrated Linear Programming Fuzzy-Rough MCDM Model for Production Optimization. Axioms, 11(10), 510. DOI: 10.3390/axioms11100510

Ecer, F., & Aycin, E. (2022). Novel Comprehensive MEREC Weighting-Based Score Aggregation Model for Measuring Innovation Performance: The Case of G7 Countries. Informatica, 1–31. DOI: 10.15388/22-INFOR494

Ecer, F., & Zolfani, S. H. (2022). Evaluating economic freedom via a multi-criteria MEREC-DNMA model-based composite system: the case of OPEC countries. Technological and Economic Development of Economy, 28(4), 1158–1181. DOI: 10.3846/tede.2022.17152

Haghshenas, M. (2019). A model for utilizing social Softwares in learning management system of E-learning. Quarterly of Iranian Distance Education Journal, 1(4), 25–38. DOI: 10.30473/idej.2019.6124

Haq, R. S. U., Saeed, M., Mateen, N., Siddiqui, F., Naqvi, M., Yi, J. B., & Ahmed, S. (2022). Sustainable material selection with crisp and ambiguous data using single-valued neutrosophic-MEREC-MARCOS framework. Applied Soft Computing, 128, 109546. DOI: 10.1016/j.asoc.2022.109546

Hezam, I. M., Mishra, A. R., Rani, P., Cavallaro, F., Saha, A., Ali, J., Strielkowski, W., & Štreimikienė, D. (2022). A Hybrid Intuitionistic Fuzzy-MEREC-RS-DNMA Method for Assessing the Alternative Fuel Vehicles with Sustainability Perspectives. Sustainability, 14(9), 5463. DOI: 10.3390/su14095463

Hwang, C. L., & Yoon, K. (1981). Methods for multiple attribute decision making. In Multiple attribute decision making (pp. 58–191). Springer, Berlin, Heidelberg. DOI: 10.1007/978-3-642-48318-9_3

Işık, A. H., Ince, M., & Yiğit, T. (2015). A fuzzy AHP approach to select learning management system. International Journal of Computer Theory and Engineering, 7(6), 499.

Keshavarz-Ghorabaee, M., Amiri, M., Zavadskas, E. K., Turskis, Z., & Antucheviciene, J. (2021). Determination of Objective Weights Using a New Method Based on the Removal Effects of Criteria (MEREC). Symmetry, 13(4), 525. DOI: 10.3390/sym13040525

Krishankumar, R., & Ecer, F. (2023). Selection of IoT service provider for sustainable transport using q-rung orthopair fuzzy CRADIS and unknown weights. Applied Soft Computing, 132, 109870. DOI: 10.1016/j.asoc.2022.109870

Marinković, M., Zavadskas, E. K., Matić, B., Jovanović, S., Das, D. K., & Sremac, S. (2022). Application of Wasted and Recycled Materials for Production of Stabilized Layers of Road Structures. Buildings, 12(5), 552. DOI: 10.3390/buildings12050552

Mishra, A. R., Saha, A., Rani, P., Hezam, I. M., Shrivastava, R., & Smarandache, F. (2022). An integrated decision support framework using single-valued-MEREC-MULTIMOORA for low carbon tourism strategy assessment. IEEE Access, 10, 24411–24432. DOI: 10.1109/ACCESS.2022.3155171

Muhammad, M. N., & Cavus, N. (2017). Fuzzy DEMATEL method for identifying LMS evaluation criteria. Procedia computer science, 120, 742–749. DOI: 10.1016/j.procs.2017.11.304

Nazir, M., & Cavus, N. (2017). Quality evaluation of learning management systems using DEMATEL-ANP. In INTED2017 Proceedings (pp. 5754–5760). IATED. DOI: 10.21125/inted.2017.1350

Nicolalde, J. F., Cabrera, M., Martínez-Gómez, J., Salazar, R. B., & Reyes, E. (2022). Selection of a phase change material for energy storage by multi-criteria decision method regarding the thermal comfort in a vehicle. Journal of Energy Storage, 51, 104437. DOI: 10.1016/j.est.2022.104437

Paunović, V., Puzović, S., & Vesić, J. (2018). One MCDM Approach to Learning Management Systems Evaluation. In Proceedings of the 7th International Scientific Conference Technics and Informatics in Education (pp. 238–244).

Petrova, V. (2019, June). Using the Analytic Hierarchy Process for LMS selection. In Proceedings of the 20th International Conference on Computer Systems and Technologies (pp. 332–336). DOI: 10.1145/3345252.3345297

Popović, G., Milovanović, G., & Stanujkić, D. (2018). Prioritization of strategies for tourism development by applying a SWOT-SWARA analysis: The case of Sokobanja Spa. Teme, 42(3), 999-1016. DOI: 10.22190/TEME1803999P

Popović, G., Pucar, Đ., & Smarandache, F. (2022). MEREC-COBRA approach in e-commerce development strategy selection. Journal of process management and new technologies, 10(3–4), 66–74. DOI: 10.5937/jouproman2203066P

Puška, A., Stević, Ž., & Pamučar, D. (2022a). Evaluation and selection of healthcare waste incinerators using extended sustainability criteria and multi-criteria analysis methods. Environment, Development and Sustainability, 24(9), 11195–11225. DOI: 10.1007/s10668-021-01902-2

Puška, A., Nedeljković, M., Prodanović, R., Vladisavljević, R., & Suzić, R. (2022b). Market assessment of pear varieties in Serbia using fuzzy CRADIS and CRITIC methods. Agriculture, 12(2), 139. DOI: 10.3390/agriculture12020139

Puška, A., Božanić, D., Nedeljković, M., & Janošević, M. (2022c). Green supplier selection in an uncertain environment in agriculture using a hybrid MCDM model: Z-Numbers–Fuzzy LMAW–Fuzzy CRADIS model. Axioms, 11(9), 427. DOI: 10.3390/axioms11090427

Puška, A., Nedeljković, M., Šarkoćević, Ž., Golubović, Z., Ristić, V., & Stojanović, I. (2022). Evaluation of Agricultural Machinery Using Multi-Criteria Analysis Methods. Sustainability, 14(14), 8675. DOI: 10.3390/su14148675

Radwan, N. M., Senousy, M. B., & Alaa El Din, M. R. (2016). Neutrosophic AHP multi criteria decision making method applied on the selection of learning management system. International Journal of Advancements in Computing Technology (IJACT), 8(5), 95–105.

Randjelović, M., Savić, G., Stojanović, B., & Randjelović, D. (2020). An integrated DEA/AHP methodology for determining the criteria of importance in the process of business-friendly certification at the local level. Teme, 44(1), 285–300. DOI: 10.22190/TEME180614021R

Rani, P., Mishra, A. R., Saha, A., Hezam, I. M., & Pamucar, D. (2022). Fermatean fuzzy Heronian mean operators and MEREC‐based additive ratio assessment method: An application to food waste treatment technology selection. International Journal of Intelligent Systems, 37(3), 2612–2647. DOI: 10.1002/int.22787

Turker, Y. A., Baynal, K., & Turker, T. (2019). The evaluation of learning management systems by using Fuzzy AHP, fuzzy TOPSIS and an integrated method: A case study. Turkish Online Journal of Distance Education, 20(2), 195–218. DOI: 10.17718/tojde.557864

Shanmugasundar, G., Sapkota, G., Čep, R., & Kalita, K. (2022). Application of MEREC in Multi-Criteria Selection of Optimal Spray-Painting Robot. Processes, 10(6), 1172. DOI: 10.3390/pr10061172

Simic, V., Gokasar, I., Deveci, M., & Švadlenka, L. (2022). Mitigating Climate Change Effects of Urban Transportation Using a Type-2 Neutrosophic MEREC-MARCOS Model. IEEE Transactions on Engineering Management, 1–17. DOI: 10.1109/TEM.2022.3207375

Sokolović, J., Stanujkić, D., & Štirbanović, Z. (2021). Selection of process for aluminium separation from waste cables by TOPSIS and WASPAS methods. Minerals Engineering, 173, 107186. DOI: 10.1016/j.mineng.2021.107186

Starčević, V., Petrović, V., Mirović, I., Tanasić, L. Ž., Stević, Ž., & Đurović Todorović, J. (2022). A Novel Integrated PCA-DEA-IMF SWARA-CRADIS Model for Evaluating the Impact of FDI on the Sustainability of the Economic System. Sustainability, 14(20), 13587. DOI: 10.3390/su142013587

Stević, Ž, Pamučar, D., Puška, A., & Chatterjee, P. (2020). Sustainable supplier selection in healthcare industries using a new MCDM method: Measurement alternatives and ranking according to compromise solution (MARCOS). Computers & Industrial Engineering, 140, 106231. DOI: 10.1016/j.cie.2019.106231

Štirbanović, Z., Gardić, V., Stanujkić, D., Marković, R., Sokolović, J., & Stevanović, Z. (2021). Comparative MCDM Analysis for AMD Treatment Method Selection. Water Resources Management, 35(11), 3737–3753. DOI: 10.1007/s11269-021-02914-3

Stojanović, I., Puška, A., & Selaković, M. (2022). A multi-criteria approach to the comparative analysis of the global innovation index on the example of the Western Balkan countries. Economics, 10(2), 9–26. DOI: 10.2478/eoik-2022-0019

Su, W., Luo, D., Zhang, C., & Zeng, S. (2022). Evaluation of online learning platforms based on probabilistic linguistic term sets with self-confidence multiple attribute group decision making method. Expert Systems with Applications, 208, 118153. DOI: 10.1016/j.eswa.2022.118153

Ulutaş, A., Stanujkic, D., Karabasevic, D., Popovic, G., & Novaković, S. (2022). Pallet truck selection with MEREC and WISP-S methods. Strategic Management-International Journal of Strategic Management and Decision Support Systems in Strategic Management, 27(4), 23–29. DOI: 10.5937/StraMan2200013U

Wang, W., Wang, Y., Fan, S., Han, X., Wu, Q., & Pamucar, D. (2023). A complex spherical fuzzy CRADIS method based Fine-Kinney framework for occupational risk evaluation in natural gas pipeline construction. Journal of Petroleum Science and Engineering, 220, 111246. DOI: 10.1016/j.petrol.2022.111246

Wątróbski, J., Bączkiewicz, A., & Sałabun, W. (2022). Version [1.1]–[pyrepo-mcda—Reference Objects based MCDA Software Package]. SoftwareX, 19, 101107. DOI: 10.1016/j.softx.2022.101107

Zare, M., Pahl, C., Rahnama, H., Nilashi, M., Mardani, A., Ibrahim, O., & Ahmadi, H. (2016). Multi-criteria decision-making approach in E-learning: A systematic review and classification. Applied Soft Computing, 45, 108–128. DOI: 10.1016/j.asoc.2016.04.020

Zavadskas, E. K., & Turskis, Z. (2010). A new additive ratio assessment (ARAS) method in multicriteria decision making. Technological and Economic Development of Economy, 16(2), 159–172. DOI: 10.3846/tede.2010.10




DOI: https://doi.org/10.22190/TEME230209058P

Refbacks

  • There are currently no refbacks.


© University of Niš, Serbia
Creative Commons licence CC BY-NC-ND
Print ISSN: 0353-7919
Online ISSN: 1820-7804