Usability Evaluation of E-Learning Website User Experience Using the TUXEL Method: A Technique for User Experience Evaluation in Learning Management System

Asri Samsiar Ilmananda; Arif Saivul Affandi

doi:10.35671/jmtt.v4i1.86

Authors

Asri Samsiar Ilmananda Universitas Merdeka Malang https://orcid.org/0000-0002-9469-2997
Arif Saivul Affandi Universitas Merdeka Malang https://orcid.org/0000-0002-9478-0065

DOI:

https://doi.org/10.35671/jmtt.v4i1.86

Keywords:

Usability, User Experience, E-learning, Evaluation, LMS,

Abstract

The purpose of this study was to determine the usability and User Experience (UX) on the E-Learning.net website with three aspects, namely general usability, pedagogical usability and user experience. This study uses the TUXEL method, a method used to evaluate usability and user experience in e-learning using three questionnaires, namely the problem reporting table, general LMS evaluation checklist and user experience evaluation. Data collection through validated questionnaires was then distributed to respondents by taking samples using non-probability sampling techniques. The sample used was obtained from a study of students at SMK N 12 Malang with a sample size of 10 students with characteristics of having knowledge about e-learning. The data obtained were analyzed using the descriptive analysis method. The evaluation results obtained from the three questionnaires, namely the problem reporting table, found 14 problems from the four variables, namely login, general interface, assignments and assessments. In the General LMS evaluation checklist, 18 problems were found from the four variables, namely Help and Documentation, LMS Learnability, Learning Through the LMS and LMS Flexibility. In the User Experience Evaluation, a positive mean value was obtained. The E-Learning website excels in the dimensions of support, innovation, creativity and motivation. E-Learning.net is suitable for use in independent learning.

Downloads

Download data is not yet available.

Author Biographies

Asri Samsiar Ilmananda, Universitas Merdeka Malang

Secretary of the Bachelor of Information Systems Study Program, Universitas Merdeka Malang, East Java, Indonesia.

Arif Saivul Affandi, Universitas Merdeka Malang

Department of Information System, Faculty of Information Technology, Universitas Merdeka Malang, Malang, East Java, Indonesia

References

W. Suh and S. Ahn, “Utilizing the metaverse for learner-centered constructivist education in the post-pandemic era: An analysis of elementary school students,” J. Intell., vol. 10, no. 1, p. 17, 2022.

A. Mittal and R. Sridaran, “Evaluation of Websites’ Performance and Search Engine Optimization: A Case Study of 10 Indian University Websites.” 2019.

I. Santiko and A. Hidayat, “User Experience ( UX ) on Search Semantic Modeling Using Iterative Process Flow Method,” J. Multimed. Trend Technol., vol. 1, no. 3, pp. 8–15, 2022.

E. A. Al Ghawail, S. Ben Yahia, and M. A. Alrshah, “Challenges of applying e-learning in the libyan higher education system,” Int. J. Adv. Trends Comput. Sci. Eng., vol. 8, no. 1.4 S1, pp. 38 – 43, 2019, doi: 10.30534/ijatcse/2019/0681.42019.

G. Cebrián, R. Palau, and J. Mogas, “The smart classroom as a means to the development of ESD methodologies,” Sustain., vol. 12, no. 7, 2020, doi: 10.3390/su12073010.

A. M. Alfoudari, C. M. Durugbo, and F. M. Aldhmour, “Exploring quality attributes of smart classrooms from the perspectives of academics,” Educ. Inf. Technol., vol. 28, no. 10, pp. 13109 – 13151, 2023, doi: 10.1007/s10639-022-11452-3.

I. Santiko, T. R. Soeprobowati, B. Surarso, and I. Tahyudin, “Traditional-Enhance-Mobile-Ubiquitous-Smart: Model Innovation in Higher Education Learning Style Classification Using Multidimensional and Machine Learning Methods,” J. Appl. Data Sci., vol. 6, no. 1, pp. 753–772, 2025, doi: https://doi.org/10.47738/jads.v6i1.598.

I. Santiko, T. R. Soeprobowati, and B. Surarso, “Model review on the proposed new smart campus framework in achieving industry 4.0,” Proc. - 2021 IEEE 5th Int. Conf. Inf. Technol. Inf. Syst. Electr. Eng. Appl. Data Sci. Artif. Intell. Technol. Glob. Challenges Dur. Pandemic Era, ICITISEE 2021, pp. 288–293, 2021, doi: 10.1109/ICITISEE53823.2021.9655813.

I. Önder and A. Berbekova, “Web analytics: more than website performance evaluation?,” Int. J. Tour. Cities, vol. 8, no. 3, pp. 603–615, 2022.

M. Rashida, K. Islam, A. S. M. Kayes, M. Hammoudeh, M. S. Arefin, and M. A. Habib, “Towards Developing a Framework to Analyze the Qualities of the University Websites,” first Comput., 2021, doi: 10.3390/COMPUTERS10050057.

A. Szymkowiak, B. Melović, M. Dabić, K. Jeganathan, and G. S. Kundi, “Information technology and Gen Z: The role of teachers, the internet, and technology in the education of young people,” Technol. Soc., vol. 65, p. 101565, 2021.

M. Manzoor, W. Hussain, O. Sohaib, F. K. Hussain, and S. Alkhalaf, “Methodological investigation for enhancing the usability of university websites,” J. Ambient Intell. Humaniz. Comput., 2019, doi: 10.1007/S12652-018-0686-6.

W. T. Nakamura, “TUXEL: A Technique for User experience Evaluation in e-Learning,” 2018.

H. Azhar, “Evaluasi CeLOE Learning Management System (LMS) Universitas Telkom dengan Technique for User Experience Evaluation In E-Learning (TUXEL) 2.0,” JEPIN J. Edukasi dan Penelit. Inform. Univ. Tanjungpura, vol. 8, no. 1, pp. 180–187, 2022.

M. D. Arga, S. H. Wijoyo, and H. M. Az-Zahra, “Evaluasi Pengalaman Pengguna E-Learning SMAN 90 Jakarta menggunakan Technique for User Experience Evaluation in E-Learning (TUXEL),” J. Pengemb. Teknol. Inf. dan Ilmu Komput., vol. 6, no. 9, pp. 4353–4362, 2022.

W. Nakamura, E. Oliveira, and T. Conte, “Applying design science research to develop a technique to evaluate the usability and user experience of learning management systems,” in Brazilian Symposium on Computers in Education (Simpósio Brasileiro de Informática na Educação-SBIE), 2018, p. 953.

D. Ghorbanzadeh and M. Sharbatiyan, “The role of website features in creating value co-creation behaviors and enhancing the brand image and reputation of higher education institutions,” Interact. Technol. smart Educ., vol. 21, no. 1, pp. 21–43, 2024.

L. C. Maudlin, K. S. McNeal, H. Dinon-Aldridge, C. Davis, R. Boyles, and R. M. Atkins, “Website usability differences between males and females: An eye-tracking evaluation of a climate decision support system,” Weather. Clim. Soc., vol. 12, no. 1, pp. 183–192, 2020.

A. Rofiudin, “Analisis efektivitas penggunaan google classroom dengan metode Technique for User Experience Evaluation in e-Learning (TUXEL 2.0) pada proses belajar mengajar kompetensi TIK di SMK Negeri Kota Malang,” Universitas Negeri Malang, 2023.

W. H. Wong and E. Chapman, “Student satisfaction and interaction in higher education,” High. Educ., vol. 85, no. 5, pp. 957–978, 2023.

A. H. Nirwana, A. Supriyanto, and A. P. Wardhanie, “Evaluasi Usability, Pedagogical dan User Experience My Brilian Menggunakan Metode Tuxel,” J. Technol. Informatics, vol. 4, no. 1, pp. 7–12, 2022.

F. R. Fiena Rindani and S. P. Sulistyo Puspitodjati, “Integration of Webqual Method to Importance Performance Analysis and Kano Model to Analyze System Quality of E-Government: Case Study LAPOR!,” J. Sist. Inf. (Journal Inf. Syst., vol. 16, no. 2, pp. 1–17, 2020.

I. Santiko and G. Andriana, “Assessing the Accuracy Level of University-Based Website-Based Search Engines Using F-Measure and Hellinger,” vol. 6, no. 2, pp. 689–700, 2024, doi: 10.51519/journalisi.v6i2.716.

D. Mulyana, M. Defriani, and M. R. Muttaqin, “Perancangan UI/UX Aplikasi Dasteur Geulis Berbasis Mobile Menggunakan Metode Agile UX,” Merkurius J. Ris. Sist. Inf. dan Tek. Inform., vol. 2, no. 5, pp. 38–50, 2024.