Hill Publishing Group | contact@hillpublisher.com

Hill Publishing Group

Location:Home / Journals / The Educational Review, USA /


Using a User Experience Evaluation to Improve a Learning Management System Created in Response to COVID-19

Date: May 19,2022 |Hits: 2385 Download PDF How to cite this paper

Maimoona H. Al Abri*, Ali S. Al Adi, Alrabeea Awald Thani, Ghalib A. Alabrawi, Abdullah H. Al Harthi

Learning Technology Department, Ministry of Education, Muscat, Sultanate of Oman.

*Corresponding author: Maimoona H. Al Abri


User-experience (UX) evaluation is one approach to design a high-quality user experience for a product. UX evaluation aims to examine the effectiveness of a product and what end-users expect to do with the product to complete intended tasks. In education, adopting a learning management system (LMS) is critical for institutions. Thus, it is important to understand the users’ needs and requirements in order to design a comprehensive LMS that provides the desired features in ways that are easy to use. The purpose of this study was to describe the process of a UX evaluation of a K-12 educational organization’s LMS that was developed in-house in response to COVID-19. Data for this study was collected using a triangulation of methods: interviews, survey questionnaires, thinking-aloud, and focus-group discussions. The result of UX evaluation lists 19 problems that users had with their current LMS and 17 areas of the LMS where users wanted improvement.


Al-Khalifa, H. S. (2010). A First Step in Evaluating the Usability of JUSUR Learning Management System. In 3rd Annual Forum on e-Learning Excellence in the Middle East 2010: Bringing Global Quality to a Local Context. February 1st-3rd, Dubai, U.A.E.

Brooke, J. (1996). SUS: A “quick and dirty” usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & A. L. McClelland (Eds.), Usability evaluation in industry. London: Taylor and Francis.

Ghilay, Y. (2019). Effectiveness of learning management systems in higher education: Views of lecturers with different levels of activity in LMSs. Journal of Online Higher Education, 3(2), 29-50.

Gomez, (2020). The online course environment: Learning management systems (LMSs). In S. Bryans-Bongey & K. J., Graziano (Eds.), Online teaching in k-12: Models, methods, and best practices for teachers and administrators (pp. 24-50). New Jersey: Information Today, Inc.

Hartson, R. and Pyla, P. (2012). Affordances demystified [PowerPoint slides]. Retrieved from http://dopey.cs.vt.edu/courses/cs5714-s13/slides/Chapter_20_ Affs.pdf.

Hartson, R. and Pyla, P. (2012). The UX book: Process and guidelines for ensuring a quality user experience. Maryland, MA: El-sevier.

Iqbal, S. and Qureshi, I. A. (2011). Learning management systems (LMS): Inside matters. Information Management and Business Review, 3(4), 206-216.

Kaptelinin, V. (2014). Affordances and Design. The Interaction Design Foundation, Denmark.

Mastroianni, C. (2015). The 7 e-affordances in learning: The e-affordances in learning. ELearning Industry. Retrieved from https://elearningindustry.com/7-e-affordances-elearning.

Nakamura, W., Oliveira, E. H., and Conte, T. (2017). Usability and User Experience Evaluation of Learning Management Systems: A Systematic Mapping Study. In: Proceedings of the 19th International Conference on Enterprise Information Systems (pp. 97-108). doi: 10.5220/0006363100970108.

Nielson, J. (1993). Usability engineering. Cambridge, MA: Academic Press.

Orfanou. K., Tselios. N., and Katsanos. Ch. (2015). Perceived usability evaluation of learning management systems: Empirical evaluation of the system usability scale. International Review of Research in Open and Distributed Learning, 16(2), 227-246.

Ouadoud, M. and Chkouri, M. Y. (2021). Modeling and Prototyping New Smart Learning Management Systems. Information Science Reference.

Phongphaew. N. and Jiamsanguanwong. A. (2018). Usability Evaluation on Learning Management System. In the proceeding of Advances in Intelligent Systems and Computing (pp. 39-48). Springer, Cham. doi 10.1007/978-3-319-60492-3_4. 

Rohrer, C. H. (2014). Research methods, strategy, user testing. Nielsen Norman group. Retrieved from: https://www.nngroup.com/ articles/which-ux-research-methods/.

Zins, A. H., U. Bauernfeind, F. Del Missier, A. Venturini, H. Rumetshofer. (2004). “An Experimental Usability Test for different Destination Recommender Systems”. Proceedings of ENTER 2004, Cairo, Egypt, January 26-28, 2004.

How to cite this paper

Using a User Experience Evaluation to Improve a Learning Management System Created in Response to COVID-19

How to cite this paper:  Maimoona H. Al Abri, Ali S. Al Adi, Alrabeea Awald Thani, Ghalib A. Alabrawi, Abdullah H. Al Harthi. (2022). Using a User Experience Evaluation to Improve a Learning Management System Created in Response to COVID-19. The Educational Review, USA6(5), 147-157.

DOI: http://dx.doi.org/10.26855/er.2022.05.001

Free HPG Newsletters

Add your e-mail address to receive free newsletters from Hill Publishing Group.

Contact us

Hill Publishing Group

8825 53rd Ave

Elmhurst, NY 11373, USA

E-mail: contact@hillpublisher.com

Copyright © 2019 Hill Publishing Group Inc. All Rights Reserved.