Submit a Manuscript

Journal of Information Systems Engineering and Management

Heuristic Evaluation and Usability Testing of G-MoMo Applications
Guma Ali 1 * , Mussa Ally Dida 1, Anael Elikana Sam 2
More Detail
1 Department of Information Technology Development and Management, Nelson Mandela African Institution of Science and Technology (NM-AIST), Tanzania
2 Department of Communication Science and Engineering (CoSE), Nelson Mandela African Institution of Science and Technology (NM-AIST), Tanzania
* Corresponding Author
Full Text (PDF)
Research Article

Journal of Information Systems Engineering and Management, 2022 - Volume 7 Issue 3, Article No: 15751
https://doi.org/10.55267/iadt.07.12296

Published Online: 29 Jul 2022

Views: 911 | Downloads: 967

Open Access
How to cite this article
APA 6th edition
In-text citation: (Ali et al., 2022)
Reference: Ali, G., Dida, M. A., & Sam, A. E. (2022). Heuristic Evaluation and Usability Testing of G-MoMo Applications. Journal of Information Systems Engineering and Management, 7(3), 15751. https://doi.org/10.55267/iadt.07.12296
Vancouver
In-text citation: (1), (2), (3), etc.
Reference: Ali G, Dida MA, Sam AE. Heuristic Evaluation and Usability Testing of G-MoMo Applications. J INFORM SYSTEMS ENG. 2022;7(3):15751. https://doi.org/10.55267/iadt.07.12296
AMA 10th edition
In-text citation: (1), (2), (3), etc.
Reference: Ali G, Dida MA, Sam AE. Heuristic Evaluation and Usability Testing of G-MoMo Applications. J INFORM SYSTEMS ENG. 2022;7(3), 15751. https://doi.org/10.55267/iadt.07.12296
Chicago
In-text citation: (Ali et al., 2022)
Reference: Ali, Guma, Mussa Ally Dida, and Anael Elikana Sam. "Heuristic Evaluation and Usability Testing of G-MoMo Applications". Journal of Information Systems Engineering and Management 2022 7 no. 3 (2022): 15751. https://doi.org/10.55267/iadt.07.12296
Harvard
In-text citation: (Ali et al., 2022)
Reference: Ali, G., Dida, M. A., and Sam, A. E. (2022). Heuristic Evaluation and Usability Testing of G-MoMo Applications. Journal of Information Systems Engineering and Management, 7(3), 15751. https://doi.org/10.55267/iadt.07.12296
MLA
In-text citation: (Ali et al., 2022)
Reference: Ali, Guma et al. "Heuristic Evaluation and Usability Testing of G-MoMo Applications". Journal of Information Systems Engineering and Management, vol. 7, no. 3, 2022, 15751. https://doi.org/10.55267/iadt.07.12296
ABSTRACT
Financial technology (FinTech) has swiftly revolutionized mobile money as one of the ways of accessing financial services in developing countries. Numerous mobile money applications were developed to access mobile money services but are hindered by severe authentication security challenges, thus, forcing the researchers to design a secure multi-factor authentication (MFA) algorithm for mobile money applications. Three prototypes of native mobile money applications (G-MoMo applications) were developed to confirm that the algorithm provides high security and is feasible. This study, therefore, aimed to evaluate the usability of the G-MoMo applications using heuristic evaluation and usability testing to identify potential usability issues and provide recommendations for improvement. Heuristic evaluation and usability testing methods were used to evaluate the G-MoMo applications. The heuristic evaluation was carried out by five experts that used the 10 principles proposed by Jakob Nielsen with a five-point severity rating scale to identify the usability problems. While the usability testing was conducted with forty participants selected using a purposive sampling method to validate the usability of the G-MoMo applications by performing tasks and filling out the post-test questionnaire. Data collected were analyzed in RStudio software. Sixty-three usability issues were identified during heuristic evaluation, where 33 were minor and 30 were major. The most violated heuristic items were “help and documentation”, and “user control and freedom”, while the least violated heuristic items were “aesthetic and minimalist design” and “visibility of system status”. The usability testing findings revealed that the G-MoMo applications’ performance proved good in learnability, effectiveness, efficiency, memorability, and errors. It also provided user satisfaction, ease of use, aesthetics, usefulness, integration, and understandability. Therefore, it was highly recommended that the developers of G-MoMo applications fix the identified usability problems to make the applications more reliable and increase overall user satisfaction.
KEYWORDS
Mobile money industry 4.0 digital transformation G-MoMo applications blockchain heuristic evaluation usability testing experts participants
REFERENCES
  • A’bas, N.N., Rahim, S.S., Dolhalit, M.L., Saifudin, W.S.N., Abdullasim, N., Parumo, S., Omar, R.N.R., Khair, S.Z.M., Kalaichelvam, K., Izhar, S.I.N., 2021. Development and Usability Testing of a Consultation System for Diabetic Retinopathy Screening. International Journal of Advanced Computer Science and Applications 12. https://doi.org/10.14569/IJACSA.2021.0120522
  • Abidin, S.R.Z., Fadzilah, S., Sahari, N., 2019. Heuristic Evaluation of Serious Game Application for Slow-reading Students. International Journal of Advanced Computer Science and Applications.
  • Agbezoutsi, K.E., Urien, P., Dandjinou, T.M., 2021. Mobile money traceability and federation using blockchain services. Annals of Telecommunications 76, 223–233. https://doi.org/10.1007/s12243-021-00840-4
  • Agbezoutsi, K.E., Urien, P., Dandjinou, T.M., 2019. Towards Blockchain Services For Mobile Money Traceability And Federation, in: 2019 3rd Cyber Security in Networking Conference (CSNet). pp. 14–20. https://doi.org/10.1109/CSNet47905.2019.9108970
  • Al-Gayar, S., Goga, N., Al-Habeeb, N., Ali, H., Marin, I., Shubber, M., 2021. Testing the Usability of the MediCare System. Turkish Journal of Computer and Mathematics Education (TURCOMAT) 12, 3227–3237. https://doi.org/10.17762/turcomat.v12i3.1569
  • Ali, G., Dida, M., Sam, A., 2021. A Secure and Efficient Multi-Factor Authentication Algorithm for Mobile Money Applications. Future Internet 13, 1–31. https://doi.org/10.3390/fi13120299
  • Ali, G., Dida, M., Sam, A., 2020a. Two-Factor Authentication Scheme for Mobile Money: A Review of Threat Models and Countermeasures. Future Internet 12, 1–27. https://doi.org/10.3390/fi12100160
  • Ali, G., Dida, M., Sam, A., 2020b. Evaluation of Key Security Issues Associated with Mobile Money Systems in Uganda. Information 11, 1–24. https://doi.org/10.3390/info11060309
  • Alturki, R., AlGhamdi, M., Gay, V., Awan, N., Kundi, M., Alshehri, M., 2020. Analysis of an ehealth app: Privacy, security and usability. International Journal of Advanced Computer Science and Applications 11, 209–214. https://doi.org/10.14569/IJACSA.2020.0110428
  • Ammar, L.B., 2019. A Usability Model for Mobile Applications Generated with a Model-Driven Approach. International Journal of Advanced Computer Science and Applications 10. https://doi.org/10.14569/IJACSA.2019.0100218
  • Ayeb, S., Hemery, B., Jeanne, F., Cherrier, E., 2022. Community detection for mobile money fraud detection. IEEE, Paris, France, pp. 1–6. https://doi.org/10.1109/SNAMS52053.2020.9336578
  • Babatunde, F.O., Macdermid, J., Grewal, R., Macedo, L.G., Szekeres, M., 2020. Development and Usability Testing of a Web-Based and Therapist-Assisted Coping Skills Program for Managing Psychosocial Problems in Individuals With Hand and Upper Limb Injuries: Mixed Methods Study. JMIR Human Factors 7.
  • Bajcar, B., Borkowska, A., Jach, K., 2020. Asymmetry in Usability Evaluation of the Assistive Technology among Users With and Without Disabilities. null 36, 1849–1866. https://doi.org/10.1080/10447318.2020.1798084
  • Ball, L.H., Bothma, T.J.D., 2018. Heuristic evaluation of e-dictionaries. Library Hi Tech 36, 319–338. https://doi.org/10.1108/LHT-07-2017-0144
  • Burkard, E.C., 2020. Usability Testing within a Devsecops Environment, in: 2020 Integrated Communications Navigation and Surveillance Conference (ICNS). pp. 1C1-1. https://doi.org/10.1109/ICNS50378.2020.9222919
  • Byun, D.-H., Yang, H.-N., Chung, D.-S., 2020. Evaluation of Mobile Applications Usability of Logistics in Life Startups. Sustainability 12. https://doi.org/10.3390/su12219023
  • Caro-Alvaro, S., García, E., García-Cabot, A., Marcos, L. de, Martínez-Herráiz, J.J., 2018. Identifying Usability Issues in Instant Messaging Apps on iOS and Android Platforms. Mob. Inf. Syst. 2018, 2056290:1-2056290:19.
  • Chipa, N., Mwanza, B., 2021. Factors Impeding Mobile Money Expansion in Zambia. International Journal of Engineering and Management Research 11, 178–186. https://doi.org/10.31033/ijemr.11.1.24
  • Eliseo, M.A., Casac, B.S., Gentil, G.R., 2017. A comparative study of video content user interfaces based on heuristic evaluation, in: 2017 12th Iberian Conference on Information Systems and Technologies (CISTI). pp. 1–6. https://doi.org/10.23919/CISTI.2017.7975820
  • Hertzum, M., 2020. Usability Testing: A Practitioner’s Guide to Evaluating the User Experience. Synthesis Lectures on Human-Centered Informatics 13, i–105.
  • Hewett, T.T., 1986. The role of iterative evaluation in designing systems for usability, in: People and Computers II: Designing for Usability. Cambridge University Press, Cambridge, pp. 196–214.
  • Höhn, S., Bongard-Blanchy, K., 2020. Heuristic evaluation of COVID-19 chatbots. Springer, pp. 131–144.
  • Hussain, A., Omar, A.M., 2020. Usability evaluation model for mobile visually impaired applications. International Journal of Interactive Mobile Technologies 14, 95–107. https://doi.org/10.3991/ijim.v14i05.13349
  • Islam, M.N., Bouwman, H., Islam, A.N., 2020. Evaluating web and mobile user interfaces with semiotics: An empirical study. IEEE Access 8, 84396–84414.
  • Jeddi, F.R., Nabovati, E., Bigham, R., Farrahi, R., 2020. Usability evaluation of a comprehensive national health information system: A heuristic evaluation. Informatics in Medicine Unlocked 19, 100332.
  • Jeong, J., Kim, N., In, H.P., 2020. GUI information-based interaction logging and visualization for asynchronous usability testing. Expert Systems with Applications 151, 113289.
  • Kekkonen, M., Oinas-Kukkonen, H., 2019. Social Comparison in Behavior Change Support Systems: Heuristic Evaluation of a System’s Usability.
  • Kous, K., Pušnik, M., Heričko, M., Polančič, G., 2020. Usability evaluation of a library website with different end user groups. Journal of Librarianship and Information Science 52, 75–90.
  • Kumar, B.A., Goundar, M.S., Chand, S.S., 2020. A framework for heuristic evaluation of mobile learning applications. Education and Information Technologies 25, 3189–3204.
  • Lowe, C., Sing, H.H., Browne, M., Alwashmi, M.F., Marsh, W., Morrissey, D., 2021. Usability testing of a digital assessment routing tool: protocol for an iterative convergent mixed methods study. JMIR research protocols 10, e27205.
  • Lynn, N.D., Sourav, A.I., Setyohadi, D.B., 2020. Increasing User Satisfaction of Mobile Commerce using Usability. International Journal of Advanced Computer Science and Applications 11. https://doi.org/10.14569/IJACSA.2020.0110839
  • Nabovati, E., Vakili-Arki, H., Eslami, S., Khajouei, R., 2014. Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system. J Med Syst 38, 35. https://doi.org/10.1007/s10916-014-0035-z
  • Nielsen, J., 2021. How many test users in a usability study? [WWW Document]. URL https://www.nngroup.com/articles/how-many-test-users/
  • Nielsen, J., 1994a. 10 Usability heuristics for user interface design [WWW Document]. URL https://www.nngroup.com/articles/ten-usability-heuristics/ (accessed 6.22.21).
  • Nielsen, J., 1994b. Severity ratings for usability problems. [WWW Document]. URL https://www.nngroup.com/articles/how-to-rate-the-severity-of-usability-problems/ (accessed 7.23.21).
  • Nielsen, J., Mack, R.L., 1994. Heuristic evaluation. Usability inspection methods.
  • Othman, M.K., Sulaiman, M.N.S., Aman, S., 2018. Heuristic Evaluation: Comparing Generic and Specific Usability Heuristics for Identification of Usability Problems in a Living Museum Mobile Guide App. Advances in Human-Computer Interaction 2018, 1518682. https://doi.org/10.1155/2018/1518682
  • Paramitha, A.A.I.I., Dantes, G.R., Indrawan, G., 2018. The Evaluation of Web Based Academic Progress Information System Using Heuristic Evaluation and User Experience Questionnaire (UEQ). 2018 Third International Conference on Informatics and Computing (ICIC) 1–6.
  • Pimentel, J.L., 2010. A note on the usage of Likert Scaling for research data analysis. USM R&D Journal 18, 109–112.
  • Putri, N.L., Maluana, A., Maryam, S.D., Juraida, A., 2021. Improving online course based on the result of usability testing methods. Psychology and Education 1, 6373–6382. https://doi.org/10.17762/pae.v58i1.3795
  • Ramayasa, I.P., Candrawibawa, I.G.A., 2021. Usability Evaluation of Lecturer Information Systems Using Sirius Framework and Moscow Technique. Scientific Journal of Informatics 8, 16–23.
  • Rwiza, S., Kissaka, M., Kapis, K., 2020. A methodology for evaluating security in MNO financial service model. IEEE, pp. 1–10.
  • Salari, R., Kalhori, S.R.N., GhaziSaeedi, M., Jeddi, M., Nazari, M., Fatehi, F., 2021. Mobile-based and cloud-based system for self-management of people with type 2 diabetes: Development and usability evaluation. Journal of medical Internet research 23, e18167.
  • Salman, H.M., Ahmad, W.F.W., Sulaiman, S., 2018. Usability evaluation of the smartphone user interface in supporting elderly users from experts’ perspective. Ieee Access 6, 22578–22591.
  • Santesteban-Echarri, O., Tang, J., Fernandes, J., Addington, J., 2020. Development and usability testing of SOMO, a mobile-based application to monitor social functioning for youth at clinical high-risk for psychosis. Digital Psychology 1, 4–19.
  • Sukmasetya, P., Setiawan, A., Arumi, E., 2020. Usability evaluation of university website: a case study. IOP Publishing, p. 012071.
  • Tremoulet, P.D., Shah, P.D., Acosta, A.A., Grant, C.W., Kurtz, J.T., Mounas, P., Kirchhoff, M., Wade, E., 2021. Usability of Electronic Health Record–Generated Discharge Summaries: Heuristic Evaluation. Journal of medical Internet research 23, e25657.
  • Vingen, D., Andrews, E.J., Ferati, M., 2020. Usability in Patient-Oriented Drug Interaction Checkers—A Scandinavian Sampling and Heuristic Evaluation. MDPI, p. 42.
  • Wahyuningrum, T., Kartiko, C., Wardhana, A.C., 2020. Exploring e-Commerce Usability by Heuristic Evaluation as a Compelement of System Usability Scale. IEEE, pp. 1–5.
  • Weichbroth, P., 2020. Usability of mobile applications: a systematic literature study. IEEE Access 8, 55563–55577.
  • Wirasasmiata, R., Uska, M., 2019. Evaluation of E-Rapor Usability using Usability Testing Method. Atlantis Press, pp. 343–346.
  • Zakaria, N., Wahabi, H., Al Qahtani, M., 2020. Development and usability testing of Riyadh Mother and Baby Multi-center cohort study registry. Journal of Infection and Public Health 13, 1473–1480.
LICENSE
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
All Rights Reserved © 2016-2024