Evaluasi Usability Aplikasi Mobile Ngaji.ai dengan Penerapan Metode Cognitive Walkthrough

Ngaji.Ai is a learning application for reciting and studying the Qur'an based on Artificial Intelligence (AI), designed to assist users in improving their Qur'an pronunciation. This study aims to evaluate the usability of the Ngaji.Ai mobile application in supporting Qur'an learning. The evaluation method used is Cognitive Walkthrough, a technique that assesses the ease with which users understand and complete tasks in the application. The study’s respondents are students accustomed to using a physical Qur'an in their daily activities, allowing for a clearer comparison between the use of the physical Qur'an and the digital application. The evaluation focused on the main features of the application, such as Pre-Tahsin, Pre-Tahsin Test, Tadarus, and the AI-based Pronunciation Correction feature. The evaluation results showed a completion rate of 100% across all scenarios. A total of three errors were encountered across all scenarios during the evaluation process. The time-based efficiency recorded for each scenario was 0.217 goals/second for the Pre-Tahsin feature, 0.179 goals/second for the Pre-Tahsin Test feature, and 0.137 goals/second for the Tadarus feature, all of which were classified as very fast. Furthermore, numerous observations were made in the evaluation of the AI feature, particularly regarding the need to improve the algorithm's accuracy or expand the AI’s voice recognition dataset to enhance accuracy in detecting users' pronunciation.