China
Africa
Explore chapters and articles related to this topic
Usability testing for multimodal transportation application
Published in Aria Hendrawan, Rifi Wijayanti Dual Arifin, Engineering, Information and Agricultural Technology in the Global Digital Revolution, 2020
W.F. Akbar, P.W. Wirawan, E. Suharto
The evaluation of Travio application using usability testing has several stages, namely selecting respondents, asking respondents to work on assignments with the application, asking respondents to fill out questionnaires, and analyzing questionnaire results. Respondents were randomly selected BRT passengers whose age ranging from 17 to 25 years. The number of respondents is 8 people. Respondents were then asked to do the task in Table 1 without being told how to do it. After completing the assignment, respondents were asked to fill out a questionnaire containing 10 declarative statements from the System Usability Scale (SUS). Each respondent was asked to fill in the values of each statement using the Likert scale 1 to 5. Scale one means strongly disagree and five means strongly agree (Hartson and Pyla, 2012). The questions was shown in Figure 1.
Testing Performance Support Products
Published in James R. Williams, Developing Performance Support for Computer Systems, 2004
Various questionnaires have been used to collect data concerning the user’s satisfaction with a product or application. Three of the most popular questionnaires are the SUS, SUMI and QUIS. The SUS (System Usability Scale) is a 10-item questionnaire that gives an overview of satisfaction with a software product. Developed by John Brooke (1996) at Digital in 1986, the SUS was intended to: provide an easy test for subjects to complete (minimal number of questions), be easy to score and allow comparisons across product. It has been used extensively in evaluations of projects at Digital, such as office systems, technical tools and hardware systems and is freely available for use providing acknowledgement is made of the source. The SUS is a 5 point Likert scale that provides a single number representing a composite measure of the overall usability of the system, or product, being studied. It includes questions related to liking the system, ease of use, need for support, integration, consistency, ease of learning and confidence in using the system.
Methods of Evaluation
Published in Nancy J. Stone, Chaparro Alex, Joseph R. Keebler, Barbara S. Chaparro, Daniel S. McConnell, Introduction to Human Factors, 2017
Nancy J. Stone, Chaparro Alex, Joseph R. Keebler, Barbara S. Chaparro, Daniel S. McConnell
To measure end users’ perceptions of how usable a system or product is, specific measures have been developed to address the varying aspects that contribute to “usability.” The System Usability Scale (SUS) is described as a “quick-and-dirty” assessment tool to evaluate users’ perceptions of usability (Brooke, 1986). Table 5.5 presents the SUS items. Scores on each item are summarized and reflected as a total score out of 100 points (see Box 5.4 for an explanation on how to score and apply the SUS).
A Novel Hybrid Machine Learning Model for Analyzing E-Learning Users’ Satisfaction
Published in International Journal of Human–Computer Interaction, 2023
Sulis Sandiwarno, Zhendong Niu, Ally S. Nyamawe
Evaluation of e-learning systems has recently received considerable attention from the previous research to evaluate and quantify the satisfaction level of both lecturers and students. Satisfaction is a condition where the users accept the system and agree that they are comfortable to use it (Kornpitack & Sawmong, 2022; Landrum et al., 2021; Puška et al., 2021; Wei & Chou, 2020). In analyzing e-learning users’ satisfaction based on users’ activities, most of the previous approaches have attempted to employ several techniques, usage-based metrics, such as completion rate, task duration, and cursor distance or mouse click and most of the usability measurement tools for usability testing in analyzing e-learning users’ satisfaction in the previous research is System Usability Scale (SUS) (Alghabban & Hendley, 2022; Harrati et al., 2016; Pal & Vanijja, 2020; Revythi & Tselios, 2019; Vlachogianni & Tselios, 2022). System Usability Scale (SUS) is a survey-based metric for assessing the perceived usability of a system, product, and service (Brooke, 1996). The SUS metric is suitable for analyzing users’ satisfaction in e-learning systems since it can be used for a wide range of users’ characteristics and it allows processing usability results quickly and easily (Ani, 2020; Ani et al., 2019). Furthermore, the aforementioned approaches have used Technology Acceptance Model (TAM) and Structure Equation Model (SEM) based on questionnaires to analyze users’ satisfaction with the teaching and learning processes (Pal & Vanijja, 2020; Puška et al., 2021).
Exploring Relationships Between Eye Tracking and Traditional Usability Testing Data
Published in International Journal of Human–Computer Interaction, 2019
Jiahui Wang, Pavlo Antonenko, Mehmet Celepkolu, Yerika Jimenez, Ethan Fieldman, Ashley Fieldman
This study evaluated the usability of Algebra Nation™, a massive online learning environment that is used by hundreds of thousands of students, and investigated relationships between data collected using several usability evaluation methods. Traditional usability testing methods (i.e., standard metrics to gauge effectiveness and efficiency) revealed that the usability tasks resulted in variable task completion times and task difficulty ratings, which helped in identifying the aspects of the interface that need improvement. For example, participants rated task 4 (find a post explaining parallel line) as significantly more difficult compared to task 1 (log into the system), task 2 (select an instructor for the video) and task 5 (locate information on Karma Points). Results of the System Usability Scale, another traditional and widely used usability testing technique, suggested that Algebra Nation™ is user-friendly and easy to use. On average, the overall System Usability Scale score was 82, which is an acceptable SUS score for a system/interface evaluation. The levels of agreement with the SUS statements also corroborated this finding. Specifically, participants generally believed the system was easy to use and they were confident in using it.
Towards a Standard Arabic System Usability Scale: Psychometric Evaluation using Communication Disorder App
Published in International Journal of Human–Computer Interaction, 2018
Bareeq A. AlGhannam, Sana A. Albustan, Abeer A. Al-Hassan, Lamees A. Albustan
System Usability Scale (SUS) (Brooke, 1996, 2013) is a standard questionnaire widely used to evaluate the usability of diverse systems and products. John Brooke developed SUS in 1986 at Digital Equipment Corporation (DEC), Reading, UK. SUS questionnaire is composed of 10 questions that are equally divided by alternative negative and positive statements. The SUS positive statements are odd numbered and the negative statements are even numbered. The purported advantage of this alternation is to control bias (Sauro & Lewis, 2011). The respondents choose from a five-point Likert-scale that ranges from least agree to most agree which is represented by numbers from (1 to 5) accordingly. When there is no response a three is assigned (Brooke, 1996)”.