China
Africa
Explore chapters and articles related to this topic
*
Published in Nathalie Henry Riche, Christophe Hurter, Nicholas Diakopoulos, Sheelagh Carpendale, Data-Driven Storytelling, 2018
Fereshteh Amini, Matthew Brehmer, Gordon Bolduan, Christina Elmer, Benjamin Wiederkehr
To evaluate the usability and learnability of a storytelling tool, a simple usability study may be appropriate [60] in which participants naive to the tool are recruited and instructed to accomplish a specific goal or a series of specific tasks such as recreating or approximating an existing story or a series of presentation-oriented charts. As they attempt to complete these tasks, participants should be encouraged to think aloud while interacting with the interface of the tool. Think-aloud protocols are limited in that they do not capture automatic, nonconscious reactions to stimuli; as a result, a think-aloud protocol should be complemented with a retrospective interview or survey following the completion of the tasks. Usability study sessions should also be video recorded, and if possible, the authoring tool should be instrumented such that an interaction log is generated as a person interacts with the tool. These additional sources of data, along with the think-aloud transcript result in qualitative insights about the tool that can help the tool evaluators to assess whether the tool’s functionality is visible, accessible, and used as they were anticipated by the designers, as well as whether the use of features produce the results by the participants. These usability studies can also help to determine if the tool requires additional functionality, or if existing functionality is unnecessary or redundant.
Methods for Usability Evaluation
Published in Patrick W. Jordan, An Introduction to Usability, 2020
A possible disadvantage of think aloud protocols is related to the possible interference between participants’ verbalisations and the tasks that they are performing. It could be argued that, in a sense, participants in think aloud protocol are performing two tasks – not only using the product under test, but also trying to verbalise what they are doing whilst using the product. The problem, then, is that this second task may interfere with the first and any difficulties that the user encounters could, possibly, be connected with the distraction caused by having to make verbalisations.
Research
Published in Frank Devitt, Martin Ryan, Trevor Vaugh, Arrive, 2021
Frank Devitt, Martin Ryan, Trevor Vaugh
The Think Aloud method has been widely used in design, psychology and other social science contexts for many decades. There is evidence that the Think Aloud protocol provides better quality data than other methods that rely on recalling information or verbalising hypothetical scenarios, which are subject to selective recall bias. The Think Aloud protocol subjects merely report verbally, in real time, on their thoughts, without interpretation or further processing. While there may be some cognitive load associated with the verbalisation, it is minimal and usually the subject quickly becomes accustomed to it.
Understanding How Older Adults Comprehend COVID-19 Interactive Visualizations via Think-Aloud Protocol
Published in International Journal of Human–Computer Interaction, 2023
Mingming Fan, Yiwen Wang, Yuni Xie, Franklin Mingzhe Li, Chunyang Chen
To answer RQs, we first reviewed COVID-19 related live dashboards and news media websites to identify common types of interactive visualizations and curated a set of representative interactive visualizations. These visualizations covered all common types of interaction techniques adopted in interactive visualizations based on a well-known taxonomy (Yi et al., 2007). We further studied the types of data shown in these visualizations and designed a set of tasks for participants to work on in the user study. To better understand how they comprehend the visualizations, we asked older adult participants (N = 14) to think aloud while working on the tasks during the study. We chose to use the think-aloud protocol because it is a well-known method for understanding users’ thought processes that are otherwise invisible to researchers (Nielsen, 2012) and widely used in industry to identify user experience problems (Fan et al., 2020; McDonald et al., 2012).
A comparison of three think-aloud protocols used to evaluate a voice intelligent agent that expresses emotions
Published in Behaviour & Information Technology, 2019
Xiang Ji, Pei-Luen Patrick Rau
The think-aloud protocols had three levels: retrospective think-aloud, in which participants were asked to think-aloud based on their chat history after all tasks had been completed; classical think-aloud, in which participants were asked to think-aloud to the experimenter under speech communication during the tasks; and interactive think-aloud, in which participants were asked to think-aloud to the VIA that they were evaluating during the tasks.