Behavioral research publication hub - Latest studies, white papers

Mediational Affordances at a Science Centre Gallery: An Exploratory and Small Study Using Eye Tracking and Interviews

Science centres are informal learning spaces embedded with artefacts embodying mediational affordances. This exploratory and small-scale mixed methods study juxtaposes eye-tracking technologies and qualitative interviews to examine how visitors to a gallery navigated this space and interacted with different artefacts. A total of 15 visitors to the science centre gallery, Energy Story, participated in the study. The findings revealed inconclusive results about the directionality of their navigation. The mediational affordances of the artefacts, as interpreted from the interactive elements and interaction of the visitors and interviews, suggested that it was better to distribute the mediational affordances across a few artefacts in an exhibit rather than have one artefact embody several affordances. The concept of “mediational threshold” was suggested as a topic for future study. The findings contributed to the academic literature on eye-tracking studies at science centres. They also provided ideas for science centre curators and teachers who bring students with diverse learning needs to this mediational space.

Eye Tracking Glasses

Software

3 versions available

Online Multimodal End-of-Turn Prediction for Three-party Conversations

Predicting end-of-turn in multiparty conversations is crucial to increase the usability and natural flow of spoken dialogue systems, offering substantial enhancements to conversational agents. We present a novel window-based method to predict end-of-turn moments in real-time in multiparty conversations, by leveraging the capabilities of cutting-edge pre-trained language models (PLMs) and recurrent neural networks (RNN). Our method fuses the distilBERT language model with a Gated Recurrent Unit (GRU) to accurately predict end-of-turn points in an online fashion. Our approach can significantly outperform conventional Inter-Pausal Unit (IPU)-based prediction methods that often overlook the nuances of overlap and interruption during dynamic conversations. Potential applications of this study are significant, particularly in the domains of virtual agents and human-robot interactions. Our accurate online end-of-turn prediction model can be facilitated to enhance the user experience in these applications, making them more natural and seamlessly integrated into real-world conversations.

Eye Tracking Glasses

Software

1 version available:

Pistol: Pupil invisible supportive tool in the wild

This paper is an in the wild evaluation of the eye tracking tool Pistol. Pistol supports Pupil Invisible projects and other eye trackers (Dikablis, Emke GmbH, Look, Pupil, and many more) in offline mode. For all eye tracking recordings, Pistol is able to compute pupil and iris ellipse, eye aperture, eye lids, 3D eye ball, optical vector estimation, and eye movement types. For Pupil Invisible projects, it also supports the detection of a special marker and allows the 2D and 3D gaze estimation mapped on the scene camera. In this extended journal paper for Pistol we focus on challenging in the wild situations, such as reflections on glasses, eye tracking during sport, changing lighting conditions, and this for two eye trackers. The tool Pistol can be downloaded here Link

Eye Tracking Glasses

Software

2 versions available

Quantitative Analysis of Physiological and Psychological Impacts of Visual and Auditory Elements in Wuyishan National Park Using Eye-Tracking

Amidst rapid societal changes and increasing urbanization, human connectivity with nature has declined, exacerbating public health concerns. This study assesses the efficacy of Shinrin-yoku, or ‘forest bathing’, in Wuyishan National Park as a simple and effective method to counteract the adverse health effects of contemporary lifestyles. Employing repeated-measures analysis of variance, forty-one participants were observed over three days across eight distinct forest settings. Techniques included eye-tracking for visual attention and soundscape perception assessments via questionnaires. Physiological responses were gauged through heart rate variability and skin conductance, while psychological evaluations utilized the Profile of Mood States (POMS) and Positive and Negative Affect Schedule (PANAS). Findings revealed that (1) natural soundscapes—especially birdsong, flowing water, wind, and bamboo raft sounds—and visual elements, such as distant mountains, streams, trees, Danxia landforms, tea gardens, and bamboo views, play pivotal roles in regulating heart rate variability, reducing arousal, and enhancing stress adaptation. Additionally, cultural landscapes, such as classical music and ancient structures, bolster parasympathetic activity. (2) Natural and cultural auditory stimuli, including flowing water and classical music, coupled with visual features, such as Danxia landforms, streams, distant mountains, lawns, and guide signs, effectively induce positive mood states, regulate mood disturbances, and enhance psychological well-being across diverse forest settings. These findings underscore the significant health benefits of immersive natural experiences and advocate for integrating forest-based wellness programs into public health strategies, offering compelling evidence for enriching life quality through nature engagement.

Eye Tracking Glasses

Software

3 versions available

Recognition of marine navigators’ workload based on eye movement features using bridge simulation

The human factor accounts for 80% of marine traffic accidents, either directly or indirectly. Workload significantly impacts the reliability of marine navigators’ behavior. Employing eye movement measurement as an objective assessment tool can effectively evaluate seafarers’ workload. This study conducts bridge simulation experiments to analyze eye movement features and investigate marine navigators’ workload levels across different tasks. By categorizing marine navigators’ workload into high and low levels based on specific navigation duties, the study employs an independent sample T-test to select blink frequency, fixation time percentage, and pupil area standard deviation as key eye movement features for workload recognition. A marine navigators’ workload recognition model is developed utilizing the support vector machine (SVM) algorithm, which is subsequently trained and evaluated with experimental data. Results demonstrate a high recognition rate of 90.91% for marine navigators’ workload, indicating the SVM method’s accuracy in workload assessment based on eye movement features. These findings lay the foundation for the advancement of intelligent monitoring systems for marine navigators’ workload and the implementation of human–computer interaction active early warning technology and equipment.

Simulator

Software

2 versions available

Text a Bit Longer or Drive Now? Resuming Driving after Texting in Conditionally Automated Cars

In this study, we focus on different strategies drivers use in terms of interleaving between driving and non-driving related tasks (NDRT) while taking back control from automated driving. We conducted two driving simulator experiments to examine how different cognitive demands of texting, priorities, and takeover time budgets affect drivers’ takeover strategies. We also evaluated how different takeover strategies affect takeover performance. We found that the choice of takeover strategy was influenced by the priority and takeover time budget but not by the cognitive demand of the NDRT. The takeover strategy did not have any effect on takeover quality or NDRT engagement but influenced takeover timing.

Simulator

Software

1 version available:

The effects of errorless psychomotor training in the

This study investigated the training effect of errorless psychomotor training, a motor training method with perceptual, attentional, and psychological manipulation, in a balance-related, lower limb reaching task (Y balance reaching task) on dynamic balance by young adults. Thirty-nine participants (Mean age = 27.03 years, SD = 2.64 years) were trained with different psychomotor training methods in the Y balance reaching task. Results illustrate that errorless psychomotor training significantly improved the participants’ dynamic balance and proprioceptive abilities. Additionally, gaze fixation duration on target during reaching decreased after errorless psychomotor training, suggesting that errorless psychomotor training could decrease visual information demand and be concurrently compensated by up-weighting on proprioception. This multisensory reweighting and cross-modal attention could contribute to the improvement of dynamic balance ability in sports.

Eye Tracking Glasses

Simulator

4 versions available

The effects of tunnel radius, turn direction, and zone characteristics on drivers’ visual performance

This study aimed to explore the influence of the tunnel radius, turn direction, and zone characteristics on drivers’ visual performance. The study used a field experiment, in which 30 participants drove real vehicles in different curved tunnels, and measured their fixation duration (FD), fixation frequency (FF), saccade duration (SD), and saccade amplitude (SA) as indicators of visual performance. The results showed that the tunnel radius, turn direction, and zone characteristics had significant effects on all four indicators of visual performance. As the tunnel radius decreases, drivers exhibit longer FD and larger SA, while FF and SD decrease correspondingly. Additionally, the directional aspect of turning significantly influences these eye movement parameters, with drivers demonstrating longer FD, lower FF, shorter SD, and smaller SA during left turns compared to right turns. Irrespective of turning direction, drivers allocate the longest average FD and highest FF in the entrance zone, followed by the middle zone, and the shortest duration in the exit zone under the same tunnel radius condition. Similarly, the mean SD and amplitude are highest in the exit zone, followed by the middle zone, and lowest in the entrance zone, regardless of the turning condition. These findings suggest that drivers adjust their visual behavior according to the dynamic and complex visual stimuli and the varying driving task demands in different scenarios of curved tunnel driving. These findings also imply that drivers face different perceptual and cognitive challenges and preferences when driving in curved tunnels with different radii, turn directions, and zone characteristics, which affect their visual adaptation and preparation processes, as well as their visual integration and differentiation processes. This study has some implications and suggestions for the design and management of curved tunnels, as well as for the education and training of drivers. This study also provides new theoretical and empirical evidence for the visual behavior and cognition of drivers in curved tunnels, and provides practical suggestions for enhancing their visual performance and improving their driving safety and efficiency in curved tunnels.

Eye Tracking Glasses

Simulator

2 versions available

The Role of Visuomotor Behaviours in Understanding the Functionality of Upper Limb Prostheses

Advanced upper limb prostheses aim to restore coordinated hand and arm function. However, this objective can be difficult to quantify as coordinated movements require an intact visuomotor system. Eye tracking has recently been applied to study the visuomotor behaviours of upper limb prosthesis users by enabling the calculation of eye movement metrics. This scoping review aims to characterize the visuomotor behaviours of upper limb prosthesis users as described by eye tracking metrics, to summarize the eye tracking metrics used to describe prosthetic behaviour, and to identify gaps in the literature and potential areas for future research. A review of the literature was performed to identify articles that reported eye tracking metrics to evaluate the visual behaviours of individuals using an upper limb prosthesis. Data on the level of amputation, type of prosthetic device, type of eye tracker, primary eye metrics, secondary outcome metrics, experimental task, aims, and key findings were extracted. Seventeen studies were included in this scoping review. A consistently reported finding is that prosthesis users have a characteristic visuomotor behaviour that differs from that of individuals with intact arm function. Visual attention has been reported to be directed more towards the hand and less towards the target during object manipulation tasks. A gaze switching strategy and delay to disengage gaze from the current target has also been reported. Differences in the type of prosthetic device and experimental task have revealed some distinct gaze behaviours. Control factors have been shown to be related to gaze behaviour, while sensory feedback and training interventions have been demonstrated to reduce the visual attention associated with prosthesis use. Eye tracking metrics have also been used to assess the cognitive load and sense of agency of prosthesis users. Overall, there is evidence that eye tracking is an effective tool to quantitatively assess the visuomotor behaviour of prosthesis users and the recorded eye metrics are sensitive to change in response to various factors. Additional studies are needed to validate the eye metrics used to assess cognitive load and sense of agency in upper limb prosthesis users.

Eye Tracking Glasses

Software

1 version available:

Training benefits driver behaviour while using automation with an attention monitoring system

Attention, or more generally, driver monitoring systems have been identified as a necessity to address overreliance on driving automation. However, research suggests that monitoring systems may not be sufficient to support safe use of advanced driver assistance systems (ADAS), also evidenced by a recent major recall of Tesla’s monitoring software. The objective of the current study was to investigate whether different training approaches improve driver behaviour while using ADAS with an attention monitoring system. A driving simulator study was conducted with three between-subject groups: no training, limitation-focused training (highlighted situations where ADAS would not work), and responsibility-focused training (highlighted the driver’s role/responsibility while using ADAS). All participants (N = 47) experienced eight events which required the ego-vehicle to slow down to avoid a collision. Anticipatory cues in the environment indicated the potential for the upcoming events. Event type (covered in training vs. not covered) and event criticality (action-necessary vs. action-not-necessary) were within-subject factors. The responsibility-focused group made fewer long glances (≥ 3 s) to a secondary task than the no training and limitation-focused groups when there were no anticipatory cues. Responsibility-focused training and no training were associated with faster takeover time at the events than limitation-focused training. There were additional benefits of responsibility-focused training for events that were covered in training (e.g., higher percent of time looking at the anticipatory cues). Overall, our results suggest that even if attention monitoring systems are implemented, there may be benefits to driver ADAS training. Responsibility-focused training may be preferable to limitation-focused training, especially for situations where minimizing training length is advantageous.

Simulator

Software

3 versions available

Company

Publication Hub

Filter menu

Mediational Affordances at a Science Centre Gallery: An Exploratory and Small Study Using Eye Tracking and Interviews

Online Multimodal End-of-Turn Prediction for Three-party Conversations

Pistol: Pupil invisible supportive tool in the wild

Quantitative Analysis of Physiological and Psychological Impacts of Visual and Auditory Elements in Wuyishan National Park Using Eye-Tracking

Recognition of marine navigators’ workload based on eye movement features using bridge simulation

Text a Bit Longer or Drive Now? Resuming Driving after Texting in Conditionally Automated Cars

The effects of errorless psychomotor training in the

The effects of tunnel radius, turn direction, and zone characteristics on drivers’ visual performance

The Role of Visuomotor Behaviours in Understanding the Functionality of Upper Limb Prostheses

Training benefits driver behaviour while using automation with an attention monitoring system

Explore Cutting-Edge Research in Human Factors and Ergonomics