Publication Hub

Moving to maintain perceptual and social constancy

Past research on object constancy has tended to treat the viewer as a passive observer. Here we examine viewers’ body and eye movements when they are asked to view photos of people in a gallery setting. Participants considered one individual in each photo, before indicating how socially connected they felt toward them and then moving to a spot in the gallery where they would be most comfortable when talking to them. Photographed individuals varied in their projected distance from the camera (near, far) and in their image resolution (sharp, slightly blurred). Results showed that participants looked more directly at near versus far individuals and at sharp versus blurred individuals. They also rated their social connection as stronger when the images were near versus far and sharp versus blurred. Where participants stood when making these ratings was strongly correlated with the projected distance of the images and with their ratings of social connection. These findings are discussed with regard to brain mechanisms for maintaining stability in our perceptions of geometric and social aspects of our world. They also highlight our inherent tendency to attribute qualities of our perceptual experiences to objects in that world.

Eye Tracking Glasses

Software

3 versions available

Multimodal Turn Analysis and Prediction for Multi-party Conversations

This paper presents a computational study to analyze and predict turns (i.e., turn-taking and turn-keeping) in multiparty conversations. Specifically, we use a high-fidelity hybrid data acquisition system to capture a large-scale set of multi-modal natural conversational behaviors of interlocutors in three-party conversations, including gazes, head movements, body movements, speech, etc. Based on the inter-pausal units (IPUs) extracted from the in-house acquired dataset, we propose a transformer-based computational model to predict the turns based on the interlocutor states (speaking/back-channeling/silence) and the gaze targets. Our model can robustly achieve more than 80% accuracy, and the generalizability of our model was extensively validated through cross-group experiments. Also, we introduce a novel computational metric called “relative engagement level" (REL) of IPUs, and further validate its statistical significance between turn-keeping IPUs and turn-taking IPUs, and between different conversational groups. Our experimental results also found that the patterns of the interlocutor states can be used as a more effective cue than their gaze behaviors for predicting turns in multiparty conversations.

Eye Tracking Glasses

Software

3 versions available

Multivariate Analysis of Gaze Behavior and Task Performance Within Interface Design Evaluation

Eye tracking technologies have frequently been used in sport research to understand the interrelations between gaze behavior and performance, using a paradigm known as vision-for-action. This methodology has not been robustly applied within the field of interface design. The present work demonstrates the benefit of employing a vision-for-action paradigm for interface evaluation. This is demonstrated through the evaluation of a novel task-specific symbology set presented on a head-up-display (HUD), developed to support pilots conduct ground operations in low-visibility conditions. HUD gaze behavior was correlated with task performance to determine whether certain combinations of gaze behavior could produce effective predictive performance models. A human-in-the-loop experiment was conducted with 11 professional pilots who were required to taxi in a fixed-base flight simulator using the HUD symbology, while gaze data toward the different HUD symbology elements was collected. Performance was measured as centerline deviation error and taxiing speed. Results revealed that appropriately timed gaze behavior toward task-specific elements of the HUD were associated with superior performance. During turns, attention toward an undercarriage lateral position indicator was associated with reduced centerline deviation (p < 0.05). The findings are interpreted alongside detailed posttrial user-feedback of the HUD symbology to illustrate how eye tracking methodologies can be incorporated into interface usability evaluations. The joint interpretation of these data demonstrates these novel procedures, the findings contribute to enhancing the wider domain of interface design evaluation.

Simulator

Software

6 versions available

On the relationship between occlusion times and in-car glance durations in simulated driving

Drivers have spare visual capacity in driving, and often this capacity is used for engaging in secondary in-car tasks. Previous research has suggested that the spare visual capacity could be estimated with the occlusion method. However, the relationship between drivers’ occlusion times and in-car glance duration preferences has not been sufficiently investigated for granting occlusion times the role of an estimate of spare visual capacity. We conducted a driving simulator experiment (N = 30) and investigated if there is an association between drivers’ occlusion times and in-car glance durations in a given driving scenario. Furthermore, we explored which factors and variables could explain the strength of the association. The findings suggest an association between occlusion time preferences and in-car glance durations in visually and cognitively low demanding unstructured tasks but that this association is lost if the in-car task is more demanding. The findings might be explained by the inability to utilize peripheral vision for lane-keeping when conducting in-car tasks and/or by in-car task structures that override drivers’ preferences for the in-car glance durations. It seems that the occlusion technique could be utilized as an estimate of drivers’ spare visual capacity in research – but with caution. It is strongly recommended to use occlusion times in combination with driving performance metrics. There is less spare visual capacity if this capacity is used for secondary tasks that interfere with the driver’s ability to utilize peripheral vision for driving or preferences for the in-car glance durations. However, we suggest that the occlusion method can be a valid method to control for inter-individual differences in in-car glance duration preferences when investigating the visual distraction potential of, for instance, in-vehicle infotainment systems.

Eye Tracking Glasses

Simulator

7 versions available

Pilot study: Effect of roles and responsibility training on driver’s use of adaptive cruise control between younger and older adults

With the development of driver support systems (SAE Levels 1 – 2), drivers must take on new monitoring and supervision tasks in additional to manual driving. Training is necessary to clarify drivers' new roles and promote safe usage and trust in these systems. Providing training for lower-levels of automation may also benefit drivers’ acceptance of future Fully Automated Vehicles (FAVs, SAE Level 5). However, younger and older drivers differ in training preferences (e.g., owner's manual vs on-road trial and error) and hold different attitudes towards automation. This study investigates the effects of additional training on drivers' roles and responsibilities when using Adaptive Cruise Control (ACC, SAE Level 1) for younger and older drivers. Thirty-nine adults (20 younger + 19 older) were trained on one of two ACC training protocols: basic (system functionality, operational procedures, and limitations) and comprehensive (basic training + ACC background and roles of responsibilities). Participants’ situational trust and ACC usage was evaluated before, during, and after experiencing an emergency event while using ACC in a driving simulator study. Results showed that the comprehensive training promoted drivers' situational trust in ACC, ACC usage, and the acceptance of FAVs. Compared to younger drivers, older drivers used ACC less, reported less dynamic situational trust, higher levels of workload, and lower acceptance. Overall, comprehensive training resulted in older drivers behaving similarly to younger drivers. The comprehensive training also promoted the acceptance of FAVs for both younger and older drivers. In conclusion, training of drivers’ roles and responsibilities has an impact on drivers’ usage of ACC and may be particularly useful for older drivers.

Simulator

Software

5 versions available

Quiet eye duration and performance outcome in petanque

Petanque is a competitive skill sport that is popular in Malaysia. Athletes often must perform in a high-pressure situation during a game. The purpose of the research is to understand the influence of the quiet eye duration on the performance outcome across different difficulties amongst the athletes. Ergoneer Dikablis (v3.55) eye-tracking system was used to collect the quiet eye duration of 8 Malaysian petanque athletes in a field setting at the National Sports Council (MSN), Keramat. The athletes were required to shoot the single ball (SB) and double ball (DB) (right ball only) across five different distances from the starting point alternately. The arrangement of a double ball is more difficult compared to a single ball. Three trials were permitted for each distance. Successful trials were recorded when the targeted ball was displaced from its original position in SB (whole ball) and in DB (ball on the right). A previous study found that athletes with higher levels of expertise and successful performance had longer QE duration. The performance outcome and the quiet eye duration were analysed for normality. The Mann-Whitney U-test and Kruskal-Wallis tests were conducted using SPSS statistical software. From the statistical findings, it was found that irrespective of distance, there is a difference in the quiet eye between a single ball and a double ball. As p=0.846, which is greater than p=0.05, there is no significant difference between distance and quiet eye for a single ball. As p=0.865, which is greater than 0.05, there is no significant difference between the distance and quiet eye for the double ball. In conclusion, the duration of the quiet eye is influenced by the difficulty level of the ball arrangement. The performance outcome was not found to be influenced by the quiet eye.

Eye Tracking Glasses

Software

3 versions available

Quiet eye training during the rugby union goal-kick: Practice and transfer effects in low-and high-pressure conditions

The present study aimed to examine the effect of a quiet eye training (QET) intervention compared to a technical training (TT) intervention on the visual control and performance of rugby union goal-kickers. Male rugby union players (n = 18, M age = 21.35 years, SD = 2.03) were randomly assigned into a QET or TT group. Participants completed a pre-test, retention test 1, pressure test, and retention test 2 over six weeks, including a two-week intervention programme. The QET focussed on the QE and performance, while TT focussed on technical aspects of rugby goal-kicking. Each participant performed a total of 50 kicks that consisted of 15 kicks during the pre-test, retention test 1, and retention test 2, and five kicks during the pressure test. Using a Dikablis eye-tracker the QE was measured before (QE-pre), and during (QE-online), the run-up of the goal-kick. The results indicated that QE-pre durations increased from the pre-test to both retention tests and the pressure test for the QET group only (all p's < 0.05, all d's ≥ 0.08). The QET group also displayed longer QE-pre durations during the pressure and retention tests (all p's < 0.05, all d's ≥ 0.80), and longer QE-online durations during the pressure test (d = 0.73), compared to the TT group. Finally, the QET group outperformed the TT group during the pressure test (d = 0.72). Thus, overall, our results revealed that a short QET intervention benefitted attentional control and goal-kicking performance, particularly under high-pressure.

Eye Tracking Glasses

Software

5 versions available

Reaching beneath the tip of the iceberg: A guide to the Freiburg Multimodal Interaction Corpus

Most corpora tacitly subscribe to a speech-only view filtering out anything that is not a ‘word’ and transcribing the spoken language merely orthographically despite the fact that the “speech-only view on language is fundamentally incomplete” (Kok 2017, 2) due to the deep intertwining of the verbal, vocal, and kinesic modalities (Levinson and Holler 2014). This article introduces the Freiburg Multimodal Interaction Corpus (FreMIC), a multimodal and interactional corpus of unscripted conversation in English currently under construction. At the time of writing, FreMIC comprises (i) c. 29 h of video-recordings transcribed and annotated in detail and (ii) automatically (and manually) generated multimodal data. All conversations are transcribed in ELAN both orthographically and using Jeffersonian conventions to render verbal content and interactionally relevant details of sequencing (e.g. overlap, latching), temporal aspects (pauses, acceleration/deceleration), phonological aspects (e.g. intensity, pitch, stretching, truncation, voice quality), and laughter. Moreover, the orthographic transcriptions are exhaustively PoS-tagged using the CLAWS web tagger (Garside and Smith 1997 ). ELAN-based transcriptions also provide exhaustive annotations of re-enactments (also referred to as (free) direct speech, constructed dialogue, etc.) as well as silent gestures (meaningful gestures that occur without accompanying speech). The multimodal data are derived from psychophysiological measurements and eye tracking. The psychophysiological measurements include, inter alia, electrodermal activity or GSR, which is indicative of emotional arousal (e.g. Peräkylä et al. 2015 ). Eye tracking produces data of two kinds: gaze direction and pupil size. In FreMIC, gazes are automatically recorded using the area-of-interest technology. Gaze direction is interactionally key, for example, in turn-taking (e.g. Auer 2021) and re-enactments (e.g. Pfeiffer and Weiss 2022 ), while changes in pupil size provide a window onto cognitive intensity (e.g. Barthel and Sauppe 2019). To demonstrate what opportunities FreMIC’s (combination of) transcriptions, annotations, and multimodal data open up for research in Interactional (Corpus) Linguistics, this article reports on interim results derived from work-in-progress.

Eye Tracking Glasses

Software

2 versions available

Research on pathfinding cognition in complex underground public space utilizing eye movement and EEG synchronous detection

The complex underground public space brings challenge on pathfinding cognition. This research took Luoxiong Road Station in Wuhan as experimental site, using eye movement and electroencephalogram (EEG) synchronous detection, through pathway analysis and space-time fault method, exploring relationship between pathfinding cognition and complex underground public space. It was found that pathfinding habits and pathfinding decision-making were mainly affected by personal factors and environmental factors, respectively. Pathfinders influenced by personal factors, had behaviors such as left-walking or right-walking tendency, and the ratio of brain wave β/α was low (impression ratio ≤1). Pathfinders influenced by environmental factors, interested in the other side situation, vertical traffic and so on, and the ratio of brain wave β/α was high (impression ratio >1), with the frontal and parietal occipital lobe regions of brain being more active. These conclusions provided theoretical and data supplements for underground rail transit environment optimizing design in future.

Eye Tracking Glasses

Simulator

2 versions available

Social and affective neuroscience of everyday human interaction: From theory to methodology

This book seeks to address central aspects for the scientific understanding of social and affective neuroscience as a whole. The book contains four parts:(I) Affective Neuroscience;(II) Social Neuroscience and Moral Emotions;(III) Clinical Neuroscience; and (IV) Methods Used in Social and Affective Neuroscience. The first part, Affective Neuroscience, presents the current state of affective neuroscience research. The term ‘affective’relates to moods and emotions and their processing, which plays a crucial role in human social interactions. We are constantly presented with our own emotions and moods and those of others. In social interactions, perceived affect processing and the processing of one’s own affect constitute ongoing necessities. Affective states guide our attention as well as motivation and thus have an effect on social interactions. The chapters in this part investigate psychological, neural and molecular aspects of affective neuroscience. The Social Neuroscience and Moral Emotions part covers phenomena present in society. Social and moral emotions guide our behaviour towards others, but the magnitude with which individuals experience these emotions varies greatly. The chapters in this part present neurobiological and behavioural processes in relevance to social interactions covering topics such mirror neurons and sex differences in social cognition as well as the development of morality and trust in the realm of social interaction. The Clinical Neuroscience part focuses on disorders/conditions that affect social cognition. As much as neuroscience can be used to explain everyday phenomena in social interactions, neuroscience can explain disorders/conditions of clinical relevance. The investigation of brains of healthy individuals compared to those with clinical diagnoses provides invaluable information on the disorders and the associated symptoms. With some conditions affecting social functioning, atypical brain processes can explain abnormalities in regard to social skills. Neuroscience can further explain emotion regulation and deficiency thereof. The chapters in this part stretch from clinical neuroscience in childhood and adolescence to adulthood The last part covers Methods Used in Social and Affective Neuroscience. Experts present state-of-the-art methods to investigate social and affective neuroscience with the typical currently widely applied equipment. That is, brain imaging (MRI), NIRS), electrophysiology (EEG, facial EMG), brain stimulation (TMS AND tDCS) and eye-tracking. The chapters in this part familiarise the reader with the listed methods by providing the necessary basic information but also to deepen the understanding and usability of these methods in social and affective neuroscience for more experienced readers.

Eye Tracking Glasses

Software

6 versions available

Company

Publication Hub

Filter menu

Moving to maintain perceptual and social constancy

Multimodal Turn Analysis and Prediction for Multi-party Conversations

Multivariate Analysis of Gaze Behavior and Task Performance Within Interface Design Evaluation

On the relationship between occlusion times and in-car glance durations in simulated driving

Pilot study: Effect of roles and responsibility training on driver’s use of adaptive cruise control between younger and older adults

Quiet eye duration and performance outcome in petanque

Quiet eye training during the rugby union goal-kick: Practice and transfer effects in low-and high-pressure conditions

Reaching beneath the tip of the iceberg: A guide to the Freiburg Multimodal Interaction Corpus

Research on pathfinding cognition in complex underground public space utilizing eye movement and EEG synchronous detection

Social and affective neuroscience of everyday human interaction: From theory to methodology

Explore Cutting-Edge Research in Human Factors and Ergonomics