A Tool to Assist in the Analysis of Gaze Patterns in Upper Limb Prosthetic Use
Gaze-tracking, where the point of regard of a subject is mapped onto the image of the scene the subject sees, can be employed to study the visual attention of the users of prosthetic hands. It can show whether the user pays greater attention to the actions of their prosthetic hand as they use it to perform manipulation tasks, compared with the general population. Conventional analysis of the video data requires a human operator to identify the key areas of interest in every frame of the video data. Computer vision techniques can assist with this process, but fully automatic systems require large training sets. Prosthetic investigations tend to be limited in numbers. However, if the assessment task is well-controlled, it is possible to make a much simpler system that uses the initial input from an operator to identify the areas of interest and then the computer tracks the objects throughout the task. The tool described here employs colour separation and edge detection on images of the visual field to identify the objects to be tracked. To simplify the computer’s task further, this test uses the Southampton Hand Assessment Procedure (SHAP) to define the activity spatially and temporarily, reducing the search space for the computer. The work reported here concerns the development of a software tool capable of identifying and tracking the points of regard and areas of interest throughout an activity with minimum human operator input. Gaze was successfully tracked for fourteen unimpaired subjects and was compared with the gaze of four users of myoelectric hands. The SHAP cutting task is described and the differences in attention observed with a greater number of shorter fixations by the prosthesis users compared to unimpaired subjects. There was less looking ahead to the next phase of the task by the prosthesis users.
Eye Tracking Glasses
Software
An analysis of the methodology and validation of the design and presentation of stimulus materials for eye-tracking experiments
Purpose, eye-tracking experimental method is gradually becoming a research hotspot for designing towards intelligence because of its ability to objectively reflect the visual perception process of the subjects. In order to enhance the rationality of the intelligent use of eye-tracking experimental method in the field of design, and to help solve the problem of the lack of a systematic approach to the design of stimulus materials in eye-tracking experiments, the corresponding theoretical model is proposed and verified in practice. Methods, relevant literature in the field of combining eye-tracking instrument and intelligent design at home and abroad is collected and organised, hierarchical relationships are sorted out, theoretical models are constructed, and eye-tracking experiments of China's underground signs are used as an example to verify the reliability of the method model. Conclusion, the design method of stimulus materials for eye movement experiments with experimental purpose as the guide and dimension division as the means is proposed, which provides certain case support for the formation of systematic theory for the intelligent design of stimulus materials in the future, and helps the researchers to be able to accurately carry out the design of stimulus materials based on the purpose of the research when carrying out the eye movement experiments, and better promotes the development of eye movement experimental method in the field of artificial intelligence, and achieves the perfect integration of science and technology and life.
Eye Tracking Glasses
Software
An end-to-end review of gaze estimation and its interactive applications on handheld mobile devices
In recent years, we have witnessed an increasing number of interactive systems on handheld mobile devices which utilise gaze as a single or complementary interaction modality. This trend is driven by the enhanced computational power of these devices, higher resolution and capacity of their cameras, and improved gaze estimation accuracy obtained from advanced machine learning techniques, especially in deep learning. As the literature is fast progressing, there is a pressing need to review the state-of-the-art, delineate the boundary, and identify the key research challenges and opportunities in gaze estimation and interaction. This article aims to serve this purpose by presenting an end-to-end holistic view in this area, from gaze capturing sensors, to gaze estimation workflows, to deep learning techniques, and to gaze interactive applications.
Eye Tracking Glasses
Simulator
Analysis of Interaction Methods in VR Virtual Reality
Virtual Reality is a new revolution in interaction. As a super technology that can trick the human brain, Virtual Reality is widely used in healthcare, education, business, medical, entertainment and industry. In the field of VR, developers are committed to giving users a full and realistic interactive experience, for example by transmitting the senses of touch, smell, sight and hearing to the user's brain and restoring the user's perception of the real world first-hand. This requires not only powerful technology, but also sophisticated interaction design. Many VR giants are currently working on various technologies and systems to enhance the user's interaction experience in the virtual world. This article analyses three of the main interaction methods (motion capture, eye tracking and haptic feedback) and their associated device products and provide a brief comparison and summary of them. Although the interaction methods in VR are not yet unified and the various virtual reality devices on the market have their own flaws, with more and more players getting involved and the rapid development of technology, it is not difficult to judge that in the near future virtual reality interaction devices will explode like a rocket.
Eye Tracking Glasses
Software
Anticipatory driving in automated vehicles: The effects of driving experience and distraction
Objective: To understand the influence of driving experience and distraction on drivers’ anticipation of upcoming traffic events in automated vehicles. Background: In nonautomated vehicles, experienced drivers spend more time looking at cues that indicate upcoming traffic events compared with novices, and distracted drivers spend less time looking at these cues compared with nondistracted drivers. Further, pre-event actions (i.e., proactive control actions prior to traffic events) are more prevalent among experienced drivers and nondistracted drivers. However, there is a research gap on the combined effects of experience and distraction on driver anticipation in automated vehicles. Methods: A simulator experiment was conducted with 16 experienced and 16 novice drivers in a vehicle equipped with adaptive cruise control and lane-keeping assist systems (resulting in SAE Level 2 driving automation). Half of the participants in each experience group were provided with a self-paced primarily visual-manual secondary task. Results: Drivers with the task spent less time looking at cues and were less likely to perform anticipatory driving behaviors (i.e., pre-event actions or preparation for pre-event actions such as hovering fingers over the automation disengage button). Experienced drivers exhibited more anticipatory driving behaviors, but their attention toward the cues was similar to novices for both task conditions. Conclusion: In line with nonautomated vehicle research, in automated vehicles, secondary task engagement impedes anticipation while driving experience facilitates anticipation. Application: Though Level 2 automation can relieve drivers of manually controlling the vehicle and allow engagement in distractions, visual-manual distraction engagement can impede anticipatory driving and should be restricted.
Eye Tracking Glasses
Simulator
Software
Comparative Data Analysis of Older Driver’s vs Younger Driver’s Gap Acceptance Behavior at signalized left turns-A driving Simulator Study
Drivers aged 65 and older are particularly prone to motor vehicle crashes, with approximately 20% of traffic fatalities occurring at intersections [11]. Intersections appear to be hazardous for drivers in this age group due to cognitive, perceptual, and psychomotor challenges. Older drivers find it particularly difficult to safely navigate left turns at signalized permissive intersections, having problems adequately detecting, perceiving, and accurately judging the safety of gaps. The increase in the number of elderly drivers has been paralleled by an increase in road-related accidents due to age-related fragility. By 2030, more than 21% of the adult population is projected to be over 65 years old [1]. However, previous studies have not adequately considered the combined effects of the randomized gap, queue length, traffic volume, pedestrians, and physiological factors on driving. The current study aims to address the gap in the literature by explicitly examining older and younger drivers’ gap acceptance behaviors during permissive left turns at four-way intersections. The main objective of this thesis is to study, identify and analyze the effect of Gap Acceptance Behavior on age, traffic volume, queue length, and physiological factors such as heart rate variability (HRV), electrodermal activity (EDA), and motion sickness among older and younger drivers. The data was collected from a driving simulator study comprising 40 participants aged between 20-30 for younger and 65 years for older. The collected data was used for comparative analysis, with the Gap Accepted by the drivers calculated from the video data. The gap is calculated as the distance between the left turning vehicle and the oncoming traffic. All recruited drivers were healthy. Each participant navigated twelve scenarios, six with lower traffic conditions and six with higher traffic conditions. Each lower and higher traffic scenario varied in queue length, with the number of cars in front of the ego vehicle varying from 0, 1, and 2. All varying queue lengths also had one with a pedestrian and another without. The physiological data collected through the Empatica4 wristband was also considered to study the gap acceptance behavior. Another parameter, motion sickness susceptibility score (MSSQ), was obtained from a questionnaire the participants completed after the experiment. Of these factors, queue length, traffic volume, and pedestrians play a significant role in studying gap acceptance. There is a significant difference in accepting and rejecting the gap between young and older drivers. Older drivers’ decision is affected more by factors, such as traffic volume, age, queue length, HRV, EDA, MSSQ score and the presence of pedestrians. This study showed that older drivers exhibited longer gap acceptance times than their younger counterparts while turning left across traffic at permissive intersections. Researchers may use the findings to better understand gap acceptance behaviors, while policymakers may utilize the results to design mobility guidelines.
Eye Tracking Glasses
Simulator
Conditionally Automated Vehicles as a Safe and Productive Workspace
Conditionally Automated Vehicles (CAVs) are poised to revolutionize transportation by providing not only safe and efficient travel but also the potential to serve as a productive workspace. This dissertation explores the feasibility, design considerations, and potential benefits of utilizing CAVs as mobile workspaces. By examining the safety protocols, ergonomic designs, and productivity tools required, the research aims to establish a framework for integrating work activities into the vehicular environment, thereby enhancing the overall value proposition of CAVs. The findings suggest that with appropriate design and regulatory measures, CAVs can significantly contribute to productivity while maintaining high safety standards.
Eye Tracking Glasses
Software
Correlation between driver visual characteristics and lane change parameters in urban long-term work zone
To investigate the correlation between drivers' visual characteristics and lane change parameters in urban long-term work zone, firstly, this paper obtains the oculomotor parameters of different drivers in urban long-term operation areas through real vehicle experiments and concludes that the pupil area and saccade angel of drivers in warning area and upstream transition area road sections have significant differences within 95% confidence interval by one-way ANOVA method. Next, scatter plots of lane change behavior parameters and eye movement parameters were plotted and validated by the Person correlation statistics method to find that: In the warning zone section, the driver's pupil area was negatively correlated with running speed, distance from the latest lane change point, and lateral displacement acceleration to varying degrees, with the strongest correlation with distance from the latest lane change point, |г|=0.816; the saccade angel was correlated with running speed and lateral displacement acceleration, with the strongest correlation with running speed, |г|=0.667. In the upstream transition zone section, the driver's pupil area was negatively correlated with all three lane change parameters to varying degrees, with the strongest correlation with the distance from the latest lane change point, |г|=0.512; the saccade angel was correlated with the distance from the latest lane change point, |г|=0.538, with no significant correlation with the running speed and lateral displacement acceleration.
Eye Tracking Glasses
Simulator
Effects of an intelligent virtual assistant on office task performance and workload in a noisy environment
This study examines the effects of noise and the use of an Intelligent Virtual Assistant (IVA) on the task performance and workload of office workers. Data were collected from forty-eight adults across varied office task scenarios (i.e., sending an email, setting up a timer/reminder, and searching for a phone number/address) and noise types (i.e., silence, non-verbal noise, and verbal noise). The baseline for this study is measured without the use of an IVA. Significant differences in performance and workload were found on both objective and subjective measures. In particular, verbal noise emerged as the primary factor affecting performance using an IVA. Task performance was dependent on the task scenario and noise type. Subjective ratings found that participants preferred to use IVA for less complex tasks. Future work can focus more on the effects of tasks, demographics, and learning curves. Furthermore, this work can help guide IVA system designers by highlighting factors affecting performance.
Eye Tracking Glasses
Software
