-
Text Entry Performance and Situation Awareness of a Joint Optical See-Through Head-Mounted Display and Smartphone System
Authors:
Jens Grubert,
Lukas Witzani,
Alexander Otte,
Travis Gesslein,
Matthias Kranz,
Per Ola Kristensson
Abstract:
Optical see-through head-mounted displays (OST HMDs) are a popular output medium for mobile Augmented Reality (AR) applications. To date, they lack efficient text entry techniques. Smartphones are a major text entry medium in mobile contexts but attentional demands can contribute to accidents while typing on the go. Mobile multi-display ecologies, such as combined OST HMD-smartphone systems, promi…
▽ More
Optical see-through head-mounted displays (OST HMDs) are a popular output medium for mobile Augmented Reality (AR) applications. To date, they lack efficient text entry techniques. Smartphones are a major text entry medium in mobile contexts but attentional demands can contribute to accidents while typing on the go. Mobile multi-display ecologies, such as combined OST HMD-smartphone systems, promise performance and situation awareness benefits over single-device use. We study the joint performance of text entry on mobile phones with text output on optical see-through head-mounted displays. A series of five experiments with a total of 86 participants indicate that, as of today, the challenges in such a joint interactive system outweigh the potential benefits.
△ Less
Submitted 7 September, 2023;
originally announced September 2023.
-
PoVRPoint: Authoring Presentations in Mobile Virtual Reality
Authors:
Verena Biener,
Travis Gesslein,
Daniel Schneider,
Felix Kawala,
Alexander Otte,
Per Ola Kristensson,
Michel Pahud,
Eyal Ofek,
Cuauhtli Campos,
Matjaž Kljun,
Klen Čopič Pucihar,
Jens Grubert
Abstract:
Virtual Reality (VR) has the potential to support mobile knowledge workers by complementing traditional input devices with a large three-dimensional output space and spatial input. Previous research on supporting VR knowledge work explored domains such as text entry using physical keyboards and spreadsheet interaction using combined pen and touch input. Inspired by such work, this paper probes the…
▽ More
Virtual Reality (VR) has the potential to support mobile knowledge workers by complementing traditional input devices with a large three-dimensional output space and spatial input. Previous research on supporting VR knowledge work explored domains such as text entry using physical keyboards and spreadsheet interaction using combined pen and touch input. Inspired by such work, this paper probes the VR design space for authoring presentations in mobile settings. We propose PoVRPoint -- a set of tools coupling pen- and touch-based editing of presentations on mobile devices, such as tablets, with the interaction capabilities afforded by VR. We study the utility of extended display space to, for example, assist users in identifying target slides, supporting spatial manipulation of objects on a slide, creating animations, and facilitating arrangements of multiple, possibly occluded, shapes. Among other things, our results indicate that 1) the wide field of view afforded by VR results in significantly faster target slide identification times compared to a tablet-only interface for visually salient targets; and 2) the three-dimensional view in VR enables significantly faster object reordering in the presence of occlusion compared to two baseline interfaces. A user study further confirmed that the interaction techniques were found to be usable and enjoyable.
△ Less
Submitted 17 January, 2022;
originally announced January 2022.
-
Accuracy Evaluation of Touch Tasks in Commodity Virtual and Augmented Reality Head-Mounted Displays
Authors:
Daniel Schneider,
Verena Biener,
Alexander Otte,
Travis Gesslein,
Philipp Gagel,
Cuauhtli Campos,
Klen Čopič Pucihar,
Matjaž Kljun,
Eyal Ofek,
Michel Pahud,
Per Ola Kristensson,
Jens Grubert
Abstract:
An increasing number of consumer-oriented head-mounted displays (HMD) for augmented and virtual reality (AR/VR) are capable of finger and hand tracking. We report on the accuracy of off-the-shelf VR and AR HMDs when used for touch-based tasks such as pointing or drawing. Specifically, we report on the finger tracking accuracy of the VR head-mounted displays Oculus Quest, Vive Pro and the Leap Moti…
▽ More
An increasing number of consumer-oriented head-mounted displays (HMD) for augmented and virtual reality (AR/VR) are capable of finger and hand tracking. We report on the accuracy of off-the-shelf VR and AR HMDs when used for touch-based tasks such as pointing or drawing. Specifically, we report on the finger tracking accuracy of the VR head-mounted displays Oculus Quest, Vive Pro and the Leap Motion controller, when attached to a VR HMD, as well as the finger tracking accuracy of the AR head-mounted displays Microsoft HoloLens 2 and Magic Leap. We present the results of two experiments in which we compare the accuracy for absolute and relative pointing tasks using both human participants and a robot. The results suggest that HTC Vive has a lower spatial accuracy than the Oculus Quest and Leap Motion and that the Microsoft HoloLens 2 provides higher spatial accuracy than Magic Leap One. These findings can serve as decision support for researchers and practitioners in choosing which systems to use in the future.
△ Less
Submitted 22 September, 2021;
originally announced September 2021.
-
Cloud-based traffic data fusion for situation evaluation of handover scenarios
Authors:
Andreas Otte,
Jens Staub,
Jonas Vogt,
Horst Wieker
Abstract:
Upcoming vehicles introduce functions at the level of conditional automation where a driver no longer must supervise the system but must be able to take over the driving function when the system request it. This leads to the situation that the driver does not concentrate on the road but is reading mails for example. In this case, the driver is not able to take over the driving function immediately…
▽ More
Upcoming vehicles introduce functions at the level of conditional automation where a driver no longer must supervise the system but must be able to take over the driving function when the system request it. This leads to the situation that the driver does not concentrate on the road but is reading mails for example. In this case, the driver is not able to take over the driving function immediately because she must first orient herself in the current traffic situation. In an urban scenario a situation that an automated vehicle is not able to steer further can arise quickly. To find suitable handover situations, data from traffic infrastructure systems, vehicles, and drivers is fused in a cloud-based situation to provide the hole traffic environment as base for the decision when the driving function should be transferred best and possibly even before a critical situation arises
△ Less
Submitted 29 January, 2021; v1 submitted 26 January, 2021;
originally announced January 2021.
-
Neurocognitive and traffic based handover strategies
Authors:
Andreas Otte,
Jonas Vogt,
Jens Staub,
Niclas Wolniak,
Horst Wieker
Abstract:
The level of automation in vehicles will significantly increase over the next decade. As automation will become more and more common, vehicles will not be able to master all traffic related situations for a long time by themselves. In such situations, the driver must take over and steer the vehicle through the situation. One of the important questions is when the takeover should be performed. Many…
▽ More
The level of automation in vehicles will significantly increase over the next decade. As automation will become more and more common, vehicles will not be able to master all traffic related situations for a long time by themselves. In such situations, the driver must take over and steer the vehicle through the situation. One of the important questions is when the takeover should be performed. Many decisive factors must be considered. On the one hand, the current traffic situation including roads, traffic light and other road users, especially vulnerable road users, and on the other hand, the state of the driver must be considered. The goal is to combine neurocognitive measurement of the drivers state and the static and dynamic traffic related data to develop an interpretation of the current situation. This situation analysis should be the basis for the determination of the best takeover point.
△ Less
Submitted 22 January, 2021;
originally announced January 2021.
-
Breaking the Screen: Interaction Across Touchscreen Boundaries in Virtual Reality for Mobile Knowledge Workers
Authors:
Verena Biener,
Daniel Schneider,
Travis Gesslein,
Alexander Otte,
Bastian Kuth,
Per Ola Kristensson,
Eyal Ofek,
Michel Pahud,
Jens Grubert
Abstract:
Virtual Reality (VR) has the potential to transform knowledge work. One advantage of VR knowledge work is that it allows extending 2D displays into the third dimension, enabling new operations, such as selecting overlapping objects or displaying additional layers of information. On the other hand, mobile knowledge workers often work on established mobile devices, such as tablets, limiting interact…
▽ More
Virtual Reality (VR) has the potential to transform knowledge work. One advantage of VR knowledge work is that it allows extending 2D displays into the third dimension, enabling new operations, such as selecting overlapping objects or displaying additional layers of information. On the other hand, mobile knowledge workers often work on established mobile devices, such as tablets, limiting interaction with those devices to a small input space. This challenge of a constrained input space is intensified in situations when VR knowledge work is situated in cramped environments, such as airplanes and touchdown spaces.
In this paper, we investigate the feasibility of interacting jointly between an immersive VR head-mounted display and a tablet within the context of knowledge work. Specifically, we 1) design, implement and study how to interact with information that reaches beyond a single physical touchscreen in VR; 2) design and evaluate a set of interaction concepts; and 3) build example applications and gather user feedback on those applications.
△ Less
Submitted 11 August, 2020;
originally announced August 2020.
-
Above Surface Interaction for Multiscale Navigation in Mobile Virtual Reality
Authors:
Tim Menzner,
Travis Gesslein,
Alexander Otte,
Jens Grubert
Abstract:
Virtual Reality enables the exploration of large information spaces. In physically constrained spaces such as airplanes or buses, controller-based or mid-air interaction in mobile Virtual Reality can be challenging. Instead, the input space on and above touch-screen enabled devices such as smartphones or tablets could be employed for Virtual Reality interaction in those spaces.
In this context,…
▽ More
Virtual Reality enables the exploration of large information spaces. In physically constrained spaces such as airplanes or buses, controller-based or mid-air interaction in mobile Virtual Reality can be challenging. Instead, the input space on and above touch-screen enabled devices such as smartphones or tablets could be employed for Virtual Reality interaction in those spaces.
In this context, we compared an above surface interaction technique with traditional 2D on-surface input for navigating large planar information spaces such as maps in a controlled user study (n = 20). We find that our proposed above surface interaction technique results in significantly better performance and user preference compared to pinch-to-zoom and drag-to-pan when navigating planar information spaces.
△ Less
Submitted 7 February, 2020;
originally announced February 2020.
-
ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality
Authors:
Daniel Schneider,
Alexander Otte,
Travis Gesslein,
Philipp Gagel,
Bastian Kuth,
Mohamad Shahm Damlakhi,
Oliver Dietz,
Eyal Ofek,
Michel Pahud,
Per Ola Kristensson,
Jörg Müller,
Jens Grubert
Abstract:
Physical keyboards are common peripherals for personal computers and are efficient standard text entry devices. Recent research has investigated how physical keyboards can be used in immersive head-mounted display-based Virtual Reality (VR). So far, the physical layout of keyboards has typically been transplanted into VR for replicating typing experiences in a standard desktop environment.
In th…
▽ More
Physical keyboards are common peripherals for personal computers and are efficient standard text entry devices. Recent research has investigated how physical keyboards can be used in immersive head-mounted display-based Virtual Reality (VR). So far, the physical layout of keyboards has typically been transplanted into VR for replicating typing experiences in a standard desktop environment.
In this paper, we explore how to fully leverage the immersiveness of VR to change the input and output characteristics of physical keyboard interaction within a VR environment. This allows individual physical keys to be reconfigured to the same or different actions and visual output to be distributed in various ways across the VR representation of the keyboard.
We explore a set of input and output mappings for reconfiguring the virtual presentation of physical keyboards and probe the resulting design space by specifically designing, implementing and evaluating nine VR-relevant applications: emojis, languages and special characters, application shortcuts, virtual text processing macros, a window manager, a photo browser, a whack-a-mole game, secure password entry and a virtual touch bar. We investigate the feasibility of the applications in a user study with 20 participants and find that, among other things, they are usable in VR. We discuss the limitations and possibilities of remapping the input and output characteristics of physical keyboards in VR based on empirical findings and analysis and suggest future research directions in this area.
△ Less
Submitted 18 July, 2019;
originally announced July 2019.