Extensible Neck: A Gesture Input Method to Extend/Contract Neck Virtually in Video See-through AR Environment

Sensors (Basel). 2022 May 7;22(9):3559. doi: 10.3390/s22093559.

Abstract

With the popularization of head-mounted displays (HMDs), many systems for human augmentation have been developed. This will increase the opportunities to use such systems in daily life. Therefore, the user interfaces for these systems must be designed to be intuitive and highly responsive. This paper proposes an intuitive input method that uses natural gestures as input cues for systems for human augmentation. We investigated the appropriate gestures for a system that expands the movements of the user's viewpoint by extending and contracting the neck in a video see-through AR environment. We conducted an experiment to investigate natural gestures by observing the motions when a person wants to extend his/her neck. Furthermore, we determined the operation method for extending/contracting the neck and holding the position through additional experiments. Based on this investigation, we implemented a prototype of the proposed system in a VR environment. Note that we employed a VR environment since we could test our method in various situations, although our target environment is AR. We compared the operability of the proposed method and the handheld controller using our prototype. The results confirmed that the participants felt more immersed using our method, although the positioning speed using controller input was faster than that of our method.

Keywords: gesture input; human augmentation; user interface.

MeSH terms

  • Female
  • Gestures*
  • Hand
  • Humans
  • Male
  • Motion
  • Movement
  • Smart Glasses*
  • User-Computer Interface

Grants and funding

This work was supported by JST CREST Grant Number JPMJCR18A3, Japan.