-
Impact of geolocation data on augmented reality usability: A comparative user test
Authors:
Julien Mercier,
N. Chabloz,
G. Dozot,
C. Audrin,
O. Ertz,
E. Bocher,
D. Rappo
Abstract:
Abstract. While the use of location-based augmented reality (AR) for education has demonstrated benefits on participants' motivation, engagement, and on their physical activity, geolocation data inaccuracy causes augmented objects to jitter or drift, which is a factor in downgrading user experience. We developed a free and open source web AR application and conducted a comparative user test (n = 5…
▽ More
Abstract. While the use of location-based augmented reality (AR) for education has demonstrated benefits on participants' motivation, engagement, and on their physical activity, geolocation data inaccuracy causes augmented objects to jitter or drift, which is a factor in downgrading user experience. We developed a free and open source web AR application and conducted a comparative user test (n = 54) in order to assess the impact of geolocation data on usability, exploration, and focus. A control group explored biodiversity in nature using the system in combination with embedded GNSS data, and an experimental group used an external module for RTK data. During the test, eye tracking data, geolocated traces, and in-app user-triggered events were recorded. Participants answered usability questionnaires (SUS, UEQ, HARUS).We found that the geolocation data the RTK group was exposed to was less accurate in average than that of the control group. The RTK group reported lower usability scores on all scales, of which 5 out of 9 were significant, indicating that inaccurate data negatively predicts usability. The GNSS group walked more than the RTK group, indicating a partial effect on exploration. We found no significant effect on interaction time with the screen, indicating no specific relation between data accuracy and focus. While RTK data did not allow us to better the usability of location-based AR interfaces, results allow us to assess our system's overall usability as excellent, and to define optimal operating conditions for future use with pupils.
△ Less
Submitted 21 August, 2023;
originally announced August 2023.
-
An Empirical Eye-Tracking Study of Feature Model Comprehension
Authors:
Elmira Rezaei Sepasi,
Kambiz Nezami Balouchi,
Julien Mercier,
Roberto Erick Lopez-Herrejon
Abstract:
Software Product Lines (SPLs) are families of related software systems which are distinguished by the set of features each system provides. Feature Models are the de facto standard for modelling the variability of SPLs because they describe the features, their relations, and all the combinations of features that constitute a SPL. Because of their key role, feature models are at the core of many ta…
▽ More
Software Product Lines (SPLs) are families of related software systems which are distinguished by the set of features each system provides. Feature Models are the de facto standard for modelling the variability of SPLs because they describe the features, their relations, and all the combinations of features that constitute a SPL. Because of their key role, feature models are at the core of many tasks in SPL engineering. Our work presents an empirical study on the comprehension of feature models for the task of checking the validity of configurations. Our study explored the relation between the number of features and the number of cross-tree constraints with the accuracy of participants' answers to validity checking questions, and used eye fixations for analyzing the difficulty in interpreting fixated information and the amount of cognitive processing of the different parts of the feature model stimuli. We found that answer accuracy does not relate individually to the number of features or to the number of cross-tree constrains of a feature model, but both factors do show an interaction on accuracy. Additionally, our study identified differences in feature models with cross-tree constraints in both number of fixations and fixation time, but no differences in those models without cross-tree constraints.
△ Less
Submitted 9 March, 2022;
originally announced March 2022.
-
Deep Template-based Object Instance Detection
Authors:
Jean-Philippe Mercier,
Mathieu Garon,
Philippe Giguère,
Jean-François Lalonde
Abstract:
Much of the focus in the object detection literature has been on the problem of identifying the bounding box of a particular class of object in an image. Yet, in contexts such as robotics and augmented reality, it is often necessary to find a specific object instance---a unique toy or a custom industrial part for example---rather than a generic object class. Here, applications can require a rapid…
▽ More
Much of the focus in the object detection literature has been on the problem of identifying the bounding box of a particular class of object in an image. Yet, in contexts such as robotics and augmented reality, it is often necessary to find a specific object instance---a unique toy or a custom industrial part for example---rather than a generic object class. Here, applications can require a rapid shift from one object instance to another, thus requiring fast turnaround which affords little-to-no training time. What is more, gathering a dataset and training a model for every new object instance to be detected can be an expensive and time-consuming process. In this context, we propose a generic 2D object instance detection approach that uses example viewpoints of the target object at test time to retrieve its 2D location in RGB images, without requiring any additional training (i.e. fine-tuning) step. To this end, we present an end-to-end architecture that extracts global and local information of the object from its viewpoints. The global information is used to tune early filters in the backbone while local viewpoints are correlated with the input image. Our method offers an improvement of almost 30 mAP over the previous template matching methods on the challenging Occluded Linemod dataset (overall mAP of 50.7). Our experiments also show that our single generic model (not trained on any of the test objects) yields detection results that are on par with approaches that are trained specifically on the target objects.
△ Less
Submitted 14 November, 2020; v1 submitted 26 November, 2019;
originally announced November 2019.
-
Learning Object Localization and 6D Pose Estimation from Simulation and Weakly Labeled Real Images
Authors:
Jean-Philippe Mercier,
Chaitanya Mitash,
Philippe Giguère,
Abdeslam Boularias
Abstract:
This work proposes a process for efficiently training a point-wise object detector that enables localizing objects and computing their 6D poses in cluttered and occluded scenes. Accurate pose estimation is typically a requirement for robust robotic grasping and manipulation of objects placed in cluttered, tight environments, such as a shelf with multiple objects. To minimize the human labor requir…
▽ More
This work proposes a process for efficiently training a point-wise object detector that enables localizing objects and computing their 6D poses in cluttered and occluded scenes. Accurate pose estimation is typically a requirement for robust robotic grasping and manipulation of objects placed in cluttered, tight environments, such as a shelf with multiple objects. To minimize the human labor required for annotation, the proposed object detector is first trained in simulation by using automatically annotated synthetic images. We then show that the performance of the detector can be substantially improved by using a small set of weakly annotated real images, where a human provides only a list of objects present in each image without indicating the location of the objects. To close the gap between real and synthetic images, we adopt a domain adaptation approach through adversarial training. The detector resulting from this training process can be used to localize objects by using its per-object activation maps. In this work, we use the activation maps to guide the search of 6D poses of objects. Our proposed approach is evaluated on several publicly available datasets for pose estimation. We also evaluated our model on classification and localization in unsupervised and semi-supervised settings. The results clearly indicate that this approach could provide an efficient way toward fully automating the training process of computer vision models used in robotics.
△ Less
Submitted 20 February, 2019; v1 submitted 18 June, 2018;
originally announced June 2018.
