Agrandissement d'un écran mobile par réalité augmentée

Abstract

Significant and recent progress in research and in industry destined augmented reality to deeply integrate both in our personal and professional life. We propose using augmented reality to extend the screen of a smartphone beyond its physical limits with a virtual surface that is co-planar with the phone and that follows as the phone is moved. This creates the feeling of interaction with a unique big handheld screen. We call this extension a VESAD, or Virtually Extended Screen-Aligned Display. We illustrate first several ways that a VESAD could be used with two different viewing modes : multi-windowed view, to support multi-task, and extended view where an application uses the whole extended screen. We also present two novel interaction techniques : wrist, where the user performs a quick rotation of the phone to switch the information shown in the VESAD, and slide-and-hang whereby the user can detach a VESAD and leave it hanging in mid-air. We then describe our video-based augmented reality headmounted display we developed with a large field of view (100°×98° for each eye) and our free and open-source (FOSS) augmented reality library ArucoUnity. It ports the camera calibration and fiducial marker tracking functions from the FOSS computer-vision library OpenCV to the 3D engine Unity. We conducted an experiment that compared three interfaces used for an abstract classification task : the first using only a smartphone, the second using the phone for input but with a VESAD for output, and the third where the user performed input in mid-air on the VESAD (as detected by a Leap Motion). The second user interface was found to be superior in task completion time, furthermore with the last trials of the participants. It was also the most performant for navigation and was subjectively preferred over the other two interfaces. We finally report implementation, interfaces and interactions guidelines to create a VESAD.

Date	30 Aug 2018
Original language	French
Awarding Institution	École de technologie supérieure
Supervisor	Michael John McGuffin (Supervisor)