User Experience of Multi-Mode and Multitasked Extended Reality on Different Mobile Interaction Platforms

Hyeonah Choi, Heeyoon Jeong, Gerard Jounghyun Kim

Research output: Contribution to journalArticlepeer-review


“Extended Reality (XR)” refers to a unified platform or content that supports all forms of “reality”—e.g., 2D, 3D virtual, augmented, and augmented virtual. We explore how the mobile device can support such a concept of XR. We evaluate the XR user experiences of multi-mode and multitasking among three mobile platforms—(1) bare smartphone (PhoneXR), (2) standalone mobile headset unit (ClosedXR), and (3) smartphone with clip-on lenses (LensXR). Two use cases were considered through: (a) Experiment 1: using and switching among different modes within a single XR application while multitasking with a smartphone app, and (b) Experiment 2: general multitasking among different “reality” applications (e.g., 2D app, AR, VR). Results showed users generally valued the immersive experience over usability—ClosedXR was clearly preferred over the others. Despite potentially offering a balanced level of immersion and usability with its touch-based interaction, LensXR was not generally received well. PhoneXR was not rated particularly advantageous over ClosedXR even if it needed the controller. The usability suffered for ClosedXR only when the long text had to be entered. Thus, improving the 1D/2D operations in ClosedXR for operating and multitasking would be one way to weave XR into our lives with smartphones.

Original languageEnglish
Article number1457
JournalElectronics (Switzerland)
Issue number6
Publication statusPublished - 2023 Mar

Bibliographical note

Funding Information:
This research was supported by the ITRC Program (IITP-2022-RS-2022-00156354) funded by MSIT/IITP Korea, the Competency Development Program for Industry Specialist funded by MSIT/IITP/MOTIE/KIAT Korea (N0009999), and the Basic Research Laboratory Program funded by NRF Korea (2022R1A4A1018869).

Publisher Copyright:
© 2023 by the authors.


  • extended reality
  • multi-mode
  • multi-tasking
  • user experience

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Signal Processing
  • Hardware and Architecture
  • Computer Networks and Communications
  • Electrical and Electronic Engineering


Dive into the research topics of 'User Experience of Multi-Mode and Multitasked Extended Reality on Different Mobile Interaction Platforms'. Together they form a unique fingerprint.

Cite this