Full-Body Interaction in Mixed Reality using 3D Pose and Shape Estimation

Hong Son Nguyen; Andrew Chalmers; Da Eun Cheong; Myoung Gon Kim; Taehyun Rhee; Jung Hyun Han

doi:10.1109/VRW66409.2025.00299

Full-Body Interaction in Mixed Reality using 3D Pose and Shape Estimation

Hong Son Nguyen^*
, Andrew Chalmers
, Da Eun Cheong
, Myoung Gon Kim
, Taehyun Rhee
, Jung Hyun Han

^*Corresponding author for this work

Department of Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

This paper presents a pipeline that estimates a user's 3D pose and shape to facilitate a user's full-body interaction with virtual objects in a mixed reality environment. The usability and effectiveness of the pipeline are demonstrated through a user study.

Original language	English
Title of host publication	Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1306-1307
Number of pages	2
ISBN (Electronic)	9798331514846
DOIs	https://doi.org/10.1109/VRW66409.2025.00299
Publication status	Published - 2025
Event	2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025 - Saint-Malo, France Duration: 2025 Mar 8 → 2025 Mar 12

Publication series

Name	Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025

Conference

Conference	2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025
Country/Territory	France
City	Saint-Malo
Period	25/3/8 → 25/3/12

Bibliographical note

Publisher Copyright:
© 2025 IEEE.

Keywords

Full-body interaction
Mixed reality
Pose and shape estimation

ASJC Scopus subject areas

Media Technology
Computer Graphics and Computer-Aided Design
Computer Science Applications
Human-Computer Interaction

Access to Document

10.1109/VRW66409.2025.00299

Cite this

Nguyen, H. S., Chalmers, A., Cheong, D. E., Kim, M. G., Rhee, T., & Han, J. H. (2025). Full-Body Interaction in Mixed Reality using 3D Pose and Shape Estimation. In Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025 (pp. 1306-1307). (Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/VRW66409.2025.00299

Full-Body Interaction in Mixed Reality using 3D Pose and Shape Estimation. / Nguyen, Hong Son; Chalmers, Andrew; Cheong, Da Eun et al.
Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025. Institute of Electrical and Electronics Engineers Inc., 2025. p. 1306-1307 (Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Nguyen, HS, Chalmers, A, Cheong, DE, Kim, MG, Rhee, T & Han, JH 2025, Full-Body Interaction in Mixed Reality using 3D Pose and Shape Estimation. in Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025. Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025, Institute of Electrical and Electronics Engineers Inc., pp. 1306-1307, 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025, Saint-Malo, France, 25/3/8. https://doi.org/10.1109/VRW66409.2025.00299

Nguyen HS, Chalmers A, Cheong DE, Kim MG, Rhee T, Han JH. Full-Body Interaction in Mixed Reality using 3D Pose and Shape Estimation. In Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025. Institute of Electrical and Electronics Engineers Inc. 2025. p. 1306-1307. (Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025). doi: 10.1109/VRW66409.2025.00299

Nguyen, Hong Son ; Chalmers, Andrew ; Cheong, Da Eun et al. / Full-Body Interaction in Mixed Reality using 3D Pose and Shape Estimation. Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025. Institute of Electrical and Electronics Engineers Inc., 2025. pp. 1306-1307 (Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025).

@inproceedings{4a9dcdde0a494f96b41339469cd853f1,

title = "Full-Body Interaction in Mixed Reality using 3D Pose and Shape Estimation",

abstract = "This paper presents a pipeline that estimates a user's 3D pose and shape to facilitate a user's full-body interaction with virtual objects in a mixed reality environment. The usability and effectiveness of the pipeline are demonstrated through a user study.",

keywords = "Full-body interaction, Mixed reality, Pose and shape estimation",

author = "Nguyen, \{Hong Son\} and Andrew Chalmers and Cheong, \{Da Eun\} and Kim, \{Myoung Gon\} and Taehyun Rhee and Han, \{Jung Hyun\}",

note = "Publisher Copyright: {\textcopyright} 2025 IEEE.; 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025 ; Conference date: 08-03-2025 Through 12-03-2025",

year = "2025",

doi = "10.1109/VRW66409.2025.00299",

language = "English",

series = "Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1306--1307",

booktitle = "Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025",

}

TY - GEN

T1 - Full-Body Interaction in Mixed Reality using 3D Pose and Shape Estimation

AU - Nguyen, Hong Son

AU - Chalmers, Andrew

AU - Cheong, Da Eun

AU - Kim, Myoung Gon

AU - Rhee, Taehyun

AU - Han, Jung Hyun

PY - 2025

Y1 - 2025

N2 - This paper presents a pipeline that estimates a user's 3D pose and shape to facilitate a user's full-body interaction with virtual objects in a mixed reality environment. The usability and effectiveness of the pipeline are demonstrated through a user study.

AB - This paper presents a pipeline that estimates a user's 3D pose and shape to facilitate a user's full-body interaction with virtual objects in a mixed reality environment. The usability and effectiveness of the pipeline are demonstrated through a user study.

KW - Full-body interaction

KW - Mixed reality

KW - Pose and shape estimation

UR - https://www.scopus.com/pages/publications/105005148435

U2 - 10.1109/VRW66409.2025.00299

DO - 10.1109/VRW66409.2025.00299

M3 - Conference contribution

AN - SCOPUS:105005148435

T3 - Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025

SP - 1306

EP - 1307

BT - Proceedings - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2025

Y2 - 8 March 2025 through 12 March 2025

ER -

Full-Body Interaction in Mixed Reality using 3D Pose and Shape Estimation

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this