OCNav: Object-centric Navigation via Parallel Language Grounding on Semantic Topological Graphs

  • Jeong Seop Park
  • , Yong Jun Lee
  • , Jong Chan Park
  • , Sung Gil Park
  • , Woo Jin Ahn
  • , Jong Jin Woo*
  • , Myo Taeg Lim*
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

This paper presents OCNav, an object-centric semantic navigation framework for mobile robots within vision-and-language navigation (VLN). With the advancement of large language models (LLMs), human–robot interaction has emerged as a crucial aspect of autonomous navigation in real-world environments. In particular, object semantics and spatial relations are essential for mobile robots to interpret and operate within home settings. Therefore, we propose a novel semantic topological graph that integrates semantic and spatial information into topological nodes as textual descriptors. Each node additionally encodes a static level that reflects the positional permanence of objects to enhance the robustness of spatial semantic representation. Given a user instruction in natural language, the mobile robot interprets the command based on the semantic attributes encoded in the graph. Then, the target location is selected based on the highest confidence score, which combines cosine similarity of sentence-BERT (sBERT) embeddings with a static-aware prior. At inference, OCNav aligns instructions with textual node descriptors in a text-only pipeline, enabling strong generalization to novel environments without task-specific fine tuning.

Original languageEnglish
Pages (from-to)3536-3546
Number of pages11
JournalInternational Journal of Control, Automation and Systems
Volume23
Issue number12
DOIs
Publication statusPublished - 2025 Dec

Bibliographical note

Publisher Copyright:
© ICROS, KIEE and Springer 2025.

Keywords

  • Large language model
  • object-centric mapping
  • parallel language grounding
  • semantic topological graph
  • static-aware planning
  • vision-and-language navigation

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'OCNav: Object-centric Navigation via Parallel Language Grounding on Semantic Topological Graphs'. Together they form a unique fingerprint.

Cite this