Touchless user interface based on marker detection and tracking for real-time mobile applications

Il Lyong Jung, Nikolay Akatyev, Won Dong Jang, Leonardo Juniti Nomoto, Chang-Su Kim

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)


A touchless user interaction system based on marker detection and tracking is proposed for real-time mobile applications. The proposed algorithm can robustly estimate users' control information with a camera on a mobile device, which often has limited hardware resources and is influenced by varying environmental conditions. First, we detect a pre-registered marker based on the normalized correlation coefficient. Then, we track the marker motion by employing the contrast invariant mean-shift algorithm. More specifically, the proposed contrast invariant mean-shift algorithm transforms a candidate frame in order to match its histogram into the histogram of the target frame. It then tracks feature points by performing the mean-shift on both original and transformed candidate frames adaptively. To evaluate the performance of the proposed interaction system, we implement 'Painting', 'Camera' and 'Virtual Keypad' applications. Experimental results demonstrate that the proposed algorithm provides better interaction performance than the conventional method, while demanding lower computational complexity and thus supporting real-time user interaction.

Original languageEnglish
Pages (from-to)851-864
Number of pages14
JournalInternational Journal of Innovative Computing, Information and Control
Issue number2
Publication statusPublished - 2013


  • Contrast invariant tracking
  • Mobile user interface
  • Pattern analysis
  • Touchless user interface
  • User interaction

ASJC Scopus subject areas

  • Software
  • Theoretical Computer Science
  • Information Systems
  • Computational Theory and Mathematics


Dive into the research topics of 'Touchless user interface based on marker detection and tracking for real-time mobile applications'. Together they form a unique fingerprint.

Cite this