Reinforcement Learning for Time Series Data with Partially Labeled Anomalies

Kio Yun, Jun Geol Baek

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In recent manufacturing processes, the escalation of sensors usage has led to the continuous collection of large volumes of data. This trends present the challenge of extracting significant patterns and rapidly identifying anomalies within this extensive time-series data. A major obstacle in this area is the scarcity of labeled data for anomaly detection, which limits the effective training of machine learning models. Existing research has mainly concentrated on utilizing the limited anomaly data with supervised learning or investigating unsupervised learning method. This study employs deep reinforcement learning to simultaneously utilize both the abundant unlabeled data and the minimal labeled data for anomaly detection. This paper aims to learn established anomaly patterns and actively explore potential anomalies in unlabeled data, thereby covering both known and undiscovered anomaly patterns. Experiments on multivariate time-series datasets have shown proposed method to outperform existing models in similar situations. The findings of this research are expected to significantly advance effective anomaly detection in manufacturing environments, particularly in contexts where labeled anomaly data is limited.

Original languageEnglish
Title of host publication6th International Conference on Artificial Intelligence in Information and Communication, ICAIIC 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages343-347
Number of pages5
ISBN (Electronic)9798350344349
DOIs
Publication statusPublished - 2024
Event6th International Conference on Artificial Intelligence in Information and Communication, ICAIIC 2024 - Osaka, Japan
Duration: 2024 Feb 192024 Feb 22

Publication series

Name6th International Conference on Artificial Intelligence in Information and Communication, ICAIIC 2024

Conference

Conference6th International Conference on Artificial Intelligence in Information and Communication, ICAIIC 2024
Country/TerritoryJapan
CityOsaka
Period24/2/1924/2/22

Bibliographical note

Publisher Copyright:
© 2024 IEEE.

Keywords

  • Anomaly Detection
  • Deep Learning
  • Reinforcement Learning
  • Semi-supervised learning settings
  • Time Series

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Information Systems
  • Safety, Risk, Reliability and Quality
  • Health Informatics

Fingerprint

Dive into the research topics of 'Reinforcement Learning for Time Series Data with Partially Labeled Anomalies'. Together they form a unique fingerprint.

Cite this