Dissimilate-and-assimilate strategy for video anomaly detection and localization

Wooyeol Hyun, Woo Jeoung Nam, Seong Whan Lee

Research output: Contribution to journalArticlepeer-review

5 Citations (Scopus)


Unsupervised anomaly detection in videos is a challenging task owing to the remarkable generalization capacity of the deep convolutional autoencoders and the complex nature of anomalous events. In this study, we introduce a dissimilate-and-assimilate strategy to learn essential patterns of multilevel latent representations of normal spatial and temporal information. To obtain the core normality of the appearance and motion samples over multiple layers of the network, our proposed method diversifies the latent patterns of normal spatial and temporal data to make the out-of-distribution samples discrete (dissimilation) and integrates the latent features of two different samples into a single sample using a feature attention mechanism for robust optimization (assimilation). Based on the learned representations, the network generates convincing predictions of the normal frame, even if it receives abnormal samples after training. That is, the anomalous objects in a series of frames can be detected with significant reconstruction errors, thus leading to better detection and precise localization performance. To verify the effectiveness of the proposed method, we quantify the preciseness of anomaly localization using the outside-inside error ratio along with the traditional area under the curve (AUC) metric to measure the detection performance on the USCD Pedestrian 2, CHUK Avenue and ShanghaiTech Campus datasets.

Original languageEnglish
Pages (from-to)203-213
Number of pages11
Publication statusPublished - 2023 Feb 14

Bibliographical note

Funding Information:
This work was conducted by Center for Applied Research in Artificial Intelligence (CARAI) grant funded by Defense Acquisition Program Administration (DAPA) and Agency for Defense Development (ADD). (UD190031RD)

Publisher Copyright:
© 2022 Elsevier B.V.


  • Out-of-distribution detection
  • Unsupervised learning
  • Video anomaly detection

ASJC Scopus subject areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence


Dive into the research topics of 'Dissimilate-and-assimilate strategy for video anomaly detection and localization'. Together they form a unique fingerprint.

Cite this