Video scene change detection using neural network: Improved ART2

A common video indexing technique is to segment a video sequence into shots and then select representative key-frames. This paper proposes a new method using an improved ART2 neural network for scene change detection. The proposed algorithm extracts DC-sequence from a video and then makes a gray variance sequence for detecting smooth intervals. During that procedure, a local minimum sequence occurring at typical gradual changes is extracted and eliminated from the smooth intervals by our local minimum detection algorithm. Then, a new sequence is constructed by concatenating obtained smooth intervals. Feature elements such as pixel-wise difference, histogram difference, and correlation coefficients are extracted from the new sequence. These three elements, plus one extra element reducing the distortion of the ART2 neural network, are presented as an input vector to the ART2 neural network that has two output units in the F2 layer. Frames at the ends of each smooth interval are assigned to the second cluster that represents key-frames. Experimental results showed that the proposed algorithm using the extra element was better than the method without it in terms of precision and recall rates. Also, it produced better results than Patel's method (Patel and Sethi, 1996) and the twin comparison method (Zhang et al., 1993).