The Algorithm of Scenario Summary Synthesis Based on Semantics

Yaling Zhu, Xiangwei Li, Jundi Wang

Abstract


The MPEG video data contains three types of frames, which are I frame, P frame and B frame. However, the I frame records the main information of video data, and the P frame and B frame are just as motion compensation of the I frame. The paper presents the method that analyzes the MPEG video stream in the compressed domain, and then according to the key technique of semantic-based video retrieval the paper presents directly extracting I-frames in the compressed domain, and using the DC coefficient of I frame to establish the model of information system. Then reduce I Frame by the theory of attribute reduction based on RS, and produce a key frame that reflects the main content of the shots. Finally, the key frame’s DC coefficient has constructed the mathematical modeling, and has classified the shot according to the differences of frames. So by the polymerization of I frames of similar shots, we could obtain the scenario summary. Experiment indicated that this method can be realized in the compressed MPEG video automatically, and can lay the foundation for the video processing in the future.

Keywords


MPEG; key frame; DCT; scene summary


DOI
10.12783/dtssehs/sshe2018/26451

Full Text:

PDF