Twofold video hashing with automatic synchronization

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    2 Scopus citations

    Abstract

    Video hashing finds a wide array of applications in content authentication, robust retrieval and anti-piracy search. While much of the existing research has focused on extracting robust and secure content descriptors, a significant open challenge still remains: Most existing video hashing methods are fallible to temporal desynchronization. That is, when the query video results by deleting or inserting some frames from the reference video, most existing methods assume the positions of the deleted (or inserted) frames are either perfectly known or reliably estimated. This assumption may be okay under typical transcoding and frame-rate changes but is highly inappropriate in adversarial scenarios such as anti-piracy video search. For example, an illegal uploader will try to bypass the 'piracy check' mechanism of YouTube/Dailymotion etc by performing a cleverly designed non-uniform resampling of the video. We present a new solution based on dynamic time warping (DTW), which can implement automatic synchronization and can be used together with existing video hashing methods. The second contribution of this paper is to propose a new robust feature extraction method called flow hashing (FH), based on frame averaging and optical flow descriptors. Finally, a fusion mechanism called distance boosting is proposed to combine the information extracted by DTW and FH. Experiments on real video collections show that such a hash extraction and comparison enables unprecedented robustness under both spatial and temporal attacks.

    Original languageEnglish (US)
    Title of host publication2014 IEEE International Conference on Image Processing, ICIP 2014
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages5362-5366
    Number of pages5
    ISBN (Electronic)9781479957514
    DOIs
    StatePublished - Jan 28 2014

    Publication series

    Name2014 IEEE International Conference on Image Processing, ICIP 2014

    All Science Journal Classification (ASJC) codes

    • Computer Vision and Pattern Recognition

    Fingerprint Dive into the research topics of 'Twofold video hashing with automatic synchronization'. Together they form a unique fingerprint.

    Cite this