CueVideo: A system for cross-modal search and browse of video databases

Abstract

The detection and recognition of events is a challenging problem in video databases. It involves crosslinking and combining information available in multiple modalities such as audio, video and associated text metadata. CueVideo is a system designed for the discovery and recognition of specific events called topics of discussion through advanced video summarization and cross-modal indexing. It supports search for relevant video content through several modes of video summarization including storyboards, moving storyboards and time-scale modified audio summarization. It also enables the recognition and indexing of topical events through cross-modal search of audio and video content based on text and image queries respectively.