Content-based video analysis for knowledge discovery

With the rapid growth of multimedia information, video content analysis becomes crucial when dealing with large amounts of multimedia data, including texts, images, audio, video, and graphics. Video content analysis can be used to facilitate the access to desired content for information retrieval, summarization, and knowledge discovery. The study and development of suitable and effective techniques for video content management and access has been conducted extensively over the last decade. In this chapter, we will first review the characteristics of visual and audio contents and their basic processing techniques. Then, we will discuss semantic approaches to video data understanding and provide an overview of major developments in this field. In particular, we emphasize video knowledge discovery using features of multiple modalities, enhancing collaboration among semantic cues from various kinds of information sources.