History-based visual mining of semi-structured audio and text

Citation

(2006) History-based visual mining of semi-structured audio and text. 2006 12th International Multi-Media Modelling Conference, Beijing, China, 04.01.2006-06.01.2006. IEEE. https://doi.org/10.1109/mmmc.2006.1651349

Abstract
Accessing specific or salient parts of multimedia recordings remains a challenge as there is no obvious way of structuring and representing a mix of space-based and time-based media. A number of approaches have been proposed which usually involve translating the continuous component of the multimedia recording into a space-based representation, such as text from audio through automatic speech recognition and images from video (keyframes). In this paper, we present a novel technique which defines retrieval units in terms of a log of actions performed on space-based artifacts, and exploits timing properties and extended concurrency to construct a visual presentation of text and speech data. This technique can be easily adapted to any mix of space-based artifacts and continuous media

Keywords
Computer-Supported Collaborative Work (CSCW); Human Computer Interaction (HCI); Multimedia Informatioin Retrieval; Multimodal Interaction