An analysis of the effectiveness of temporal mapping and speech recognition for content-based multimedia indexing

Citation

(2006) An analysis of the effectiveness of temporal mapping and speech recognition for content-based multimedia indexing. 2006 First International Workshop on Semantic Media Adaptation and Personalization (SMAP'06), Athens, Greece, 04.12.2006-05.12.2006. IEEE. https://doi.org/10.1109/smap.2006.9

Abstract
We present an extensive analytical evaluation of the effectiveness of a multimedia (text and speech) meeting browser which employs a combination of automatic speech recognition and a novel content indexing technique called temporal mapping in order to uncover contextual relations between audio and text segments in recorded remote meetings. Results show that even simple temporal mapping can effectively support browsing and retrieval of recorded audio segments and improve retrieval performance in situations where speech recognition would on its own have exhibited prohibitively high word error rates.

Keywords
Speech analysis; Multimedia Indexing; Automatic speech recognition; Multimedia Information retrieval; Multimodal Interaction; Meeting Browsing; Computer-Supported Collaborative Work (CSCW), HCI