TY - GEN
T1 - Document expansion using relevant web documents for spoken document retrieval
AU - Masumura, Ryo
AU - Ito, Akinori
AU - Uno, Yu
AU - Ito, Masashi
AU - Makino, Shozo
PY - 2010
Y1 - 2010
N2 - Recently, automatic indexing of a spoken document using a speech recognizer attracts attention. However, index generation from an automatic transcription has many problems because the automatic transcription has many recognition errors and Out-Of-Vocabulary words. To solve this problem, we propose a document expansion method using Web documents. To obtain important keywords which included in the spoken document but lost by recognition errors, we acquire Web documents relevant to the spoken document. Then, an index of the spoken document is generated by combining an index that generated from the automatic transcription and the Web documents. We propose a method for retrieval of relevant documents, and the experimental result shows that the retrieved Web document contained many OOV words. Next, we propose a method for combining the recognized index and the Web index. The experimental result shows that the index of the spoken document generated by the document expansion was closer to an index from the manual transcription than the index generated by the conventional method. Finally, we conducted a spoken document retrieval experiment, and the document-expansion-based index gave better retrieval precision than the conventional indexing method.
AB - Recently, automatic indexing of a spoken document using a speech recognizer attracts attention. However, index generation from an automatic transcription has many problems because the automatic transcription has many recognition errors and Out-Of-Vocabulary words. To solve this problem, we propose a document expansion method using Web documents. To obtain important keywords which included in the spoken document but lost by recognition errors, we acquire Web documents relevant to the spoken document. Then, an index of the spoken document is generated by combining an index that generated from the automatic transcription and the Web documents. We propose a method for retrieval of relevant documents, and the experimental result shows that the retrieved Web document contained many OOV words. Next, we propose a method for combining the recognized index and the Web index. The experimental result shows that the index of the spoken document generated by the document expansion was closer to an index from the manual transcription than the index generated by the conventional method. Finally, we conducted a spoken document retrieval experiment, and the document-expansion-based index gave better retrieval precision than the conventional indexing method.
UR - http://www.scopus.com/inward/record.url?scp=78649270786&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=78649270786&partnerID=8YFLogxK
U2 - 10.1109/NLPKE.2010.5587854
DO - 10.1109/NLPKE.2010.5587854
M3 - Conference contribution
AN - SCOPUS:78649270786
SN - 9781424468966
T3 - Proceedings of the 6th International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE 2010
BT - Proceedings of the 6th International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE, 2010
T2 - 6th International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE 2010
Y2 - 21 August 2010 through 23 August 2010
ER -