Music information retrieval from a singing voice using lyrics and melody information

Motoyuki Suzuki, Toru Hosoya, Akinori Ito

Research output: Contribution to journalArticlepeer-review

24 Citations (Scopus)


Recently, several music information retrieval (MIR) systems which retrieve musical pieces by the user's singing voice have been developed. All of these systems use only melody information for retrieval, although lyrics information is also useful for retrieval. In this paper, we propose a new MIR system that uses both lyrics and melody information. First, we propose a new lyrics recognition method. A finite state automaton (FSA) is used as recognition grammar, and about 86% retrieval accuracy was obtained. We also develop an algorithm for verifying a hypothesis output by a lyrics recognizer. Melody information is extracted from an input song using several pieces of information of the hypothesis, and a total score is calculated from the recognition score and the verification score. From the experimental results, 95.0% retrieval accuracy was obtained with a query consisting of five words.

Original languageEnglish
Article number38727
JournalEurasip Journal on Advances in Signal Processing
Publication statusPublished - 2007


Dive into the research topics of 'Music information retrieval from a singing voice using lyrics and melody information'. Together they form a unique fingerprint.

Cite this