Detection of singing mistakes from singing voice

Isao Miyagawa; Yuya Chiba; Takashi Nose; Akinori Ito

doi:10.1007/978-3-319-63859-1_17

Detection of singing mistakes from singing voice

Isao Miyagawa, Yuya Chiba, Takashi Nose, Akinori Ito

ENG - Communications Engineering

Tohoku University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

We investigate a method of detecting the wrong lyrics from the singing voice. In the proposed method, we compare the input singing voice and the reference singing voice using dynamic time warping, and then observe the frame-by-frame distance to find the error location. However, the absolute value of the distance is affected by the singer individuality of the reference and input singing voice. Thus, we attempted to adapt the singer individuality into the reference singer’s one by a linear transformation. The results of the experiment showed that we could detect the wrong lyrics with high accuracy when the different part of the lyrics was long. In addition, we investigated the effect of iterative linear transformation, and we could not find any benefit from the second or third linear transformations.

Original language	English
Title of host publication	Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceedings of the 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing,
Editors	Junzo Watada, Lakhmi C. Jain, Jeng-Shyang Pan, Pei-Wei Tsai
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	130-136
Number of pages	7
ISBN (Print)	9783319638584
DOIs	https://doi.org/10.1007/978-3-319-63859-1_17
Publication status	Published - 2018
Event	13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2017 - Matsue, Shimane, Japan Duration: 2017 Aug 12 → 2017 Aug 15

Publication series

Name	Smart Innovation, Systems and Technologies
Volume	82
ISSN (Print)	2190-3018
ISSN (Electronic)	2190-3026

Conference

Conference	13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2017
Country/Territory	Japan
City	Matsue, Shimane
Period	17/8/12 → 17/8/15

Keywords

Dynamic time warping
Lyrics mistake
Singing voice

Access to Document

10.1007/978-3-319-63859-1_17

Cite this

Miyagawa, I., Chiba, Y., Nose, T., & Ito, A. (2018). Detection of singing mistakes from singing voice. In J. Watada, L. C. Jain, J-S. Pan, & P-W. Tsai (Eds.), Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceedings of the 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, (pp. 130-136). (Smart Innovation, Systems and Technologies; Vol. 82). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-319-63859-1_17

Miyagawa, Isao ; Chiba, Yuya ; Nose, Takashi et al. / Detection of singing mistakes from singing voice. Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceedings of the 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing,. editor / Junzo Watada ; Lakhmi C. Jain ; Jeng-Shyang Pan ; Pei-Wei Tsai. Springer Science and Business Media Deutschland GmbH, 2018. pp. 130-136 (Smart Innovation, Systems and Technologies).

@inproceedings{2cbb1e9eab92415bb711fd88bb6b24d1,

title = "Detection of singing mistakes from singing voice",

abstract = "We investigate a method of detecting the wrong lyrics from the singing voice. In the proposed method, we compare the input singing voice and the reference singing voice using dynamic time warping, and then observe the frame-by-frame distance to find the error location. However, the absolute value of the distance is affected by the singer individuality of the reference and input singing voice. Thus, we attempted to adapt the singer individuality into the reference singer{\textquoteright}s one by a linear transformation. The results of the experiment showed that we could detect the wrong lyrics with high accuracy when the different part of the lyrics was long. In addition, we investigated the effect of iterative linear transformation, and we could not find any benefit from the second or third linear transformations.",

keywords = "Dynamic time warping, Lyrics mistake, Singing voice",

author = "Isao Miyagawa and Yuya Chiba and Takashi Nose and Akinori Ito",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing AG 2018.; 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2017 ; Conference date: 12-08-2017 Through 15-08-2017",

year = "2018",

doi = "10.1007/978-3-319-63859-1_17",

language = "English",

isbn = "9783319638584",

series = "Smart Innovation, Systems and Technologies",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "130--136",

editor = "Junzo Watada and Jain, {Lakhmi C.} and Jeng-Shyang Pan and Pei-Wei Tsai",

booktitle = "Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceedings of the 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing,",

address = "Germany",

}

Miyagawa, I, Chiba, Y, Nose, T & Ito, A 2018, Detection of singing mistakes from singing voice. in J Watada, LC Jain, J-S Pan & P-W Tsai (eds), Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceedings of the 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing,. Smart Innovation, Systems and Technologies, vol. 82, Springer Science and Business Media Deutschland GmbH, pp. 130-136, 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2017, Matsue, Shimane, Japan, 17/8/12. https://doi.org/10.1007/978-3-319-63859-1_17

Detection of singing mistakes from singing voice. / Miyagawa, Isao; Chiba, Yuya; Nose, Takashi et al.
Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceedings of the 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing,. ed. / Junzo Watada; Lakhmi C. Jain; Jeng-Shyang Pan; Pei-Wei Tsai. Springer Science and Business Media Deutschland GmbH, 2018. p. 130-136 (Smart Innovation, Systems and Technologies; Vol. 82).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Detection of singing mistakes from singing voice

AU - Miyagawa, Isao

AU - Chiba, Yuya

AU - Nose, Takashi

AU - Ito, Akinori

N1 - Publisher Copyright: © Springer International Publishing AG 2018.

PY - 2018

Y1 - 2018

N2 - We investigate a method of detecting the wrong lyrics from the singing voice. In the proposed method, we compare the input singing voice and the reference singing voice using dynamic time warping, and then observe the frame-by-frame distance to find the error location. However, the absolute value of the distance is affected by the singer individuality of the reference and input singing voice. Thus, we attempted to adapt the singer individuality into the reference singer’s one by a linear transformation. The results of the experiment showed that we could detect the wrong lyrics with high accuracy when the different part of the lyrics was long. In addition, we investigated the effect of iterative linear transformation, and we could not find any benefit from the second or third linear transformations.

AB - We investigate a method of detecting the wrong lyrics from the singing voice. In the proposed method, we compare the input singing voice and the reference singing voice using dynamic time warping, and then observe the frame-by-frame distance to find the error location. However, the absolute value of the distance is affected by the singer individuality of the reference and input singing voice. Thus, we attempted to adapt the singer individuality into the reference singer’s one by a linear transformation. The results of the experiment showed that we could detect the wrong lyrics with high accuracy when the different part of the lyrics was long. In addition, we investigated the effect of iterative linear transformation, and we could not find any benefit from the second or third linear transformations.

KW - Dynamic time warping

KW - Lyrics mistake

KW - Singing voice

UR - http://www.scopus.com/inward/record.url?scp=85026642663&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85026642663&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-63859-1_17

DO - 10.1007/978-3-319-63859-1_17

M3 - Conference contribution

AN - SCOPUS:85026642663

SN - 9783319638584

T3 - Smart Innovation, Systems and Technologies

SP - 130

EP - 136

BT - Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceedings of the 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing,

A2 - Watada, Junzo

A2 - Jain, Lakhmi C.

A2 - Pan, Jeng-Shyang

A2 - Tsai, Pei-Wei

PB - Springer Science and Business Media Deutschland GmbH

T2 - 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2017

Y2 - 12 August 2017 through 15 August 2017

ER -

Miyagawa I, Chiba Y, Nose T , Ito A. Detection of singing mistakes from singing voice. In Watada J, Jain LC, Pan J-S, Tsai P-W, editors, Advances in Intelligent Information Hiding and Multimedia Signal Processing - Proceedings of the 13th International Conference on Intelligent Information Hiding and Multimedia Signal Processing,. Springer Science and Business Media Deutschland GmbH. 2018. p. 130-136. (Smart Innovation, Systems and Technologies). doi: 10.1007/978-3-319-63859-1_17

Detection of singing mistakes from singing voice

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this