TY - GEN
T1 - User modeling by using bag-of-behaviors for building a dialog system sensitive to the interlocutor's internal state
AU - Chiba, Yuya
AU - Nose, Takashi
AU - Ito, Akinori
AU - Ito, Masashi
N1 - Publisher Copyright:
© 2014 Association for Computational Linguistics.
PY - 2014
Y1 - 2014
N2 - When using spoken dialog systems in actual environments, users sometimes abandon the dialog without making any input utterance. To help these users before they give up, the system should know why they could not make an utterance. Thus, we have examined a method to estimate the state of a dialog user by capturing the user's non-verbal behavior even when the user's utterance is not observed. The proposed method is based on vector quantization of multi-modal features such as non-verbal speech, feature points of the face, and gaze. The histogram of the VQ code is used as a feature for determining the state. We call this feature "the Bagof-Behaviors." According to the experimental results, we prove that the proposed method surpassed the results of conventional approaches and discriminated the target user's states with an accuracy of more than 70%.
AB - When using spoken dialog systems in actual environments, users sometimes abandon the dialog without making any input utterance. To help these users before they give up, the system should know why they could not make an utterance. Thus, we have examined a method to estimate the state of a dialog user by capturing the user's non-verbal behavior even when the user's utterance is not observed. The proposed method is based on vector quantization of multi-modal features such as non-verbal speech, feature points of the face, and gaze. The histogram of the VQ code is used as a feature for determining the state. We call this feature "the Bagof-Behaviors." According to the experimental results, we prove that the proposed method surpassed the results of conventional approaches and discriminated the target user's states with an accuracy of more than 70%.
UR - http://www.scopus.com/inward/record.url?scp=84987940270&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84987940270&partnerID=8YFLogxK
U2 - 10.3115/v1/w14-4310
DO - 10.3115/v1/w14-4310
M3 - Conference contribution
AN - SCOPUS:84987940270
T3 - SIGDIAL 2014 - 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference
SP - 74
EP - 78
BT - SIGDIAL 2014 - 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference
PB - Association for Computational Linguistics (ACL)
T2 - 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL 2014
Y2 - 18 June 2014 through 20 June 2014
ER -