TY - GEN
T1 - Modeling user's state during dialog turn using HMM for multi-modal spoken dialog system
AU - Chiba, Yuya
AU - Ito, Akinori
AU - Ito, Masashi
N1 - Publisher Copyright:
Copyright © IARIA, 2014.
PY - 2014
Y1 - 2014
N2 - Conventional spoken dialog systems cannot estimate the user's state while waiting for an input from the user because the estimation process is triggered by observing the user's utterance. This is a problem when, for some reason, the user cannot make an input utterance in response to the system's prompt. To help these users before they give up, the system should handle the requests expressed by them unconsciously. Based on this assumption, we have examined a method to estimate the state of a user before making an utterance by using the non-verbal behavior of the user. The present paper proposes an automatic discrimination method by using time sequential non-verbal information of the user. In this method, the user's internal state is estimated using multi-modal information such as speech, facial expression and gaze, modeled using a Hidden Markov Model (HMM).
AB - Conventional spoken dialog systems cannot estimate the user's state while waiting for an input from the user because the estimation process is triggered by observing the user's utterance. This is a problem when, for some reason, the user cannot make an input utterance in response to the system's prompt. To help these users before they give up, the system should handle the requests expressed by them unconsciously. Based on this assumption, we have examined a method to estimate the state of a user before making an utterance by using the non-verbal behavior of the user. The present paper proposes an automatic discrimination method by using time sequential non-verbal information of the user. In this method, the user's internal state is estimated using multi-modal information such as speech, facial expression and gaze, modeled using a Hidden Markov Model (HMM).
KW - Multi-modal information processing
KW - Spoken dialog system
KW - User's state
UR - http://www.scopus.com/inward/record.url?scp=84966671929&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84966671929&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:84966671929
T3 - ACHI 2014 - 7th International Conference on Advances in Computer-Human Interactions
SP - 343
EP - 346
BT - ACHI 2014 - 7th International Conference on Advances in Computer-Human Interactions
A2 - Miller, Leslie
A2 - Culen, Alma Leora
PB - International Academy, Research and Industry Association, IARIA
T2 - 7th International Conference on Advances in Computer-Human Interactions, ACHI 2014
Y2 - 23 March 2014 through 27 March 2014
ER -