TY - JOUR
T1 - Analyzing effect of physical expression on English proficiency for multimodal computer-assisted language learning
AU - Wu, Haoran
AU - Chiba, Yuya
AU - Nose, Takashi
AU - Ito, Akinori
N1 - Funding Information:
This work was supported by JSPS KAKENHI Grant Numbers JP15H02720 and JP17H00823.
Publisher Copyright:
© 2018 International Speech Communication Association. All rights reserved.
PY - 2018
Y1 - 2018
N2 - English proficiency is important for communication in English. Computer-Assisted Language Learning (CALL) systems are introduced to provide a convenient and low-cost language learning environment. Most of the conventional speech-based CALL systems concentrate on developing verbal fluency of the learners. However, actual English communication involves not only verbal expressions but also facial expressions and gestures, which could affect the perceived proficiency. The objective of our research is to develop a CALL system that can evaluate fluency of physical expressions as well as the verbal fluency of English. However, it is not clear how physical expressions affect the overall proficiency of English. Therefore, this study investigates the relationship between the proficiency of English and the fluency of the physical expression by analyzing the dialog data of the multimodal CALL system.
AB - English proficiency is important for communication in English. Computer-Assisted Language Learning (CALL) systems are introduced to provide a convenient and low-cost language learning environment. Most of the conventional speech-based CALL systems concentrate on developing verbal fluency of the learners. However, actual English communication involves not only verbal expressions but also facial expressions and gestures, which could affect the perceived proficiency. The objective of our research is to develop a CALL system that can evaluate fluency of physical expressions as well as the verbal fluency of English. However, it is not clear how physical expressions affect the overall proficiency of English. Therefore, this study investigates the relationship between the proficiency of English and the fluency of the physical expression by analyzing the dialog data of the multimodal CALL system.
KW - Computer-Assisted Language Leaning (CALL)
KW - Multimodal interaction
KW - Para-linguistic information
KW - Physical expressions
UR - http://www.scopus.com/inward/record.url?scp=85055006871&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85055006871&partnerID=8YFLogxK
U2 - 10.21437/Interspeech.2018-1425
DO - 10.21437/Interspeech.2018-1425
M3 - Conference article
AN - SCOPUS:85055006871
SN - 1990-9772
VL - 2018-September
SP - 1746
EP - 1750
JO - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
JF - Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH
T2 - 19th Annual Conference of the International Speech Communication, INTERSPEECH 2018
Y2 - 2 September 2018 through 6 September 2018
ER -