TY - GEN
T1 - Multimodal logical inference system for visual-textual entailment
AU - Suzuki, Riko
AU - Yanaka, Hitomi
AU - Yoshikawa, Masashi
AU - Mineshima, Koji
AU - Bekki, Daisuke
N1 - Funding Information:
We thank the two anonymous reviewers for their encouragement and insightful comments. This work was partially supported by JST CREST Grant Number JPMJCR1301, Japan.
Funding Information:
This work was partially supported by JST CREST Grant Number JPMJCR1301, Japan.
Publisher Copyright:
© 2019 Association for Computational Linguistics.
PY - 2019
Y1 - 2019
N2 - A large amount of research about multimodal inference across text and vision has been recently developed to obtain visually grounded word and sentence representations. In this paper, we use logic-based representations as unified meaning representations for texts and images and present an unsupervised multimodal logical inference system that can effectively prove entailment relations between them. We show that by combining semantic parsing and theorem proving, the system can handle semantically complex sentences for visual-textual inference.
AB - A large amount of research about multimodal inference across text and vision has been recently developed to obtain visually grounded word and sentence representations. In this paper, we use logic-based representations as unified meaning representations for texts and images and present an unsupervised multimodal logical inference system that can effectively prove entailment relations between them. We show that by combining semantic parsing and theorem proving, the system can handle semantically complex sentences for visual-textual inference.
UR - http://www.scopus.com/inward/record.url?scp=85083984180&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85083984180&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85083984180
T3 - ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Student Research Workshop
SP - 386
EP - 392
BT - ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Student Research Workshop
PB - Association for Computational Linguistics (ACL)
T2 - 57th Annual Meeting of the Association for Computational Linguistics, ACL 2019 - Student Research Workshop, SRW 2019
Y2 - 28 July 2019 through 2 August 2019
ER -