TY - GEN
T1 - A unified learning framework of skip-grams and global vectors
AU - Suzuki, Jun
AU - Nagata, Masaaki
N1 - Publisher Copyright:
© 2015 Association for Computational Linguistics.
PY - 2015
Y1 - 2015
N2 - Log-bilinear language models such as SkipGram and GloVe have been proven to capture high quality syntactic and seman-tic relationships between words in a vector space. We revisit the relationship between SkipGram and GloVe models from a ma-chine learning viewpoint, and show that these two methods are easily merged into a unified form. Then, by using the unified form, we extract the factors of the config-urations that they use differently. We also empirically investigate which factor is re-sponsible for the performance difference often observed in widely examined word similarity and analogy tasks.
AB - Log-bilinear language models such as SkipGram and GloVe have been proven to capture high quality syntactic and seman-tic relationships between words in a vector space. We revisit the relationship between SkipGram and GloVe models from a ma-chine learning viewpoint, and show that these two methods are easily merged into a unified form. Then, by using the unified form, we extract the factors of the config-urations that they use differently. We also empirically investigate which factor is re-sponsible for the performance difference often observed in widely examined word similarity and analogy tasks.
UR - http://www.scopus.com/inward/record.url?scp=84944079882&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84944079882&partnerID=8YFLogxK
U2 - 10.3115/v1/p15-2031
DO - 10.3115/v1/p15-2031
M3 - Conference contribution
AN - SCOPUS:84944079882
T3 - ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference
SP - 186
EP - 191
BT - ACL-IJCNLP 2015 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, Proceedings of the Conference
PB - Association for Computational Linguistics (ACL)
T2 - 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, ACL-IJCNLP 2015
Y2 - 26 July 2015 through 31 July 2015
ER -