Domain adaptation based on mixture of latent words language models for automatic speech recognition

Ryo Masumura, Taichi Asami, Takanobu Oba, Hirokazu Masataki, Sumitaka Sakauchi, Akinori Ito

Research output: Contribution to journalArticlepeer-review

5 Citations (Scopus)


This paper proposes a novel domain adaptation method that can utilize out-of-domain text resources and partially domain matched text resources in language modeling. A major problem in domain adaptation is that it is hard to obtain adequate adaptation effects from out-of-domain text resources. To tackle the problem, our idea is to carry out model merger in a latent variable space created from latent words language models (LWLMs). The latent variables in the LWLMs are represented as specific words selected from the observed word space, so LWLMs can share a common latent variable space. It enables us to perform flexible mixture modeling with consideration of the latent variable space. This paper presents two types of mixture modeling, i.e., LWLM mixture models and LWLM cross-mixture models. The LWLM mixture models can perform a latent word space mixture modeling to mitigate domain mismatch problem. Furthermore, in the LWLM cross-mixture models, LMs which individually constructed from partially matched text resources are split into two element models, each of which can be subjected to mixture modeling. For the approaches, this paper also describes methods to optimize mixture weights using a validation data set. Experiments show that the mixture in latent word space can achieve performance improvements for both target domain and out-of-domain compared with that in observed word space.

Original languageEnglish
Pages (from-to)1581-1590
Number of pages10
JournalIEICE Transactions on Information and Systems
Issue number6
Publication statusPublished - 2018 Jun


  • Automatic speech recognition
  • Domain adaptation
  • Latent variable space
  • Latent words language models
  • Mixture modeling


Dive into the research topics of 'Domain adaptation based on mixture of latent words language models for automatic speech recognition'. Together they form a unique fingerprint.

Cite this