A comparison of collapsed Bayesian methods for probabilistic finite automata

Chihiro Shibata, Ryo Yoshinaka

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)


This paper describes several collapsed Bayesian methods, which work by first marginalizing out transition probabilities, for inferring several kinds of probabilistic finite automata. The methods include collapsed Gibbs sampling (CGS) and collapsed variational Bayes, as well as two new methods. Their targets range over general probabilistic finite automata, hidden Markov models, probabilistic deterministic finite automata, and variable-length grams. We implement and compare these algorithms over the data sets from the Probabilistic Automata Learning Competition (PAutomaC), which are generated by various types of automata. We report that the CGS-based algorithm designed to target general probabilistic finite automata performed the best for any types of data.

Original languageEnglish
Pages (from-to)155-188
Number of pages34
JournalMachine Learning
Issue number1-2
Publication statusPublished - 2014 Jul


  • Collapsed Gibbs sampling
  • State-merging algorithms
  • Variational Bayesian methods


Dive into the research topics of 'A comparison of collapsed Bayesian methods for probabilistic finite automata'. Together they form a unique fingerprint.

Cite this