Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '14
Full text: Download
In topic modelling, various alternative priors have been de-veloped, for instance asymmetric and symmetric priors for the document-topic and topic-word matrices respectively, the hierarchical Dirichlet process prior for the document-topic matrix and the hierarchical Pitman-Yor process prior for the topic-word matrix. For information retrieval, lan-guage models exhibiting word burstiness are important. In-deed, this burstiness effect has been show to help topic mod-els as well, and this requires additional word probability vectors for each document. Here we show how to combine these ideas to develop high-performing non-parametric topic models exhibiting burstiness based on standard Gibbs sam-pling. Experiments are done to explore the behavior of the models under different conditions and to compare the algo-rithms with previously published. The full non-parametric topic models with burstiness are only a small factor slower than standard Gibbs sampling for LDA and require double the memory, making them very competitive. We look at the comparative behaviour of different models and present some experimental insights.