![]() ![]() Some generate an entire discipline while others make relatively fewer contributions. I suggest that there is substantial untapped potential for topic models and models inspired by or incorporating topic models to be fruitfully applied, and outline the characteristics of systems and data for which this may be the case. Nonetheless, it is relatively recently that probabilistic topic models have found applications outside of text analysis, and to date few such applications have been considered. LDA and it's variants have been used to find patterns in data from diverse areas of inquiry, including genetics, plant physiology, image analysis, social network analysis, remote sensing and astrophysics. These techniques are not restricted to text analysis, however, and can be applied to other types of data which can be sensibly discretised and represented as counts of labels/properties/etc. They have become widely used in the text analysis and population genetics communities, with a number of compelling applications. Numerous extensions and adaptations of LDA have been proposed: non-parametric models assorted models incorporating authors, sentiment and other features models regularised through the use of extra metadata or extra priors on topic structure, and many more. The first of these techniques to attract significant attention was Latent Dirichlet Allocation (LDA). The use of conjugate priors allows for efficient inference, and these techniques scale well to data sets with many millions of vectors. Probabilistic topic models address this using mixtures of multinomials estimated via Bayesian inference with Dirichlet priors. With such data, simply calculating a correlation matrix is infeasible. These techniques allow the modelling of high dimensional count vectors with strong correlations. I present here an overview of recent advances in probabilistic topic modelling and related Bayesian graphical models as well as some of their more atypical applications outside of their home: text analysis. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |