Skip to main content
SpringerLink
Log in
Book cover

International Symposium on Distributed Computing and Artificial Intelligence

DCAI 2018: Distributed Computing and Artificial Intelligence, Special Sessions, 15th International Conference pp 291–299Cite as

Tree-Structured Hierarchical Dirichlet Process

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 801))

Abstract

In many domains, document sets are hierarchically organized such as message forums having multiple levels of sections. Analysis of latent topics within such content is crucial for tasks like trend and user interest analysis. Nonparametric topic models are a powerful approach, but traditional Hierarchical Dirichlet Processes (HDPs) are unable to fully take into account topic sharing across deep hierarchical structure. We propose the Tree-structured Hierarchical Dirichlet Process, allowing Dirichlet process based topic modeling over a given tree structure of arbitrary size and height, where documents can arise at all tree nodes. Experiments on a hierarchical social message forum and a product reviews forum demonstrate better generalization performance than traditional HDPs in terms of ability to model new data and classify documents to sections.

Md. H. Alam and J. Peltonen had equal contributions. The work was supported by Academy of Finland decisions 295694 and 313748.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Blei, D., Ng, A., Jordan, M.: Latent Dirichlet allocation. JMLR 3, 993–1022 (2003)

    MATH  Google Scholar 

  2. Teh, Y., Jordan, M., Beal, M., Blei, D.: Hierarchical Dirichlet processes. J. Am. Stat. Assoc. 101, 1566–1581 (2006)

    Article  MathSciNet  Google Scholar 

  3. Blei, D., Griffiths, T., Jordan, M.: The nested Chinese restaurant process and Bayesian nonparametric inference of topic hierarchies. J. ACM 57, 7:1–7:30 (2010)

    Article  MathSciNet  Google Scholar 

  4. Li, W., McCallum, A.: Pachinko allocation: DAG-structured mixture models of topic correlations. In: Proceedings of ICML, pp. 577–584. ACM (2006)

    Google Scholar 

  5. Adams, R., Ghahramani, Z., Jordan, M.: Tree-structured stick breaking for hierarchical data. In: Proceedings of NIPS, pp. 19–27. Curran Associates Inc. (2010)

    Google Scholar 

  6. Faisal, A., Gillberg, J., Leen, G., Peltonen, J.: Transfer learning using a nonparametric sparse topic model. Neurocomputing 112, 124–137 (2013)

    Article  Google Scholar 

  7. Xu, Y., Yin, J., Huang, J., Yin, Y.: Hierarchical topic modeling with automatic knowledge mining. Expert Syst. Appl. 103, 106–117 (2018)

    Article  Google Scholar 

  8. Kim, J., Kim, D., Kim, S., Oh, A.: Modeling topic hierarchies with the recursive Chinese restaurant process. In: Proceedings of CIKM, pp. 783–792. ACM (2012)

    Google Scholar 

  9. He, R., McAuley, J.: Ups and downs: modeling the visual evolution of fashion trends with one-class collaborative filtering. In: Proceedings of WWW, pp. 507–517 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Tampere, Tampere, Finland

    Md. Hijbul Alam, Jaakko Peltonen, Jyrki Nummenmaa & Kalervo Järvelin

  2. Aalto University, Espoo, Finland

    Jaakko Peltonen

Authors
  1. Md. Hijbul Alam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jaakko Peltonen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jyrki Nummenmaa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kalervo Järvelin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jaakko Peltonen .

Editor information

Editors and Affiliations

  1. BISITE Digital Innovation Hub, University of Salamanca, Salamanca, Spain

    Sara Rodríguez

  2. BISITE Digital Innovation Hub, University of Salamanca, Salamanca, Spain

    Javier Prieto

  3. GECAD - Instituto Superior de Engenharia, Porto, Portugal

    Pedro Faria

  4. Department of Computer Science and Production Management, University of Zielona Góra, Zielona Góra, Poland

    Sławomir Kłos

  5. Computing Science and Artificial Intelligence, Rey Juan Carlos University, Móstoles, Madrid, Spain

    Alberto Fernández

  6. Basque Center for Applied Mathematics, Bilbao, Spain

    Santiago Mazuelas

  7. Basque Center for Applied Mathematics, Universidad de Alcalá, Alcalá de Henares, Spain

    M. Dolores Jiménez-López

  8. Departamento de Informática y Automática, University of Salamanca, Salamanca, Spain

    María N. Moreno

  9. Departamento de Sistemas Informáticos, University of Castilla-La Mancha, Albacete, Spain

    Elena M. Navarro

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Alam, M.H., Peltonen, J., Nummenmaa, J., Järvelin, K. (2019). Tree-Structured Hierarchical Dirichlet Process. In: Rodríguez, S., et al. Distributed Computing and Artificial Intelligence, Special Sessions, 15th International Conference. DCAI 2018. Advances in Intelligent Systems and Computing, vol 801. Springer, Cham. https://doi.org/10.1007/978-3-319-99608-0_33

Download citation

Publish with us

Policies and ethics

Search

Navigation