Skip to main content

Hypertrellis: A Generalization of Trellis and Factor Graph

  • Conference paper
Codes, Systems, and Graphical Models

Part of the book series: The IMA Volumes in Mathematics and its Applications ((IMA,volume 123))

Abstract

Factor graphs have recently been introduced as an efficient graphical model for codes to study iterative decoding algorithms. However, it is well-known that a factor graph generalizes only the time axis of a trellis, but omits the state transition representation. In this paper, a new graphical model, called the hypertrellis, is proposed to overcome this insufficiency of factor graphs. A hypertrellis is in essence a weighted hypergraph generalization of a traditional trellis. Its time topology, which extends the time axis of a trellis, can take the form of any factor graph. A key to this extension is the interpretation of a factor graph as a factor hypergraph. This is facilitated by introducing a “starfish” drawing representation for hypergraphs, which enhances the applicability of hypergraph models by enabling simpler drawing and easier visualization, relative to the traditional representation. The maximum likelihood decoding (MLD) problem is then formulated as a shortest hyperpath search on a hypertrellis. For hypertrellises with an acyclic time topology, a hyperpath-oriented MLD algorithm, called the one-way algorithm, is introduced. The one-way algorithm, as a hypertrellis generalization of the celebrated Viterbi algorithm, provides insights into efficient management of the surviving hyperpath history and various practical hyperpath-oriented simplifications. It is shown that as a MLD algorithm, the one-way algorithm has a lower minimal decoding delay. The computational complexity and the amount of storage needed are also bett er than with the well-known min-sum algorithm. Some connections between the hypertrellis and another recently proposed bipartite graph model, called the trellis formation, are also discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. R.G. Almond, Graphical Belief Modelling, Chapman and Hall: London, 1995.

    Google Scholar 

  2. C. Berge, Hypergraphs, North-Holland, 1989.

    Google Scholar 

  3. C. Berrou, A. Glavieux, and P. Thitimajshima, “Near Shannon limit error-correcting coding and decoding: Turbo codes,” Proc. IEEE Int. Conf. Commun. (ICC’93), Geneva, Switzerland, 1993, pp. 1064–1070.

    Google Scholar 

  4. U. Bertele and F. Brioschi, Nonserial Dynamic Programming, New York: Academic Press, 1972.

    MATH  Google Scholar 

  5. G.D. Forney, “The Viterbi Algorithm,” Proc. IEEE, 61, pp. 268–278, Mar. 1973.

    Article  MathSciNet  Google Scholar 

  6. G.D. Forney, “On Iterative Decoding and the Two-Way Algorithm,” Proc. International Symposium on Turbo Codes, Brest, France, 1997.

    Google Scholar 

  7. R.G. Gallager, Low-Density Parity-Check Codes, Cambridge, MA: MIT Press, 1966.

    Google Scholar 

  8. A. Habel, Hyperedge Replacement: Grammars and Languages, Berlin: Springer-Verlag, 1992.

    MATH  Google Scholar 

  9. J. Hagenauer, “The Turbo Principle: Thtorial Introduction and State of the Art,” Proc. International Symposium on Turbo Codes, Brest, France, 1997.

    Google Scholar 

  10. A. Kaufmann, Graphs, Dynamic Programming, and Finite Games, translated by H.C. Sneyd, Academic Press, 1967, Méthodes et Modéles de la Recherche Opérationnelle, originally published in 1964 (in French).

    Google Scholar 

  11. C.T.A. Kong, “Multivariate Belief Functions and Graphical Models,” PhD thesis, Technical Report S-107, Harvard University, Department of Statistics, 1986.

    Google Scholar 

  12. R. KÖtter, “Factor Graphs, Trellis Formations, and Generalized State Realizations,” presented at the IMA Summer Program on Codes, Systems and Graphieal Models, August 2-6, 1999. Downloadable from http://www. ima. umn. edu/talks/workshops/aug2-13. 99/8-2-13. 99.html.

    Google Scholar 

  13. R. KÖtter and A. Vardy, “Factor Graphs: Constructions, Classification, and Bounds,” Proc. International Symposium on Information Theory (ISIT’98), Cambridge, MA, USA, August 1998.

    Google Scholar 

  14. F.R. Kschischang and B.J. Frey, “Iterative Decoding of Compound Codes by Probability Propagation in Graphical Models,” IEEE J. Selected Areas in Commun., 16, pp. 219–230, 1998.

    Article  Google Scholar 

  15. F.R. Kschischang, B.J. Frey, and H.-A. Loeliger, “Factor Graphs and the Sum-Product Algorithm,” submitted to IEEE Trans. Inform. Theory, July 27, 1998. Downloadable from http://www.comm.utoronto.ca/frank/factor/.

    Google Scholar 

  16. S.L. Lauritzen, Graphical Models, Oxford University Press, 1996.

    Google Scholar 

  17. D.J.C. MacKay and R.M. Neal, “Near Shannon limit performance of low density parity check codes,” Electron. Lett., 32(18), pp. 1645–1646, 1996.

    Article  Google Scholar 

  18. R.J. McEliece, D.J.C. MacKay and J.-F. Cheng, “Turbo decoding as an instance of Pearl’s belief propagation algorithm,” IEEE J. Selected Areas in Commun., 16, pp. 140–152, 1998.

    Article  Google Scholar 

  19. W.H. Mow, “Hypertrellis: a Generalization of Trellis and Factor Graph,” material presented at the Hong Kong University of Science and Technology, July 7, 1999. Accepted by (though not presented at) the IMA Summer Program on Codes, Systems and Graphical Models, August 2-6, 1999. Downloadable from http://www.ima.umn.edu/talks/workshops/aug2-13.99/8-2-13.99.html.

    Google Scholar 

  20. G.L. Nemhauser, Introduetion to Dynamic Programming, New York: John Wiley & Sons, 1966.

    Google Scholar 

  21. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann, 1988.

    Google Scholar 

  22. G. Shafer, Probabilistic Expert Systems. CBMS-NSF Regional Conference Series in Applied Mathematics, 67, PA: SIAM, 1996.

    Google Scholar 

  23. P.P. Shenoy, “A Valuation-based Language for Expert Systems,” International Journal of Approximate Reasoning, 3(5), pp. 383–411, 1989.

    Article  Google Scholar 

  24. P.P. Shenoy, “Valuation-based Systems for Discrete Optimization,” in Uncertainty in Artificial Intelligence, 6, pp. 385–400, 1991.

    MathSciNet  Google Scholar 

  25. P.P. Shenoy and G. Shafer, “Axioms for Probability and Belief-function Propagation,” in Uncertainty in Artificial Intelligence, 4, pp. 169–198, 1990.

    MathSciNet  Google Scholar 

  26. N. Wiberg, Codes and Decoding on General Graphs, Linköping Studies in Science and Technology. Dissertations, No. 440, 1996.

    Google Scholar 

  27. N. Wiberg, H.-A. Loegliger and R. KÖtter, “Codes and Iterative Decoding on General Graphs,” European Transactions on Telecommunications, 6, pp. 513–525, 1995.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag New York, Inc.

About this paper

Cite this paper

Mow, W.H. (2001). Hypertrellis: A Generalization of Trellis and Factor Graph. In: Marcus, B., Rosenthal, J. (eds) Codes, Systems, and Graphical Models. The IMA Volumes in Mathematics and its Applications, vol 123. Springer, New York, NY. https://doi.org/10.1007/978-1-4613-0165-3_10

Download citation

  • DOI: https://doi.org/10.1007/978-1-4613-0165-3_10

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-0-387-95173-7

  • Online ISBN: 978-1-4613-0165-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics