Abstract
Factor graphs have recently been introduced as an efficient graphical model for codes to study iterative decoding algorithms. However, it is well-known that a factor graph generalizes only the time axis of a trellis, but omits the state transition representation. In this paper, a new graphical model, called the hypertrellis, is proposed to overcome this insufficiency of factor graphs. A hypertrellis is in essence a weighted hypergraph generalization of a traditional trellis. Its time topology, which extends the time axis of a trellis, can take the form of any factor graph. A key to this extension is the interpretation of a factor graph as a factor hypergraph. This is facilitated by introducing a “starfish” drawing representation for hypergraphs, which enhances the applicability of hypergraph models by enabling simpler drawing and easier visualization, relative to the traditional representation. The maximum likelihood decoding (MLD) problem is then formulated as a shortest hyperpath search on a hypertrellis. For hypertrellises with an acyclic time topology, a hyperpath-oriented MLD algorithm, called the one-way algorithm, is introduced. The one-way algorithm, as a hypertrellis generalization of the celebrated Viterbi algorithm, provides insights into efficient management of the surviving hyperpath history and various practical hyperpath-oriented simplifications. It is shown that as a MLD algorithm, the one-way algorithm has a lower minimal decoding delay. The computational complexity and the amount of storage needed are also bett er than with the well-known min-sum algorithm. Some connections between the hypertrellis and another recently proposed bipartite graph model, called the trellis formation, are also discussed.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
R.G. Almond, Graphical Belief Modelling, Chapman and Hall: London, 1995.
C. Berge, Hypergraphs, North-Holland, 1989.
C. Berrou, A. Glavieux, and P. Thitimajshima, “Near Shannon limit error-correcting coding and decoding: Turbo codes,” Proc. IEEE Int. Conf. Commun. (ICC’93), Geneva, Switzerland, 1993, pp. 1064–1070.
U. Bertele and F. Brioschi, Nonserial Dynamic Programming, New York: Academic Press, 1972.
G.D. Forney, “The Viterbi Algorithm,” Proc. IEEE, 61, pp. 268–278, Mar. 1973.
G.D. Forney, “On Iterative Decoding and the Two-Way Algorithm,” Proc. International Symposium on Turbo Codes, Brest, France, 1997.
R.G. Gallager, Low-Density Parity-Check Codes, Cambridge, MA: MIT Press, 1966.
A. Habel, Hyperedge Replacement: Grammars and Languages, Berlin: Springer-Verlag, 1992.
J. Hagenauer, “The Turbo Principle: Thtorial Introduction and State of the Art,” Proc. International Symposium on Turbo Codes, Brest, France, 1997.
A. Kaufmann, Graphs, Dynamic Programming, and Finite Games, translated by H.C. Sneyd, Academic Press, 1967, Méthodes et Modéles de la Recherche Opérationnelle, originally published in 1964 (in French).
C.T.A. Kong, “Multivariate Belief Functions and Graphical Models,” PhD thesis, Technical Report S-107, Harvard University, Department of Statistics, 1986.
R. KÖtter, “Factor Graphs, Trellis Formations, and Generalized State Realizations,” presented at the IMA Summer Program on Codes, Systems and Graphieal Models, August 2-6, 1999. Downloadable from http://www. ima. umn. edu/talks/workshops/aug2-13. 99/8-2-13. 99.html.
R. KÖtter and A. Vardy, “Factor Graphs: Constructions, Classification, and Bounds,” Proc. International Symposium on Information Theory (ISIT’98), Cambridge, MA, USA, August 1998.
F.R. Kschischang and B.J. Frey, “Iterative Decoding of Compound Codes by Probability Propagation in Graphical Models,” IEEE J. Selected Areas in Commun., 16, pp. 219–230, 1998.
F.R. Kschischang, B.J. Frey, and H.-A. Loeliger, “Factor Graphs and the Sum-Product Algorithm,” submitted to IEEE Trans. Inform. Theory, July 27, 1998. Downloadable from http://www.comm.utoronto.ca/frank/factor/.
S.L. Lauritzen, Graphical Models, Oxford University Press, 1996.
D.J.C. MacKay and R.M. Neal, “Near Shannon limit performance of low density parity check codes,” Electron. Lett., 32(18), pp. 1645–1646, 1996.
R.J. McEliece, D.J.C. MacKay and J.-F. Cheng, “Turbo decoding as an instance of Pearl’s belief propagation algorithm,” IEEE J. Selected Areas in Commun., 16, pp. 140–152, 1998.
W.H. Mow, “Hypertrellis: a Generalization of Trellis and Factor Graph,” material presented at the Hong Kong University of Science and Technology, July 7, 1999. Accepted by (though not presented at) the IMA Summer Program on Codes, Systems and Graphical Models, August 2-6, 1999. Downloadable from http://www.ima.umn.edu/talks/workshops/aug2-13.99/8-2-13.99.html.
G.L. Nemhauser, Introduetion to Dynamic Programming, New York: John Wiley & Sons, 1966.
J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Mateo, CA: Morgan Kaufmann, 1988.
G. Shafer, Probabilistic Expert Systems. CBMS-NSF Regional Conference Series in Applied Mathematics, 67, PA: SIAM, 1996.
P.P. Shenoy, “A Valuation-based Language for Expert Systems,” International Journal of Approximate Reasoning, 3(5), pp. 383–411, 1989.
P.P. Shenoy, “Valuation-based Systems for Discrete Optimization,” in Uncertainty in Artificial Intelligence, 6, pp. 385–400, 1991.
P.P. Shenoy and G. Shafer, “Axioms for Probability and Belief-function Propagation,” in Uncertainty in Artificial Intelligence, 4, pp. 169–198, 1990.
N. Wiberg, Codes and Decoding on General Graphs, Linköping Studies in Science and Technology. Dissertations, No. 440, 1996.
N. Wiberg, H.-A. Loegliger and R. KÖtter, “Codes and Iterative Decoding on General Graphs,” European Transactions on Telecommunications, 6, pp. 513–525, 1995.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag New York, Inc.
About this paper
Cite this paper
Mow, W.H. (2001). Hypertrellis: A Generalization of Trellis and Factor Graph. In: Marcus, B., Rosenthal, J. (eds) Codes, Systems, and Graphical Models. The IMA Volumes in Mathematics and its Applications, vol 123. Springer, New York, NY. https://doi.org/10.1007/978-1-4613-0165-3_10
Download citation
DOI: https://doi.org/10.1007/978-1-4613-0165-3_10
Publisher Name: Springer, New York, NY
Print ISBN: 978-0-387-95173-7
Online ISBN: 978-1-4613-0165-3
eBook Packages: Springer Book Archive