Convergence and correctness of belief propagation for the Chinese postman problem
- 7 Downloads
Belief Propagation (BP), a distributed, message-passing algorithm, has been widely used in different disciplines including information theory, artificial intelligence, statistics and optimization problems in graphical models such as Bayesian networks and Markov random fields. Despite BP algorithm has a great success in many application fields and many progress about BP algorithm has been made, the rigorous analysis about the correctness and convergence of BP algorithm are known in only a few cases for arbitrary graph. In this paper, we will investigate the correctness and convergence of BP algorithm for determining the optimal solutions of the Chinese postman problem in both undirected and directed graphs. As a main result, we prove that BP algorithm converges to the optimal solution of the undirected Chinese postman problem within O(n) iterations where n represents the number of vertices, provided that the optimal solution is unique. For the directed case, we consider the directed Chinese postman problem with capacity and show that BP algorithm also converges to its optimal solution after O(n) iterations, as long as its corresponding linear programming relaxation has the unique optimal solution.
KeywordsBelief propagation (BP) Message-passing algorithm Min-sum algorithm Convergence Undirected Chinese postman problem Directed Chinese postman problem
We are truly grateful to the reviewers’ comments and suggestions on improving the manuscript, which helped us greatly to improve the quality of our paper. The research was partially supported by the National Natural Science Foundation of China under Grant Nos. 11871280, 11471003, 11401389,11531014, 11871081, China Scholarship Council under Grant Nos. 201607910003, 201608330111, Zhejiang Provincial Natural Science Foundation of China under Grant Nos. LY17A010017, 11401389 and Qing Lan Project.
- 1.Achlioptas, D., Ricci-Tersenghi, F.: On the solution-space geometry of random constraint satisfaction problems. In: Proceedings of the 38th Annual ACM Symposium on Theory of Computing, pp. 130–139, ACM (2006)Google Scholar
- 2.Aji, S.M., Horn, G.B., Mceliece, R.J.: On the convergence of iterative decoding on graphs with a single cycle. In: Proceedings of IEEE International Symposium Information Theory, p. 276. Cambridge (1998)Google Scholar
- 6.Bayati, M., Shah, D., Sharma, M.: A simpler max-product maximum weight matching algorithm and the auction algorithm. In: IEEE International Symposium Information Theory, pp. 557–561 (2006)Google Scholar
- 10.Cheng, Y., Neely, M., Chugg, K.M.: Iterative message passing algorithm for bipartite maximum weighted matching. In: IEEE International Symposium Information Theory, Cambridge, pp. 1934–1938, (2006)Google Scholar
- 18.Gallager, R.G.: Low density parity check codes. IEEE Trans. Inf. Theory 8, 21–28 (1962)Google Scholar
- 24.Mézard, M., Zecchina, R.: Random k-satisfiability problem: from an analytic solution to an efficient algorithm. Phys. Rev. 66, 249–264 (2002)Google Scholar
- 27.Sanghavi, S., Malioutov, D., Willsky, A.: Linear programming analysis of loopy belief propagation for weighted matching. In: Advances in Neural Information Processing Systems, pp. 1273–1280. Cambridge, (2007)Google Scholar
- 31.Vontobel, P.O., Koetter, R.: Graph-cover decoding and finite-length analysis of message passing iterative decoding of LDPC codes, arXiv preprint cs/0512078 (2005)Google Scholar
- 36.Yedidia, J., Freeman, W., Weiss, Y.: Understanding belief propagation and its generalizations. Explor. Artif. Intell. New Millenn. 8, 236–239 (2003)Google Scholar