Abstract
Graph-based methods have become one of the most active research areas of semi-supervised learning (SSL). Typical SSL graphs use instances as nodes and assign weights that reflect the similarity of instances. In this paper, we propose a novel type of graph, which we call instance-attribute graph. On the instance-attribute graph, we introduce another type of node to represent attributes, and we use edges to represent certain attribute values. The instance-attribute graph thus moreexplicitly expresses the relationship between instances and attributes. Typical SSL graph-based methods are nonparametric, discriminative, and transductive in nature. Using the instance-attribute graph, we propose a nonparametric and generative method, called probability propagation, where two kinds of messages are defined in terms of corresponding probabilities. The messages are sent and transformed on the graph until the whole graph become smooth. Since a labeling function can be returned, the probability propagation method not only is able to handle the cases of transductive learning, but also can be used to deal with the cases of inductive learning. From the experimental results, the probability propagation method based on the instance-attribute graph outperforms the other two popular SSL graph-based methods, Label Propagation (LP) and Learning with Local and Global Consistency (LLGC).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kschischang, F.R., Member, S., Frey, B.J., Loeliger, H.: Factor graphs and the sum-product algorithm. IEEE Transactions on Information Theory 47, 498–519 (2001)
Zhu, X., Ghahramani, Z.: Learning from labeled and unlabeled data with label propagation, Technical Report CMU-CALD-02-107, Carnegie Mellon University (2002)
Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Schölkopf, B.: Learning with local and global consistency. In: Advances in Neural Information Processing Systems 16, pp. 321–328. MIT Press, Cambridge (2004)
Balcan, M.-F., Blum, A., Choi, P.P., Lafferty, J., Pantano, B., Rwebangira, M.R., Zhu, X.: Person identification in webcam images: An application of semi-supervised learning. In: ICML Workshop on Learning with Partially Classified Training Data (2005)
Zhu, X.: Semi-supervised learning with graphs, PhD dissertation, Carnegie Mellon University (2005)
Zhu, X., Ghahramani, Z., Lafferty, J.: Semi-supervised learning using Gaussian fields and harmonic functions. In: ICML, pp. 912–919 (2003)
Joachims, T.: Transductive learning via spectral graph partitioning. In: ICML, pp. 290–297 (2003)
Pearl, J.: Probabilistic reasoning in intelligent systems: networks of plausible inference. Morgan Kaufmann Publishers Inc., San Francisco (1988)
Braunstein, A., Mézard, M., Zecchina, R.: Survey propagation: An algorithm for satisfiability. In: Random Struct & Algorithms, vol. 27, pp. 201–226. John Wiley & Sons, Inc., New York (2005)
Mitchell, T.M.: Mahchine learning. McGraw-Hill International Edtions (1997)
Kschischang, F.R., Frey, B.J.: Iterative decoding of compound codes by probability propagation in graphical models. IEEE Journal on Selected Areas in Communications 16, 219–230 (1998)
Yedidia, J.S., Freeman, W.T., Weiss, Y.: Bethe free energies, Kikuchi approximations, and belief propagation algorithms. Technical report TR-2001-10 (2001), http://www.merl.com/reports/TR2001-16/index.html
Witten, I.H., Frank, E.: Data mining - practical machine learning tools and techniques with Java implementation. Morgan Kaufmann, San Francisco (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, B., Zhang, H. (2010). Semi-supervised Probability Propagation on Instance-Attribute Graphs. In: Farzindar, A., Kešelj, V. (eds) Advances in Artificial Intelligence. Canadian AI 2010. Lecture Notes in Computer Science(), vol 6085. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13059-5_17
Download citation
DOI: https://doi.org/10.1007/978-3-642-13059-5_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13058-8
Online ISBN: 978-3-642-13059-5
eBook Packages: Computer ScienceComputer Science (R0)