Abstract
Reconstruction of biological networks from profiling data is one of the most challenges in systems biology. Methods that use some measures in information theory to reconstruct local relationships in biological networks are often preferred over others due to their simplicity and low computation cost. Present mutual information-based methods cannot detect as well as provide relationships that take into account more than two variables (called multivariate relationships or k-wise relationships). Some previous studies have tried to extend mutual information from two to multiple variables; however the interpretation of these extensions is not clear. We introduce a novel interpretation and visualization of mutual information between two variables. With the new interpretation, we then extend mutual information to multiple variables that can capture different categories of multivariate relationships. We illustrate the prediction performance of these multivariate mutual information measures in reconstructing three-variable relationships on different benchmark networks.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Butte, A., Kohane, I.: Mutual Information Relevance Networks: Functional Genomic Clustering using Pairwise Entropy Measurements. In: Pacific Symposium on Biocomputing, pp. 418–429 (2000)
Cover, T.M., Thomas, J.A.: Elements of Information Theory, 2nd edn. Molecular Systems Biology. Wiley-Interscience, A John wiley & Sons, Inc. (2006)
Fano, R.M.: A Statistical Theory of Communication. MIT Press, Cambridge (1961)
Jakulin, A.: Machine Learning Based on Attribute Interactions. PhD Dissertation, University of Ljubljana (2005)
Jakulin, A., Bratko, I.: Quantifying and Visualizing Attribute Interactions: An Approach Based on Entropy. CoRR, cs.AI/0308002 (2004), http://arxiv.org/abs/cs.AI/0308002
McGill, W.J.: Multivariate information transmission. Psychometrika 19(2), 97–116 (1954)
Steuer, R., Kurths, J., Daub, C.O., Weise, J., Selbig, J.: The Mutual Information: Detecting and Evaluating Dependencies between Variables. Bioinformatics 18, 231–240 (2002)
Watanabe, S.: Information Theoretical Analysis of Multivariate Correlation. IBM Journal of Research and Development 4, 66–82 (1960)
Margolin, A., Nemenman, I., Basso, K., Wiggins, C., Stolovitzky, G., Favera, R.D., Califano, A.: ARACNE: an Algorithm for the Reconstruction of Gene Regulatory Networks in a Mammalian Cellular Context. BMC Bioinformatics 7(sppl.1) (2006)
Anastassiou, D.: Computational Analysis of the Synergy among Multiple Interacting Genes. Molecular Systems Biology 3(83) (2007)
Cho, K.H., Choo, S.M., Jung, S.H., Kim, J.R., Choi, H.S., Kim, J.: Reverse engineering of gene regulatory networks. IET Syst. Biol. 1(3), 149–163 (2007)
Daub, C.O., Steuer, R., Selbig, J., Kloska, S.: Estimating Mutual Information using B-spline Functions–an Improved Similarity Measure for Analysing Gene Expression Data. BMC Bioinformatics 5(118) (2004)
Friedman, N., Linial, M., Nachman, I., Peer, D.: Using Bayesian Networks to Analyze Expression Data. J. Comput. Biol. 7, 601–620 (2000)
Han, T.S.: Multiple mutual information and multiple interactions in frequency data. Information and Control 46, 26–45 (1980)
Heckera, M., Lambecka, S., Toepferb, S., Somerenc, E., Guthke, R.: Gene regulatory network inference: Data integration in dynamic models - A review (2009)
Leydesdorff, L.: Interaction Information: Linear and Nonlinear Interpretations. Int. J. General Systems 6(36), 681–685 (2009)
Marbach, D., Schaffter, T., Mattiussi, C., Floreano, D.: Generating realistic in silico gene networks for performance assessment of reverse engineering methods. J. Comput. Biol. 16(2), 229–239 (2009)
Pham, T.H., Ho, T.B., Nguyen, Q.D., Tran, D.H., Nguyen, H.V.: Multivariate Mutual Information Measures for Discovering Biological Networks. In: The 9th IEEE - RIVF International Conference on Computing and Comunication Technologies, pp. 103–108 (2012)
Prill, R.J., Marbach, D., Saez-Rodriguez, J., Sorger, P.K., Alexopoulos, L.G., Xue, X., Clarke, N.D., Altan-Bonnet, G., Stolovitzky, G.: Towards a rigorous assessment of systems biology models: the DREAM3 challenges 5(2) (2010)
Stolovitzky, G., Prill, R.J., Califano, A.: Lessons from the DREAM2 Challenges: A Community Effort to Assess Biological Network Inference. Ann. N.Y. Acad. Sci., 159–195 (2009)
Styczynski, M.P., Stephanopoulos, G.: Overview of computational methods for the inference of gene regulatory networks. Computers & Chemical Engineering 29(3), 519–534 (2005)
Walters-Williams, J., Li, Y.: Estimation of mutual information: A survey. In: Wen, P., Li, Y., Polkowski, L., Yao, Y., Tsumoto, S., Wang, G. (eds.) RSKT 2009. LNCS, vol. 5589, pp. 389–396. Springer, Heidelberg (2009)
Watkinson, J., Liang, K.C., Wang, X., Zheng, T., Anastassiou, D.: Inference of regulatory gene interactions from expression data using three-way mutual information. Ann. N.Y. Acad. Sci., 302–313 (2009)
Werhli, A.V., Husmeier, D.: Reconstructing Gene Regulatory Networks with Bayesian Networks by Combining Expression Data with Multiple Sources of Prior Knowledge. Statistical Applications in Genetics and Molecular Biology 6(1) (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nguyen, Q.D., Pham, T.H., Ho, T.B., Nguyen, V.H., Tran, D.H. (2013). Reconstruction of Triple-wise Relationships in Biological Networks from Profiling Data. In: Meesad, P., Unger, H., Boonkrong, S. (eds) The 9th International Conference on Computing and InformationTechnology (IC2IT2013). Advances in Intelligent Systems and Computing, vol 209. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37371-8_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-37371-8_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37370-1
Online ISBN: 978-3-642-37371-8
eBook Packages: EngineeringEngineering (R0)