On the Sufficiency of Pairwise Interactions in Maximum Entropy Models of Networks
- 324 Downloads
Biological information processing networks consist of many components, which are coupled by an even larger number of complex multivariate interactions. However, analyses of data sets from fields as diverse as neuroscience, molecular biology, and behavior have reported that observed statistics of states of some biological networks can be approximated well by maximum entropy models with only pairwise interactions among the components. Based on simulations of random Ising spin networks with p-spin (\(p>2\)) interactions, here we argue that this reduction in complexity can be thought of as a natural property of densely interacting networks in certain regimes, and not necessarily as a special property of living systems. By connecting our analysis to the theory of random constraint satisfaction problems, we suggest a reason for why some biological systems may operate in this regime.
KeywordsCollective dynamics p-spin models Numerical simulations
We thank Aly Pesic and Daniel Holz, who helped during the early stages of this project, Arthur Lander and Chris Myers, who suggested a possible link to evolution, and Thierry Mora, Aleksandra Walczak, and Gasper Tkacik for useful discussions. We also thank the anonymous referees for their insightful comments. We are grateful to the Emory College Emerson Center for Scientific Computing and its funders for the help with numerical simulations. The authors were partially supported by the James S. McDonnell foundation Complex Systems award, by the Human Frontiers Science Program, and by the National Science Foundation.
- 4.Broderick, T., Dudik, M., Tkacik, G., Schapire, R.E., Bialek, W.: Faster solutions of the inverse pairwise Ising problem. (2007). arXiv:0712.2437v2
- 10.Tkacik, G., Bialek, W. Information processing in living systems. (2014). arXiv:1412.8752v1
- 12.Tang, A., Jackson, D., Hobbs, J., Chen, W., Smith, J.L., Patel, H., Prieto, A., Petrusca, D., Grivich, M.I., Sher, A., Hottowy, P., Dabrowski, W., Litke, A.M., Beggs, J.M.: A maximum entropy model applied to spatial and temporal correlations from cortical networks in vitro. J. Neurosci. 28, 505 (2008)CrossRefGoogle Scholar
- 16.Bethge, M., Berens, P.: Near-maximum entropy models for binary neural representations of natural images. In: Platt, J., Koller, D., Singer, Y., Roweis, S. (eds.) Advances in Neural Information Processing Systems, p. 97. MIT Press, Cambridge (2008)Google Scholar
- 24.Tkacik, G., Schneidman, E., Berry, M., Bialek, W.: Ising models for networks of real neurons. (2006). arXiv:org/q-bio/0611072v1
- 38.Lander, A. Beyond q-bio? The closing talk at The Sixth q-bio Conference, Santa Fe, NM. (2012)Google Scholar
- 39.Barlow, H.B.: Possible principles underlying the transformation of sensory messages. In: Rosenblith, W. (ed.) Sensory Communication, p. 217. MIT Press, Cambridge, MA (1961)Google Scholar