Relations Between Communication Complexity, Linear Arrangements, and Computational Complexity
Recently, Forster  proved a new lower bound on probabilistic communication complexity in terms of the operator norm of the communication matrix. In this paper, we want to exploit the various relations between communication complexity of distributed Boolean functions, geometric questions related to half space representations of these functions, and the computational complexity of these functions in various restricted models of computation. In order to widen the range of applicability of Forster’s bound, we start with the derivation of a generalized lower bound. We present a concrete family of distributed Boolean functions where the generalized bound leads to a linear lower bound on the probabilistic communication complexity (and thus to an exponential lower bound on the number of Euclidean dimensions needed for a successful half space representation), whereas the old bound fails. We move on to a geometric characterization of the well known communication complexity class C-PP in terms of half space representations achieving a large margin. Our characterization hints to a close connection between the bounded error model of probabilistic communication complexity and the area of large margin classification. In the final section of the paper, we describe how our techniques can be used to prove exponential lower bounds on the size of depth-2 threshold circuits (with still some technical restrictions). Similar results can be obtained for read-k-times randomized ordered binary decision diagram and related models.
Unable to display preview. Download preview PDF.
- 1.N. Alon, P. Frankl, and V. Rödl. Geometrical realization of set systems and probabilistic communication complexity. In Proceedings of the 26th Symposium on Foundations of Computer Science, pages 277–280, 1985.Google Scholar
- 3.Rosa I. Arriaga and Santosh Vempala. An algorithmic theory of learning: Robust concepts and random projection. In Proceedings of the 40’th Annual Symposium on the Foundations of Computer Science, pages 616–623, 1999.Google Scholar
- 4.Shai Ben-David, Nadav Eiron, and Hans Ulrich Simon. Limitations of learning via embeddings in euclidean half-spaces. In Proceedings of the 14th Annual Workshop on Computational Learning Theory, pages 385–401. Springer Verlag, 2001.Google Scholar
- 5.Jehoshua Bruck and Roman Smolensky. Polynomial threshold functions, AC 0 functions and spectral norms. In Proceedings of the 31st Symposium on Foundations of Computer Science, pages 632–641, 1990.Google Scholar
- 6.Nello Christianini and John Shawe-Taylor. An Introduction to Support Vector Machines. Cambridge University Press, 2000.Google Scholar
- 7.Jürgen Forster. A linear bound on the unbounded error probabilistic communication complexity. In Proceedings of the 16th Annual Conference on Computational Complexity, pages 100–106, 2001.Google Scholar
- 8.Jürgen Forster, Niels Schmitt, and Hans Ulrich Simon. Estimating the optimal margins of embeddings in euclidean half spaces. In Proceedings of the 14th Annual Workshop on Computational Learning Theory, pages 402–415. Springer Verlag, 2001.Google Scholar
- 12.Matthias Krause and Pavel Pudlák. On the computational power of depth-2 circuits with threshold and modulo gates. In Proceedings of the 25th Annual Symposium on Theory of Computing, pages 48–57, 1993.Google Scholar
- 13.Matthias Krause and Stephan Waack. Variation ranks of communication matrices and lower bounds for depth two circuits having symmetric gates with unbounded fan-in. In Proceedings of the 32nd Symposium on Foundations of Computer Science, pages 777–782, 1991.Google Scholar
- 15.Martin Sauerhoff. On the size of randomized OBDDs and read-once branching programs for k-stable functions. In Proceedings of the 16th Annual Symposium on Theoretical Aspects of Computer Science, pages 488–499. Springer Verlag, 1999.Google Scholar
- 16.Ingo Wegner. Branching programs and binary decision diagrams — theory and applications. Monographs on Discrete Mathematics and Applications. SIAM, 2001.Google Scholar