Abstract
Maximization of a submodular function is a central problem in the algorithmic theory of combinatorial optimization. On the one hand, it has the feel of a clean and stylized problem, amenable to mathematical analysis, while on the other hand, it comfortably contains several rather different problems which are independently of interest from both theoretical and applied points of view. There have been successful analyses from the point of view of theoretical computer science, specifically approximation algorithms, and from an operations research viewpoint, specifically novel branch-and-bound methods have proven to be effective on broad subclasses of problems. To some extent, both of these points of view have validated what some practitioners have known all along: Local-search methods are very effective for many of these problems.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anstreicher, K.M., Lee, J.: A masked spectral bound for maximum-entropy sampling. In: MODA 7 – Advances in Model-Oriented Design and Analysis. Contributions to Statistics, pp. 1–12. Springer, Berlin (2004)
Anstreicher, K.M., Fampa, M., Lee, J., Williams, J.D.: Continuous relaxations for constrained maximum-entropy sampling. In: Integer Programming and Combinatorial Optimization, Vancouver. Lecture Notes in Computer Science, vol. 1084, pp. 234–248. Springer, Berlin (1996)
Anstreicher, K.M., Fampa, M., Lee, J., Williams, J.D.: Using continuous nonlinear relaxations to solve constrained maximum-entropy sampling problems. Math. Program. A 85, 221–240 (1999)
Anstreicher, K.M., Fampa, M., Lee, J., Williams, J.D.: Maximum-entropy remote sampling. Discret. Appl. Math. 108, 211–226 (2001)
Barahona, F., Grötschel, M., Jünger, M., Reinelt, G.: An application of combinatorial optimization to statistical physics and circuit layout design. Oper. Res. 36(3), 493–513 (1988)
Burer, S., Lee, J.: Solving maximum-entropy sampling problems using factored masks. Math. Program. 109(2–3), 263–281 (2007)
Calinescu, G., Chekuri, C., Pál, M., Vondrák, J.: Maximizing a submodular set function subject to a matroid constraint. In: Proceedings of 12th IPCO, Ithaca, pp. 182–196 (2007)
Caselton, W.F., Zidek, J.V.: Optimal monitoring network designs. Stat. Probab. Lett. 2, 223–227 (1984)
Caselton, W.F., Kan, L., Zidek, J.V.: Quality data networks that minimize entropy. In: Walden, A.T., Guttorp, P. (eds.) Statistics in the Environmental and Earth Sciences, pp. 10–38. Arnold, London (1992)
D’Ambrosio, C., Lee, J., Wächter, A.: An algorithmic framework for MINLP with separable non-convexity. In: Leyffer, S., Lee, J. (eds.) Mixed Integer Nonlinear Programming. The IMA Volumes in Mathematics and Its Applications, vol. 154, pp.315–347. Springer, New York (2012)
Fisher, M.L., Nemhauser, G.L., Wolsey, L.A.: An analysis of approximations for maximizing submodular set functions II. Math. Program. Study 8, 73–87 (1978)
Frank, A.: Applications of submodular functions. In: Walker, K. (ed.) Surveys in Combinatorics. London Mathematical Society, Lecture Note Series, vol. 187, pp.850–136. Cambridge University Press, Cambridge (1993)
Fujishige, S.: Submodular functions and optimization. Annals of Discrete Mathematics, vol. 58, 2nd edn. Elsevier, Amsterdam (2005)
Fujishige, S., Isotani, S.: A submodular function minimization algorithm based on the minimum-norm base. Pac. J. Optim. 7, 3–17 (2011)
Goemans, M.X., Williamson, D.P.: Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming. J. ACM 42(6), 1115–1145 (1995)
Grötschel, M., Lovász, L., Schrijver, A.: The ellipsoid method and its consequence in combinatorial optimization. Combinatorica 1(2), 169–197 (1981)
Grötschel, M., Lovász, L., Schrijver, A.: Geometric Algorithms and Combinatorial Optimization. Springer, Berlin (1993)
Guttorp, P., Le, N.D., Sampson, P.D., Zidek, J.V.: Using Entropy in the redesign of an environmental monitoring network. In: Patil, G.P., Rao, C.R. (eds.) Multivariate Environmental Statistics, pp. 175–202. North Holland, New York (1993)
Hoffman, A.J., Lee, J., Williams, J.D.: New upper bounds for maximum-entropy sampling. In: Atkinson, A.C., Hackl, P., Müller, W.G. (eds.) MODA 6 – Advances in Model-Oriented Design and Analysis. Contributions to Statistics, pp. 143–153. Springer, Berlin (2001)
Iwata, S., Fleischer, L., Fujishige, S.: A combinatorial, strongly polynomial-time algorithm for minimizing submodular functions. In: Proceedings of the Thirty-Second Annual ACM Symposium on Theory of Computing, Portland, pp. 97–106 (electronic). ACM, New York (2000)
Kelmans, A.K., Kimelfeld, B.N.: Multiplicative submodularity of a matrix?s principal minor as a function of the set of its rows and some combinatorial applications. Discret. Math. 44(1), 113–116 (1980)
Ko, C.-W., Lee, J., Queyranne, M.: An exact algorithm for maximum entropy sampling. Oper. Res. 43(4), 684–691 (1995)
Krause, A.: SFO: a toolbox for submodular function optimization. J. Mach. Learn. Res. 11, 1141–1144 (2010)
Krause, A., Guestrin, C.: Beyond convexity: submodularity in machine learning (2013). http://submodularity.org/
Laurent, M.: Semidefinite relaxations for max-cut. In: The Sharpest Cut. MPS/SIAM Series on Optimization, pp. 257–290. SIAM, Philadelphia (2004)
Le, N.D., Zidek, J.V.: Statistical analysis of environmental space-time processes. Springer Series in Statistics. Springer, New York (2006)
Lee, J.: Discussion on: ‘A state-space-model approach to optimal spatial sampling design based on entropy’. Environ. Ecol. Stat. 5, 45–46 (1998)
Lee, J.: Constrained maximum-entropy sampling. Oper. Res. 46, 655–664 (1998)
Lee, J.: Semidefinite programming in experimental design. In: Wolkowicz, H., Saigal, R., Vandenberghe, L. (eds.) Handbook of Semidefinite Programming. International Series in Operations Research and Management Science, vol. 27. Kluwer, Boston (2000)
Lee, J.: Maximum entropy sampling. In: El-Shaarawi, A.H., Piegorsch, W.W. (eds.) Encyclopedia of Environmetrics, 2nd edn., vol. 3, pp. 1570–1574. Wiley, Chichester (2012)
Lee, J.: A First Course in Combinatorial Optimization. Cambridge University Press, Cambridge/New York (2004)
Lee, J., Williams, J.: A linear integer programming bound for maximum-entropy sampling. Math. Program. B 94, 247–256 (2003)
Lee, J., Sviridenko, M., Vondrák, J.: Submodular maximization over multiple matroids via generalized exchange properties. In: Dinur, I., Jansen, K., Naor, S., Rolim, J.D.P. (eds.) Proceedings of APPROX 2009, 12th International Workshop, Berkeley, 21–23 Aug 2009. Lecture Notes in Computer Science, vol. 5687, pp. 244–257. Springer (2009)
Lee, J., Mirrokni, V.S., Nagarajan, V., Sviridenko, M.: Non-monotone submodular maximization under matroid and knapsack constraints. In: Proceedings of the 41st Annual ACM Symposium on Theory of Computing STOC 2009, Bethesda, pp. 323–332 (2009)
Lee, J., Sviridenko, M., Vondrák, J.: Approximate maximization of a submodular function over multiple matroids via generalized exchange properties. Math. Oper. Res. 35(4), 795–806 (2010)
Lee, J., Mirrokni, V.S., Nagarajan, V., Sviridenko, M.: Maximizing non-monotone submodular functions under matroid and knapsack constraints. SIAM J. Discret. Math. 23(4), 2053–2078 (2010)
Lehmann, B., Lehmann, D.J., Nisan, N.: Combinatorial auctions with decreasing marginal utilities (journal version). Games Econ. Behav. 55, 270–296 (2006)
NADP/NTN website (2013). http://nadp.sws.uiuc.edu
Narayanan, H.: Submodular functions and electrical networks. Annals of Discrete Mathematics, vol. 54. North-Holland, Amsterdam (1997)
Nemhauser, G.L., Wolsey, L.A., Fisher, M.: An analysis of approximations for maximizing submodular set functions. I. Math. Program. 14(3), 265–294 (1978)
Nemhauser, G.L., Wolsey, L.A., Laurence A.: Integer and Combinatorial Optimization. Wiley-Interscience Series in Discrete Mathematics and Optimization. Wiley, New York (1988)
Oppenheim, A.: Inequalities connected with definite Hermitian forms. J. Lond. Math. Soc. 5, 114–119 (1930)
Poljak, S., Rendl, F.: Solving the max-cut problem using eigenvalues. Special volume on partitioning and decomposition in combinatorial optimization. Discret. Appl. Math. 62(1–3), 249–278 (1995)
Recski, A.: Matroid theory and its applications in electric network theory and in statics. Algorithms and Combinatorics, vol. 6. Springer, Berlin (1989)
Rendl, F., Rinaldi, G., Wiegele, A.: Solving max-cut to optimality by intersecting semidefinite and polyhedral relaxations. Math. Program. A 121 (2), 307–335 (2010)
Rendl, F., Rinaldi, G., Wiegele, A.: Biq mac solver – binary quadratic and max cut solver (2013). http://biqmac.uni-klu.ac.at/
Schrijver, A.: A combinatorial algorithm minimizing submodular functions in strongly polynomial time. J. Comb. Theory B 80(2), 346–355 (2000)
Semple, C.: Submodular functions and biodiversity conservation (2010). http://www-theory.phys.utas.edu.au/phylomania2010/website/2010/slides/slides/Semplehobart10.pdf
Shewry, M.C., Wynn, H.P.: Maximum entropy sampling. J. Appl. Stat. 14, 165–170 (1987)
Sviridenko, M.: A note on maximizing a submodular set function subject to knapsack constraint. Oper. Res. Lett. 32, 41–43 (2004)
Wu, S., Zidek, J.V.: An entropy based review of selected NADP/NTN network sites. Atmos. Environ. 26A, 2089–2103 (1992)
Acknowledgements
Partially supported by NSF Grant CMMI–1160915.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Lee, J. (2013). Techniques for Submodular Maximization. In: Bezdek, K., Deza, A., Ye, Y. (eds) Discrete Geometry and Optimization. Fields Institute Communications, vol 69. Springer, Heidelberg. https://doi.org/10.1007/978-3-319-00200-2_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-00200-2_10
Published:
Publisher Name: Springer, Heidelberg
Print ISBN: 978-3-319-00199-9
Online ISBN: 978-3-319-00200-2
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)