Large-Scale and Distributed Optimization: An Introduction

Abstract

The recent explosion in size and complexity of datasets and the increased availability of computational resources has led us to what is sometimes called the big data era. In many big data fields, mathematical optimization has over the last decade emerged as a vital tool in extracting information from the data sets and creating predictors for unseen data. The large dimension of these data sets and the often parallel, distributed, or decentralized computational structures used for storing and handling the data, set new requirements on the optimization algorithms that solve these problems. This has led to a dramatic shift in focus in the optimization community over this period. Much effort has gone into developing algorithms that scale favorably with problem dimension and that can exploit structure in the problem as well as the computational environment. This is also the main focus of this book, which is comprised of individual chapters that further contribute to this development in different ways. In this introductory chapter, we describe the individual contributions, relate them to each other, and put them into a wider context.