Advertisement

© 2020

Beginning Apache Spark Using Azure Databricks

Unleashing Large Cluster Analytics in the Cloud

Book

Table of contents

  1. Front Matter
    Pages i-xvii
  2. Robert Ilijason
    Pages 1-14
  3. Robert Ilijason
    Pages 15-25
  4. Robert Ilijason
    Pages 27-38
  5. Robert Ilijason
    Pages 39-49
  6. Robert Ilijason
    Pages 51-73
  7. Robert Ilijason
    Pages 75-102
  8. Robert Ilijason
    Pages 103-137
  9. Robert Ilijason
    Pages 139-175
  10. Robert Ilijason
    Pages 177-199
  11. Robert Ilijason
    Pages 201-226
  12. Robert Ilijason
    Pages 227-267
  13. Back Matter
    Pages 269-274

About this book

Introduction

Analyze vast amounts of data in record time using Apache Spark with Databricks in the Cloud. Learn the fundamentals, and more, of running analytics on large clusters in Azure and AWS, using Apache Spark with Databricks on top. Discover how to squeeze the most value out of your data at a mere fraction of what classical analytics solutions cost, while at the same time getting the results you need, incrementally faster.

This book explains how the confluence of these pivotal technologies gives you enormous power, and cheaply, when it comes to huge datasets. You will begin by learning how cloud infrastructure makes it possible to scale your code to large amounts of processing units, without having to pay for the machinery in advance. From there you will learn how Apache Spark, an open source framework, can enable all those CPUs for data analytics use. Finally, you will see how services such as Databricks provide the power of Apache Spark, without you having to know anything about configuring hardware or software. By removing the need for expensive experts and hardware, your resources can instead be allocated to actually finding business value in the data.

This book guides you through some advanced topics such as analytics in the cloud, data lakes, data ingestion, architecture, machine learning, and tools, including Apache Spark, Apache Hadoop, Apache Hive, Python, and SQL. Valuable exercises help reinforce what you have learned.

What You Will Learn

  • Discover the value of big data analytics that leverage the power of the cloud
  • Get started with Databricks using SQL and Python in either Microsoft Azure or AWS
  • Understand the underlying technology, and how the cloud and Spark fit into the bigger picture
  • See how these tools are used in the real world
  • Run basic analytics, including machine learning, on billions of rows at a fraction of a cost or free

This book is for data engineers, data scientists, and cloud architects who want or need to run advanced analytics in the cloud. It is assumed that the reader has data experience, but perhaps minimal exposure to Apache Spark and Azure Databricks. The book is also recommended for people who want to get started in the analytics field, as it provides a strong foundation.

Robert Ilijason is a 20-year veteran in the business intelligence (BI) segment. He has worked as a contractor for some of Europe’s biggest companies and has conducted large-scale analytics projects within the areas of retail, telecom, banking, government, and more. Robert has seen his share of analytic trends come and go over the years, but unlike most of them, he strongly believes that Apache Spark in the cloud, especially with Azure Databricks, is a game changer.

Keywords

Azure Spark Cloud Analytics Advanced Analytics Spark High Performance Analytics Microsoft Azure and Data Hadoop Analyzing Data Data lake Analytics HDInsight Azure Data Lake AWS and Data

Authors and affiliations

  1. 1.VikenSweden

About the authors

Robert Ilijason is a 20-year veteran in the business intelligence (BI) segment. He has worked as a contractor for some of Europe’s biggest companies and has conducted large-scale analytics projects within the areas of retail, telecom, banking, government, and more. He has seen his share of analytic trends come and go over the years, but unlike most of them, he strongly believes that Apache Spark in the cloud, especially with Azure Databricks, is a game changer.

Bibliographic information

Industry Sectors
Biotechnology
Engineering