Advertisement

© 2020

PolyBase Revealed

Data Virtualization with SQL Server, Hadoop, Apache Spark, and Beyond

Benefits

  • Helps you remain relevant through your existing T-SQL skills

  • Aids in mastering an important new product line from Microsoft

  • Covers data sources such as Apache Hadoop, Azure Blob Storage, Apache Spark, Cosmos DB, and more

Book

Table of contents

  1. Front Matter
    Pages i-xix
  2. Kevin Feasel
    Pages 1-31
  3. Kevin Feasel
    Pages 33-62
  4. Kevin Feasel
    Pages 63-93
  5. Kevin Feasel
    Pages 151-182
  6. Kevin Feasel
    Pages 205-231
  7. Kevin Feasel
    Pages 233-249
  8. Kevin Feasel
    Pages 289-304
  9. Back Matter
    Pages 305-311

About this book

Introduction

Harness the power of PolyBase data virtualization software to make data from a variety of sources easily accessible through SQL queries while using the T-SQL skills you already know and have mastered.

PolyBase Revealed shows you how to use the PolyBase feature of SQL Server 2019 to integrate SQL Server with Azure Blob Storage, Apache Hadoop, other SQL Server instances, Oracle, Cosmos DB, Apache Spark, and more. You will learn how PolyBase can help you reduce storage and other costs by avoiding the need for ETL processes that duplicate data in order to make it accessible from one source. PolyBase makes SQL Server into that one source, and T-SQL is your golden ticket. The book also covers PolyBase scale-out clusters, allowing you to distribute PolyBase queries among several SQL Server instances, thus improving performance.

With great flexibility comes great complexity, and this book shows you where to look when queries fail, complete with coverage of internals, troubleshooting techniques, and where to find more information on obscure cross-platform errors. Data virtualization is a key target for Microsoft with SQL Server 2019. This book will help you keep your skills current, remain relevant, and build new business and career opportunities around Microsoft’s product direction.

You will:

  • Install and configure PolyBase as a stand-alone service, or unlock its capabilities with a scale-out cluster
  • Understand how PolyBase interacts with outside data sources while presenting their data as regular SQL Server tables
  • Write queries combining data from SQL Server, Apache Hadoop, Oracle, Cosmos DB, Apache Spark, and more
  • Troubleshoot PolyBase queries using SQL Server Dynamic Management Views
  • Tune PolyBase queries using statistics and execution plans
  • Solve common business problems, including "cold storage" of infrequently accessed data and simplifying ETL jobs

Keywords

PolyBase SQL Server 2019 Big Data Data Virtualization External Tables External File Formats External Pushdown Polyglot Data Massively Parallel Processing (MPP) Hadoop Apache Spark MongoDB Oracle T-SQL Teradata Azure Blob Storage Predicate Pushdown CosmosDB Azure SQL Data Warehouse Dynamic Management Views

Authors and affiliations

  1. 1.DurhamUSA

About the authors

Kevin Feasel is a Microsoft Data Platform MVP and CTO at Envizage where he specializes in T-SQL and R development, forcing Spark clusters to do his bidding, fighting with Kafka, and pulling rabbits out of hats on demand. He is the lead curator at Curated SQL (curatedsql.com). A resident of Durham, North Carolina, USA, Kevin can be found cycling the trails along the Triangle whenever the weather is nice enough.

 


Bibliographic information

Industry Sectors
Automotive
Chemical Manufacturing
Biotechnology
IT & Software
Telecommunications
Consumer Packaged Goods
Engineering
Pharma
Materials & Steel
Finance, Business & Banking
Electronics
Energy, Utilities & Environment
Aerospace