Overview
- Contains implementation examples starting from the first chapter
- Demonstrates ADF concepts through their practical application
- Draws parallels that help SSIS veterans adapt to using ADF
Access this book
Tax calculation will be finalised at checkout
Other ways to access
About this book
Data engineers who need to hit the ground running will use this book to build skills in Azure Data Factory v2 (ADF). The tutorial-first approach to ADF taken in this book gets you working from the first chapter, explaining key ideas naturally as you encounter them. From creating your first data factory to building complex, metadata-driven nested pipelines, the book guides you through essential concepts in Microsoft’s cloud-based ETL/ELT platform. It introduces components indispensable for the movement and transformation of data in the cloud. Then it demonstrates the tools necessary to orchestrate, monitor, and manage those components.
This edition, updated for 2024, includes the latest developments to the Azure Data Factory service:
What You Will Learn
Who This Book Is For
Data engineers and ETL developers taking their first steps in Azure Data Factory, SQL Server Integration Services users making the transition toward doing ETL in Microsoft’s Azure cloud, and SQL Server database administrators involved in data warehousing and ETL operations
This edition, updated for 2024, includes the latest developments to the Azure Data Factory service:
- Enhancements to existing pipeline activities such as Execute Pipeline, along with the introduction of new activities such as Script, and activities designed specifically to interact with Azure Synapse Analytics.
- Improvements to flow control provided by activity deactivation and the Fail activity.
- The introduction of reusable data flow components such as user-defined functions and flowlets.
- Extensions to integration runtime capabilities including Managed VNet support.
- The ability to trigger pipelines in response to custom events.
- Tools for implementing boilerplate processes such as change data capture and metadata-driven data copying.
What You Will Learn
- Create pipelines, activities, datasets, and linked services
- Build reusable components using variables, parameters, and expressions
- Move data into and around Azure services automatically
- Transform data natively using ADF data flows and Power Query data wrangling
- Master flow-of-control and triggers for tightly orchestrated pipeline execution
- Publish and monitor pipelines easily and with confidence
Who This Book Is For
Data engineers and ETL developers taking their first steps in Azure Data Factory, SQL Server Integration Services users making the transition toward doing ETL in Microsoft’s Azure cloud, and SQL Server database administrators involved in data warehousing and ETL operations
Similar content being viewed by others
Table of contents (13 chapters)
Authors and affiliations
About the author
​Richard Swinbank is a data engineer and Microsoft Data Platform MVP. He specializes in building and automating analytics platforms using Microsoft technologies from the SQL Server stack to the Azure cloud. He is a fervent advocate of DataOps, with a technical focus on bringing automation to both analytics development and operations. An active member of the data community and keen knowledge-sharer, Richard is a volunteer, organizer, speaker, blogger, open source contributor, and author. He holds a PhD in computer science from the University of Birmingham (UK).
Accessibility information
PDF accessibility summary
This PDF does Not fully comply with PDF/UA standards but does include limited screen reader support, descriptions for Non-text content (such as images and graphs), bookmarks for easy navigation, and searchable, selectable text. Users of assistive technologies may experience difficulty navigating or interpreting content in this document. We recognise the importance of accessibility and welcome queries about accessibility for any of our products. If you have a question or an access need, please get in touch with us via https://www.springernature.com/gp/info/accessibility
EPUB accessibility summary
This EPUB has been designed with accessibility in mind and aims to meet the EPUB Accessibility 1.0 and WCAG 2.2 Level AA standards. Its features include Alternative Text descriptions for images and other Non-text content, as well as rich navigation that is compatible with screen readers. We recognise the importance of accessibility and welcome queries about accessibility for any of our products. If you have a question or an access need, please get in touch with us via https://www.springernature.com/gp/info/accessibility
Bibliographic information
Book title: Azure Data Factory by Example
Book subtitle: Practical Implementation for Data Engineers
Authors: Richard Swinbank
DOI: https://doi.org/10.1007/979-8-8688-0218-8
Publisher: Apress Berkeley, CA
eBook packages: Professional and Applied Computing, Apress Access Books, Professional and Applied Computing (R0)
Copyright information: Richard Swinbank 2024
Softcover ISBN: 979-8-8688-0217-1Published: 23 March 2024
eBook ISBN: 979-8-8688-0218-8Published: 22 March 2024
Edition number: 2
Number of pages: XXIII, 421
Number of illustrations: 206 b/w illustrations
Topics: Microsoft and .NET, Database Management