The PASS Business Analytics Group provides virtual training on the tools and architecture patterns required to create world-class Business Analytics solutions.

Sign in to Subscribe

Meeting Details

From ETL to Data Engineering with Azure Data Factory with Simon Whiteley

Tue, Jul 30 2019 17:00 UTC

From ETL to Data Engineering with Azure Data Factory

Modern Azure Data Factories are lean, efficient data pipelines, fully parameterised, dynamic and hugely scalable, but where do you start and how do you get there? This session will take you from an ADF newbie to a lean, mean, pipeline writing machine. We'll talk about scalability, patterns for success and how to model some common scenarios. We'll look at how these features change our working patterns and change how you should think about ETL in the modern data platform. This session will demonstrate some of the new features in ADFV2 and discuss how they can be used to streamline your factories, putting them in the context of real-world solutions. We will also look at the new compute options provided by ADF Mapping Data Flows, review how it interacts with Azure Databricks and set you up for truly cloud-native ETL!

Simon Whiteley

Simon Whiteley is the Director of Engineering for Advancing Analytics Ltd and a Microsoft Data Platform MVP. Simon is a seasoned solution architect and technical lead with well over a decade of Microsoft Analytics experience. A deep techie with a focus on emerging cloud technologies and applying "big data" thinking to traditional analytics problems, Simon also has a passion for bringing it back to the high level and making sense of the bigger picture. When not tinkering with tech, Simon is a death-dodging London cyclist, a sampler of craft beers, an avid chef, and a generally nerdy person.

Back to Top