This course is designed to build your foundational skills in data engineering on Microsoft Fabric, focusing on the Lakehouse concept. This course will explore the powerful capabilities of Apache Spark for distributed data processing and the essential techniques for efficient data management, versioning, and reliability by working with Delta Lake tables. This course will also explore data ingestion and orchestration using Dataflows Gen2 and Data Factory pipelines. This course includes a combination of lectures and hands-on exercises that will prepare you to work with lakehouses in Microsoft Fabric. Module 1: Introduction to end-to-end analytics using Microsoft FabricDescribe end-to-end analytics in Microsoft FabricModule 2: Get started with lakehouses in Microsoft FabricDescribe core features and capabilities of lakehouses in Microsoft FabricCreate a lakehouseIngest data into files and tables in a lakehouseQuery lakehouse tables with SQLModule 3: Use Apache Spark in Microsoft FabricConfigure Spark in a Microsoft Fabric workspaceIdentify suitable scenarios for Spark notebooks and Spark jobsUse Spark dataframes to analyze and transform dataUse
