Data Engineering Learning Path (English)

Description

In the Data Engineering program, we help you take the next step as a Data Engineer:

• For example, from on-premises to the cloud
• .. or from an RDBMS to a data platform such as Databricks, Snowflake, or Fabric

Each week we cover an important topic within Data Engineering and work on it hands-on. By the end, you will have built a Proof of Concept of a data platform and significantly broadened and deepened your Data Engineering knowledge.

Who is the Data Engineering program for?

Participants in this training come from different backgrounds and roles:

• On-premises Data Warehouse specialists: As a BI or Data Warehouse engineer, you are well-versed in traditional Data Warehouses. However, you also see the limitations of on-premises environments and want to help your organization move analytics environments to the cloud.
• Power BI Professionals. You have worked with Power BI for years. But you know and recognize that larger challenges require other tools. That is why you want to transition into Data Engineering.
• Experienced developers You already have experience in software development and want to transition into Data Engineering.
• Data Engineers. You already manage a cloud environment and have contributed to developing a solution. But times are changing, and you want to move to a new platform and/or a modern architecture.

This applies to every participant: your world is changing, and you want to grow. You also want to apply what you learn, rather than keeping it theoretical. And we will help you achieve that.

Objectives

After completing this program:

• You will understand various solution architectures currently in use and how they translate into cloud solutions
• You will understand the differences between design choices for various types of data platforms.
• You will be familiar with processes and prerequisites for a successful Data Platform project, such as security and proper development practices
• You will be able to evaluate different products for a data scenario that you brought to the course
• You will have built a Proof of Concept, setting up the configuration, ingestion, transformation, and orchestration yourself.

Prerequisites for attending the Data Engineering program

In this training, you need prior knowledge of the principles of Business Intelligence and Data Warehousing. This experience may come from previous experience with the SQL Server stack, or broad experience with Power BI.

Topics

In this program, you can choose which technology you want to specialize in by selecting a "stream". The streams we offer are:

• Stream 1: Snowflake
• Stream 2: Databricks
• Stream 3: Microsoft Fabric

The Data Engineering program consists of 5 weeks, divided into the following modules. Each week you prepare for the training day. This allows room on the training day for deeper learning, discussions, conversations, and working on your Proof of Concept.

• Architecture and design
  • Cloud architecture
  • Designing a Data Platform
  • Federated Governance
  • Collaboration
  • Data Warehousing
  • Lakehouses and the Medallion architecture
  • Data Fabric
  • Data Mesh
• Setting up your cloud platform
• Ingestion, orchestration, and exposing data sources
  • Azure Data Factory
  • External Stages in Snowflake
  • Working with APIs
• Transformation and Analytics Engineering
  • ETL/ELT
  • Data Factory
  • dbt
  • Databricks Jobs and Notebooks
  • Snowflake Tasks and Streams
• Completing the Proof of Concept and broadening / deepening knowledge. Possible topics:
  • Security and networking
  • Infrastructure as Code
  • Streaming Data

All topics are approached from a Data Engineering perspective. Not only is it important how to use a tool, but also how it fits into the broader data landscape and how the overall solution remains maintainable.

Study materials

In the Data Engineering program, we use materials developed in-house by Wortell Smart Learning. This includes slides, assignments during training days, and assignments between sessions. We also provide ample material to help you deepen or broaden your knowledge. We ensure you receive all necessary materials on time.