Skip to content

MirriamKM/DP-203

BranchesTags
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

123 Commits
01 - Introduction
01 - Introduction
 
 
02 - Brief history of data architectures
02 - Brief history of data architectures
 
 
03 - Storage account overview
03 - Storage account overview
 
 
04 - Storage account redundancy
04 - Storage account redundancy
 
 
05 - Storage account access tiers
05 - Storage account access tiers
 
 
06 - Common file types (CSV, XML, JSON)
06 - Common file types (CSV, XML, JSON)
 
 
07 - Common file types - PARQUET
07 - Common file types - PARQUET
 
 
08 - Common file types - Delta lake
08 - Common file types - Delta lake
 
 
09 - Data lake structure - Raw layer
09 - Data lake structure - Raw layer
 
 
10 - Introduction to Azure Data Factory
10 - Introduction to Azure Data Factory
 
 
11 - Dynamic ADF
11 - Dynamic ADF
 
 
12 - ADF integration runtimes (part 1)
12 - ADF integration runtimes (part 1)
 
 
13 - ADF integration runtimes (part 2)
13 - ADF integration runtimes (part 2)
 
 
14 - ADF error handling
14 - ADF error handling
 
 
15 - Questions to ask about new data source
15 - Questions to ask about new data source
 
 
16 - Executing ADF pipelines
16 - Executing ADF pipelines
 
 
17 - Data lake security - anonymous access, access keys
17 - Data lake security - anonymous access, access keys
 
 
18 - Data lake security - Key Vault, managed identities
18 - Data lake security - Key Vault, managed identities
 
 
19 - Data lake security - shared access signature
19 - Data lake security - shared access signature
 
 
20 - Data lake security - role-based access control
20 - Data lake security - role-based access control
 
 
21 - Data lake security - access control lists
21 - Data lake security - access control lists
 
 
22 - ARM-based CICD for ADF (part 1)
22 - ARM-based CICD for ADF (part 1)
 
 
23 - ARM-based CICD for ADF (part 2)
23 - ARM-based CICD for ADF (part 2)
 
 
24 - Selective CICD for ADF with ADF Tools (part 1)
24 - Selective CICD for ADF with ADF Tools (part 1)
 
 
25 - Selective CICD for ADF with ADF Tools (part 2)
25 - Selective CICD for ADF with ADF Tools (part 2)
 
 
26 - Introduction to Logic Apps
26 - Introduction to Logic Apps
 
 
27 - Azure Synapse Analytics - Overview, Pipelines
27 - Azure Synapse Analytics - Overview, Pipelines
 
 
28 - Milestone 1 - Ingest phase recapped, challenge
28 - Milestone 1 - Ingest phase recapped, challenge
 
 
29 - Introduction to dimensional modelling
29 - Introduction to dimensional modelling
 
 
30 - Slowly changing dimensions, data lake layers
30 - Slowly changing dimensions, data lake layers
 
 
31 - Introduction to Azure Databricks
31 - Introduction to Azure Databricks
 
 
32 - A closer look at Databricks notebooks
32 - A closer look at Databricks notebooks
 
 
33 - Connecting to ADLSg2 from Azure Databricks
33 - Connecting to ADLSg2 from Azure Databricks
 
 
34 - Common data transformations
34 - Common data transformations
 
 
35 - Writing data to ADLSg2
35 - Writing data to ADLSg2
 
 
36 - Azure Databricks Autoloader
36 - Azure Databricks Autoloader
 
 
37 - Orchestrating Databricks notebooks
37 - Orchestrating Databricks notebooks
 
 
38 - Introduction to dbt
38 - Introduction to dbt
 
 
39 - Azure Synapse Analytics - Spark Pools
39 - Azure Synapse Analytics - Spark Pools
 
 
40 - Azure Synapse Analytics - Spark Pools additional features
40 - Azure Synapse Analytics - Spark Pools additional features
 
 
41 - Transforming data with data flows
41 - Transforming data with data flows
 
 
42 - 2nd milestone
42 - 2nd milestone
 
 
43 - Azure Synapse Analytics - Dedicated SQL Pool
43 - Azure Synapse Analytics - Dedicated SQL Pool
 
 
44 - Loading data to Dedicated SQL Pool
44 - Loading data to Dedicated SQL Pool
 
 
45 - Additional features in Dedicated SQL Pool
45 - Additional features in Dedicated SQL Pool
 
 
46 - Synapse Dedicated SQL Pool security
46 - Synapse Dedicated SQL Pool security
 
 
47 - Azure Synapse Analytics - Serverless SQL Pool
47 - Azure Synapse Analytics - Serverless SQL Pool
 
 
48 - Milestone 3 - Serve phase recapped
48 - Milestone 3 - Serve phase recapped
 
 
49 - Introduction to streaming and Event Hubs
49 - Introduction to streaming and Event Hubs
 
 
50 - Stream Analytics overview
50 - Stream Analytics overview
 
 
51 - Time and performance in Stream Analytics
51 - Time and performance in Stream Analytics
 
 
52 - Data governance with Microsoft Purview
52 - Data governance with Microsoft Purview
 
 
53 - Milestone 4 - Streaming and data governance
53 - Milestone 4 - Streaming and data governance
 
 
README.md
README.md
 
 

Repository files navigation

Hi there,

This is a repository for my YouTube course about Data Enginering on Microsoft Azure.

Have fun!

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 98.3%
  • Python 1.4%
  • TSQL 0.3%