0% found this document useful (0 votes)
56 views122 pages

2023-IDA Custom Bootcamp Curriculum Day Wise Curriculum v0.1

2023-IDA_Custom_Bootcamp_Curriculum_day_wise_curriculum_v0.1

Uploaded by

babjeereddy
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
56 views122 pages

2023-IDA Custom Bootcamp Curriculum Day Wise Curriculum v0.1

2023-IDA_Custom_Bootcamp_Curriculum_day_wise_curriculum_v0.1

Uploaded by

babjeereddy
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as XLSX, PDF, TXT or read online on Scribd
You are on page 1/ 122

Topics

Data Fundamentals (DBMS/ DWH/


Datalakes) and Big Data Fundamentals
Azure Fundamentals

Azure SQL

Azure Storage Types

Azure Data Factory


Azure Synapse Analytics
Focus more on SQL DW (Dedicated pool) &
overview of Serverless

Data Visualisation using Power BI

Python
Pyspark
Azure Databricks
Azure Containers : Containerization with
Docker and Kubernetes in Azure

Azure Deployment/Devops

Azure ML Studio

Power Platform (More focus on PowerApps)

Case study overview and implementation

Case Study Demo


Custom Bootcamp - 2023
Training Duration

3
3
2

2.5

0.5
28
amp - 2023
Assessment + Hands On*
Assessment 1 :Data Fundamentals ,Big Data concepts and Azure Fundamentals .
Hands On: Must

Assessment 2 : Azure SQL


Hands On: Must
Assessment 3 : Azure Storage Types
Hands On: Must

Assessment 4 : Azure Data Factory & SQL DWH


Hands On: Must

Assessment 5 : Power BI
Hands On: Must

Assessment 5: Python, PySpark, Azure Databricks


Hands On: Must

Assessment 6: Containers, DevOps, Azure MLStudio


Hands On: Must

Hands On: Must

Assessment 7: Case Study implementation ; Case study & Content – Unext to create
10-12 case studies -> Case study content review by Shell
Case Study Demo

*Hands on: Hands-on training means practical experience i.e. training


in a simulated work environment that permits each student to have
experience performing tasks. Manipal to give exercises to participants
to get practical experience
Day Topic
1 Data Fundamentals (DBMS/ DWH/
Datalakes) and Big Data
Fundamentals
2
Data Fundamentals (DBMS/ DWH/
Datalakes) and Big Data
Fundamentals
Azure Fundamentals

Azure SQL

Azure SQL

5
Azure Storage Types

6
Azure Storage Types

Azure Data Factory


8

Azure Data Factory

Azure Data Factory

10

Azure Synapse Analytics


11

12
Data Visualisation using Power BI

13

Python
14

Python

15

16

Pyspark
17

Pyspark

18

19

Core Databricks
20

Core Databricks

21

Azure Containers
22
Azure Deployment/Devops

23

24

Azure ML Studio
25

Power Platform
26. ,27, 28

Case study - implementation (2.5


hrs)

28 Case study - implementation


Case study - Demo (0.5 hr)
Modules
ER Modelling and Normalization (Different types)
Understand the Cardinality concepts
Dimensional Modeling concepts: Star Schema, Snowflake, Denormalization, SCD
Overview on Bigdata - Structured, unstructured, semistructured
Tools used to solve the problem of Big data
Datalakes , Deltalakes Architecture, Data Lakehouse concepts, Describe general security and
network security features
Describe identity, governance, privacy, and compliance features

Introduction
Schemas, DML, DDL
Create, Alter, Drop
Grant, Revoke
Working with DMLs
Insert, Update, Delete, Truncate
Group by, Having
Sorting, Filtering

Joins Concept and different type of Joins


Subqueries
Tables , Views - working with Views
Stored Procedures and Functions - overview
Indexes(Heaps, Clustered and Non clustered Indexes, Column store indexes)

Overview of various Storage Types in Azure (File formats and supported types , Blob , Queue ,
tables)

Storage accounts , Data Lake Gen 2 , BLOB


(Overview , container concept , access and authorisations, creation of resources , upload data into
Data Lake)
ADF: Introduction
(What Is Azure Data Factory? Why We Need It? How does Data Factory work?Key
Components of Azure Data Factory ELT Vs ETL, data sets , Integration run time ,
parameters ,system variables , pipeline)
Understand ADF components
Copy Data Flow activity in ADF
• Azure Data Factory Instance
• How to Connect to Azure SQL Data Base from On-Premise
• Linked Services
• Input & Output Data Set in Azure Data Factory
Control Flow Activity
• Get Metadata Activity
• Filter Activity
• If Activity
• Append Activity
• Wait Activity
• ForEach Loop Activity
• Lookup Activity

Dataflow Transformation
• Source Transformation
• Sink Transformation
• Conditional Split Transformation
• Derived Column Transformation

Integrate ADF with Databricks


Error and Exception handling
Debugging
Scheduling
Alerts
Monitor
• Monitor Visually
Azure Monitor

SQL DW (Dedicated Pool): Introduction to Azure Synapse Analytics SQL Data Warehouse,
Understand the key features and benefits of SQL DW, Learn about the distributed architecture and
MPP capabilities, Provisioning a SQL Data Warehouse, Create a dedicated SQL DW instance in the
Azure portal,Configure the necessary settings, such as , performance tiers and storage options,
Data Ingestion and Preparation, Use Azure Data Factory to ingest data from various sources into
SQL DW, Perform data preparation tasks like schema modifications and data transformations,
Querying and Analyzing Data, Explore the SQL DW interface and query editorWrite and execute
SQL queries to analyze data , stored in SQL DW, Understand query performance optimization
techniques.
Serverless: Introduction to Azure Synapse Analytics Serverless, Understand the key features and
benefits of the serverless option, Learn about the query execution model and cost considerations,
Querying Data with Serverless

Explore the Azure Synapse Studio interface.


Connect to the serverless option and execute SQL queries.
Analyze and visualize the query results using built-in tools.
Understanding Power BI and exploring its interface
Power BI Data source connection - Connecting to various sources (CSV, Excel etc), Data loading and
transformation -Eliminating duplicates, Slicers, handling dates, groups, replacing values and
parameters, Introduction to DAX & Calculated Columns, Implicit and Explicit Measures.

Row level security and Aggregation Functions, Understanding various chart types
Generating native visualizations based on the queries and data model - 1, Generating native
visualizations based on the queries and data model - 2, Univariate analysis & Bivariate analysis,
Reports and Dashboard in Power BI, Power BI Mobile & Recap.

Python Basics Part 1:

• Integers and Floating-Point Numbers in Python


• Strings in Python
• Boolean values in Python
• Arithmetic operators in Python
• Comparison Operator in Python
• Logical Operators in Python
• Membership Operator in Python
• String formatting in Python
• Lists in Python
• Tuples in Python
• Dictionaries in Python
• Zip() Function in Python
• Enumerate() Function in Python
• Counter() Function in Python
• If-else Statements in Python
• Range() Function in Python
• User Defined Functions in Python
Advanced:
• Functions
• Positional and keyword arguments
• *args and **kwargs
• Classes
• List Comprehension
• Lambda Functions

• Panda Data frame, Series, Lists, Numpy Array, Dictionaries, Sets, Tuples
• Map
• Numpy, Pandas, Matplotlib, Scipy, Scikit-learn

Introduction , Overview and Installation


Spark Architecture - Dataframe, Dataset, Clusters, Notebooks, Spark programing - Python, Cluster
management
Azure Databricks Architecture - understand architecture of ADB spark cluster,Read and write Data
in Databricks, UDF Components of Spark & Spark Architecture , Job
Lifecycle in Spark , Applications of Spark , Apache Spark use cases
RDD concepts overview
Data Frame
Pyspark SQL
Common File Handling operations(read , write , filter , append etc)
Handling different file formats through Pyspark

CRUD operations
Data Cleaning
Data Transformation

Data Ingestion and Exploration:


Importing and exploring data in Databricks
Reading data from various sources (e.g., CSV, JSON, Parquet)
Performing basic data exploration and visualization

Data Transformations with Spark:


Introduction to Apache Spark and its role in Databricks
Using DataFrames and Spark SQL for data transformations
Applying common transformations like filtering, aggregating, and joining data

Databricks Libraries and Job Scheduling:


Working with libraries in Databricks
Installing and managing external libraries
Scheduling and running jobs for automated data processing
Databricks Deployment and Integration

Deploying Databricks notebooks and clusters:


Integrating Databricks with other Azure services (e.g., Azure Storage, Azure Data Lake)
Best practices for deploying Databricks applications in production
Introduction to Databricks Delta Tables
a. Overview of Databricks and Delta Lake
b. Benefits of Delta Tables over traditional data storage formats
c. Key features and concepts of Delta Tables

Delta Table Architecture


a. Understanding the ACID properties (Atomicity, Consistency, Isolation, Durability)
b. Versioning and transaction log
c. Schema evolution and data lifecycle management

Working with Delta Tables


a. Creating Delta Tables
i. Schema definition
ii. Partitioning and clustering
b. Data ingestion into Delta Tables
i. Batch and streaming data ingestion
ii. Supported file formats and compression techniques
c. Querying Delta Tables
i. SQL and DataFrame API
ii. Optimizations and performance tuning
d. Updating and deleting data in Delta Tables
e. Handling schema evolution and table maintenance

Data Quality and Reliability


a. Data integrity and consistency checks
b. Data validation and schema enforcement
c. Time travel and versioning capabilities
d. Optimistic concurrency control and isolation levels

Best Practices and Advanced Topics


a. Performance optimization techniques
b. Delta Table partitioning and clustering strategies
c. Optimizing for streaming data ingestion
d. Integrating Delta Tables with MLflow and ML workloads
e. Data governance and security considerations

Recap and Q&A


a. Summary of key concepts and takeaways
b. Addressing participant questions and concerns

Introduction to Containers and Containerization


a. Overview of containerization and its benefits
b. Introduction to Docker and Kubernetes
c. Understanding the role of containers in modern application development

Docker Fundamentals
a. Introduction to Docker and its architecture
b. Docker images and containers
c. Dockerfile: Creating custom Docker images
d. Docker commands and basic operations
e. Docker Registry: Pushing and pulling images

Docker in Azure
a. Introduction to Azure Container Registry (ACR)
b. Setting up an ACR and managing container images
c. Deploying Docker containers in Azure App Service
d. Container orchestration with Azure Container Instances (ACI)

Introduction to Kubernetes
a. Overview of Kubernetes and its architecture
b. Kubernetes components: Pods, Deployments, Services
c. Understanding Kubernetes objects and their YAML specifications

Kubernetes in Azure
a. Introduction to Azure Kubernetes Service (AKS)
b. Provisioning and managing an AKS cluster
c. Deploying applications using Kubernetes manifests
d. Scaling and updating applications in AKS
Code collaboration (Azure Devops/GitHub) , Github Actions
Azure CICD pipelines , (ADF , Databricks , Database and Power BI)

Introduction to Azure Machine Learning

Overview of Azure Machine Learning services and features


Understanding the benefits of using Azure Machine Learning for managing datasets and
experimentation
Managing Datasets in Azure Machine Learning

Uploading and registering datasets in Azure Machine Learning


Performing data preparation and transformations
Exploring and visualizing datasets using Azure Machine Learning tools
Experimentation and Hyperparameter Tuning

Creating and managing experiments in Azure Machine Learning


Defining and tuning hyperparameters for machine learning models
Tracking and comparing experiment runs
Evaluating and selecting the best-performing model
Pipelines in Azure Machine Learning
Registering and Managing Models

Registering trained models in Azure Machine Learning


Versioning and managing model artifacts
Tracking model metadata and dependencies
Deploying models to Azure services and environments
Model Deployment and Endpoint Management

Creating and deploying model endpoints in Azure Machine Learning


Configuring and managing compute targets for model serving
Testing and monitoring model endpoints
Scaling and updating deployed models
Understanding Compute and Linked Services

Exploring different compute options in Azure Machine Learning


Provisioning and managing compute resources
Configuring compute targets for experimentation and training
Utilizing linked services for data integration and access
Azure ML Studio Designer and AutoML

Introduction to Azure Machine Learning Studio Designer


Building machine learning workflows using drag-and-drop interface
Automating model selection and hyperparameter tuning with AutoML
Deploying and managing models created with AutoML
Introduction to Power Apps
Overview of Power Apps and its capabilities
Understanding canvas apps and model-driven apps
Exploring the Power Apps interface and features
Introduction to data sources and connectors

Building your first Power App:


Creating a new canvas app from a template
Designing the user interface using controls, screens, and forms
Configuring data sources and connecting to external data
Adding formulas and logic to control app behavior
Previewing and testing the app

Advanced App Design:


Customizing app layouts and themes
Working with galleries and data tables
Implementing navigation and app flow
Utilizing controls for media, charts, and maps
Implementing user authentication and security

Data Integration and Flow:


Connecting to various data sources (SharePoint, Excel, SQL, etc.)
Fetching and displaying data from different sources
Creating data connections and gateways
Implementing business logic using formulas
Introduction to Power Automate for app automation

Deployment and Administration:


Publishing and sharing your app with users
Managing permissions and security roles
Monitoring app usage and performance
Troubleshooting common issues
Overview of app lifecycle management
Case Study - Case study should be a industry scenario seeking a Data analytics Solution using
technologies on Azure Cloud. Learners need to go through the case study and create a solution of
the case study which should be something as shown below :-

a)Create a data flow architecture for the use case showing all the technical components that need
to be used .
b)Ingestion Layer - Create Ingestion Pipeline (using Azure Data Factory) to extract data from BLOB
and store it into Data Lake Gen2.
c)Transformation Layer - Create a Transofrmation Pipeline with Databricks Notebook to transform
the data as per the business requirement and store it in Consumption/Curated Layer (Synapse)

d)Curated Layer - Synapse


e)Visualization layer - Create Visualisation on top of the Consumption Layer using Power BI as per
Business requirement
f)Make sure to do unit testing of each Pipeline

g)Make sure to do Integration testing by testing the completed solution together .

h)Schedule the pipelines as per Business requirement

i)Monitor the pipelines


j)Make sure you have error handling , exception handling in your pipelines

k)Store the Code in GitHub/Devops

Case Study Demo


Hands-on session details:
Normalize the given table upto 3NF
Create the ER model (including cardinality and relationships) for the given schema using draw.io
Create SCD Table ER Model Using Draw.io

To create Schemas with PK, FK, unique, NULL, check etc


Perform CRUD operations
Group data and apply aggregate functions
Solve queries to understand application of "where" and "having" clause
Sort the data using sort function and ORDER BY clause
Join data from three tables using Inner and Outer joins
Write complex queries using nested queries, corelated subqueries

Create BLOB storage


host static webiste
monitor BLOB storage
Create a data lake and manage it

Using data factory, injest data through data pipelines, integrate azure services like SQL, storage and other servcies
Work on control flow activity and data flow transformations on ADF
Integrate ADF with databricks
Exception handling
Explore Debugging
Schedule and manage alerts
Monitoring

Provisioning a SQL Data Warehouse:


Lab Name: "Provisioning SQL Data Warehouse in Azure Synapse Analytics"
Description: This lab will guide you through the process of provisioning a dedicated SQL Data Warehouse instance in Azure
Synapse Analytics.
Data Ingestion and Preparation:

Lab Name: "Ingesting and Preparing Data in Azure Synapse Analytics SQL Data Warehouse"
Description: In this lab, you will use Azure Data Factory to ingest data from various sources into SQL Data Warehouse and
perform data preparation tasks.
Querying Data with Serverless:

Lab Name: "Querying Data with Azure Synapse Analytics Serverless"


Description: This lab will walk you through the process of connecting to the serverless option in Azure Synapse Analytics
and executing SQL queries to analyze data.
Serverless Data Lake Integration:

Lab Name: "Azure Synapse Analytics Serverless Data Lake Integration"


Description: In this lab, you will learn how to access and query data stored in Azure Data Lake Storage using the serverless
option in Azure Synapse Analytics.
Cost Optimization and Best Practices:
Lab Name: "Cost Optimization and Best Practices in Azure Synapse Analytics"
Description: This lab will cover various techniques and best practices to optimize query performance and reduce costs in
Azure Synapse Analytics.
You can find these labs in the Azure Synapse Analytics documentation or Azure Learning Paths. Follow the step-by-step
instructions provided in each lab to complete the exercises and gain practical experience with Azure Synapse Analytics SQL
Data Warehouse and Serverless.
Remember to adjust the pace and duration of each topic based on your learning speed and the depth of understanding
you aim to achieve. Feel free to explore additional resources, such as Microsoft documentation, tutorials, and online
courses, to enhance your knowledge further.
Hands-on Scenario 1: Importing and Transforming Data
Participants will import a sample dataset (e.g., sales data) into Power BI Desktop. They will learn to clean and transform
the data using various Query Editor functionalities, such as filtering, removing duplicates, and creating calculated columns.

Hands-on Scenario 2: Creating Basic Visualizations


Participants will create various basic visualizations (e.g., bar chart, line chart, pie chart) based on the imported dataset.
They will explore different customization options and formatting features to enhance the visual appeal of their charts.

Hands-on Scenario 3: Advanced Visualizations and Interactivity


Participants will create advanced visualizations, such as treemaps and gauges, and apply interactivity using slicers and
filters. They will also learn to implement conditional formatting to highlight specific data points.

Hands-on Scenario 4: Creating a Dashboard and Report Navigation


Participants will design a dashboard layout with multiple visualizations and tiles. They will learn to create bookmarks for
report navigation and create a Table of Contents (TOC) to provide easy access to different sections of the report.

Hands-on Scenario 5: Publishing and Sharing Reports


Participants will publish their created reports to the Power BI Service and explore sharing options. They will collaborate
with other participants by sharing reports and working on a shared workspace.

Integrated Hands-on Scenario: Student Grade Calculator

Objective: Build a program that calculates the average grade for a student based on their subject grades and determines if
they passed or failed.

Tasks:

Create a dictionary called subjects with subject names as keys and the corresponding grades as values. Include at least
three subjects.
Calculate the average grade for the student using the values from the subjects dictionary.
Use the comparison operator to check if the average grade is above a passing threshold (e.g., 60).
Print the average grade and a message indicating whether the student passed or failed.
Integrated Hands-on Scenario: Online Bookstore

Objective: Build a program that simulates an online bookstore where users can search for books, add them to a shopping
cart, and calculate the total price.

Tasks:

Create a class called Book with attributes such as title, author, and price.
Implement a function called search_books that takes a keyword argument, title, and a variable number of positional
arguments, books. The function should search for books with titles containing the given keyword and return a list of
matching books.
Implement a function called add_to_cart that takes a variable number of positional arguments, books, and uses list
comprehension to create a new list containing the titles of the books in the shopping cart.
Implement a function called calculate_total_price that takes a variable number of keyword arguments, books, where the
book title is the key and the quantity is the value. The function should calculate the total price based on the prices of the
books and their quantities.

Integrated Hands-on Scenario: Sales Analysis

Objective: Analyze sales data using pandas DataFrame, perform data manipulations, and visualize insights using
matplotlib.

Tasks:

Import the necessary libraries: pandas, numpy, and matplotlib.


Create a pandas DataFrame from a CSV file containing sales data, including columns such as "Product", "Price", "Quantity",
and "Date".
Explore the DataFrame by printing the first few rows, checking data types, and identifying missing values.
Calculate the total sales for each product and create a new column in the DataFrame to store this information.
Use the pandas groupby() function to group sales data by month and calculate the total sales for each month.
Visualize the monthly sales using a line chart using matplotlib.
Calculate the average price for each product and store it in a new column.
Use the map() function to create a new column in the DataFrame indicating whether each product is "High" or "Low"
priced based on the average price.
Filter the DataFrame to include only "High" priced products and create a new DataFrame.
Convert the filtered DataFrame to a numpy array.
Create a dictionary mapping each product to its respective price.
Create a set containing unique products from the DataFrame.
Create a tuple of the top 5 highest-selling products based on quantity.

Connect to Azure databricks and work with Spark Dataframes


Create and access data from files
Build predictive models using spark machine learning library
Form clustering to seggregate similar data points on a given dataset
Perform CRUD operation
Build predictive models using spark machine learning library
Form clustering to seggregate similar data points on a given dataset
Perform CRUD operation

Hands-on exercises should be interspersed throughout the training to provide participants with
practical experience. Here are some hands-on exercises that can be included:

Creating and executing a Databricks notebook


Loading data from different file formats into Databricks
Performing data exploration and visualization using Databricks notebooks
Transforming data using Spark DataFrames and Spark SQL
Installing and using external libraries in Databricks
Scheduling a job to run a notebook on a regular basis
Hands-on Exercises
a. Setting up a Databricks workspace
b. Creating and managing Delta Tables
c. Loading data into Delta Tables
d. Querying and updating Delta Tables
e. Performing data quality checks and schema evolution
f. Exploring time travel and versioning capabilities

Hands-on Exercises
a. Setting up Azure Container Registry
b. Building Docker images and pushing them to ACR
c. Deploying Docker containers to Azure App Service
d. Creating and managing a Kubernetes cluster in AKS
e. Deploying applications to AKS using Kubernetes manifests
f. Scaling and updating applications in AKS
Develop the Azure CICD pipleline

Hands-on Scenario:
You will create an Azure Machine Learning workspace, upload a dataset, and perform basic data exploration and
preparation. Then, you will create and run an experiment, tune hyperparameters of a machine learning model, and
compare the results. Finally, you will build a pipeline to automate the data preparation and model training process.

Hands-on Scenario:
You will register a trained model in Azure Machine Learning, deploy it as an endpoint, and interact with the deployed
model using sample data. Then, you will explore different compute options and create and manage compute resources for
training and deployment. Finally, you will use Azure Machine Learning Studio Designer to create a machine learning
workflow and leverage AutoML to automatically select and tune models.
preferences.

Steps:

Create a new canvas app:


Open Power Apps Studio.
Click on "Create" and select "Canvas app from blank" or choose a template if you prefer.
Choose the layout and orientation for your app.
Design the user interface:

Add a screen for registration details (e.g., "RegistrationScreen") and a screen for session selection (e.g., "SessionScreen").
Customize the screens by adding relevant controls like labels, text inputs, dropdowns, and buttons.
Use the properties pane to configure the appearance and behavior of each control.
Set up data sources:
Add a data source, such as SharePoint or Excel, to store the registration information.
Connect to the data source and define the necessary fields (e.g., Name, Email, SessionChoice).
Implement the registration form:
On the "RegistrationScreen," add input controls for capturing the user's name, email, and any other required information.
Add a button to submit the registration form.
In the button's "OnSelect" property, write a formula to save the user's details to the data source.
Create session selection:

On the "SessionScreen," display a gallery control with the available conference sessions.
Customize the gallery to show relevant information like session title, date, and description.
Allow users to select their preferred session using a dropdown or radio buttons.
Add navigation and flow:

Implement navigation between the "RegistrationScreen" and "SessionScreen" using buttons or tabs.
Use the "OnSelect" property of the buttons to navigate between screens.
Test and preview the app:

Use the Power Apps Studio's preview feature to test the app's functionality.
Enter test data, submit a registration, and verify that the information is saved to the data source.
Test the navigation between screens and ensure the session selection works correctly.
Publish and share the app:

Once you're satisfied with the app, publish it to the Power Apps portal or share it with selected users.
Configure app permissions and security roles to control access.
Case Study Demo
Cloud Access Required

No

NO

Yes

Yes

Yes

Yes

Yes
Yes

Yes

Yes
Yes

Yes

No
No

No

Yes
Yes

Yes

Yes
Yes

Yes
Yes

Yes

Yes
No
Yes

Yes
Data Fundamentals (DBMS/ DWH/ Datalakes) and Big
DAY
Date Time
09:30 - 10:30
10:30:10:45
10:45 - 11:45

11:45 - 13:00

13:00 - 14:00

14:00 - 15:00

15:00 - 15:45

15:45 - 17:30

DAY
09:30 - 10:30

10:30 - 11:30
11:30 - 11:45
11:45 - 13:00
13:00 - 14:00
14:00 - 15:00
15:00 - 15:15
15:15 - 16:15
16:15 - 16:30
16:30 - 17:30
mentals (DBMS/ DWH/ Datalakes) and Big Data Fundamentals & Azu
DAY 1
Details
Recap of Data Architecture / Data Modelling

Break
ER Modelling
Case Study on ER Modeling

Normalization

Lunch
Normalization
Case Study Solving with Pen and Paper approch to design ER Model
based on given business case.

Dimensional Modeling concepts: Star Schema, Snowflake


Creating Dimensional Model based on ER Model Case given above

SCD, Denomalization

DAY 2
Overview on Bigdata - Structured, unstructured, semistructured

Tools used to solve the problem of Big data

Break
Datalakes, Deltalakes Architecture

Lunch
Data Lakehouse concepts
Break
Describe general security and network security features

Break
Describe identity, governance, privacy, and compliance features
ata Fundamentals & Azure Fundamentals (2 days)
Mode
Instructor led – Concepts
Break
Instructor led – Concepts

Instructor led – Concepts

Lunch

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts

Instructor led – Concepts

Instructor led – Concepts

Break
Instructor led – Concepts

Lunch
Instructor led – Concepts

Break
Instructor led – Concepts

Break
Instructor led – Concepts
Azure SQL
DAY
Date Time
09:30 - 10:30
10:30 - 10:45

10:45 - 11:45

11:45 - 12:00

12:00 - 13:00

13:00 - 14:00

14:00 - 15:00

15:00 - 15:15

15:15 - 16:15

16:15 - 16:30

16:30 - 17:30

DAY
09:30 - 10:30
10:30:10:45
10:45 - 11:45
11:45 - 12:00
12:00 - 13:00
13:00 - 14:00
14:00 - 15:00
15:00 - 15:15

15:15 - 16:15

16:15 - 16:30
16:30 - 17:30
Azure SQL (2 Days)
DAY 1
Details
Introduction, Schemas, DDL, DML, DCL meaning and uses.
Break
DDL Statems - Create, Alter, Drop with Constrains Like PK, FK, Unique, NULL,
check etc. CRUD Operations.

Break

Create and implimnet schema as per ER Model design in previous module


and apply Constains.

Lunch

Permission - Grant, Revoke. Working with DMLs - Insert, Update, Delete and
Truncate operations.
Insert Data in your newly created schema as per given scenario.
Break

Filtering Data, Grouping Data by Group by and Having clause. Sorting the
final data.

Break
Group the data after aggregation. Solve queries to understand application
of "where" and "having" clause. Sort the data using sort function and
ORDER BY clause. All these on schema created by you.

DAY 2
Joins and Subqueries

Break
Join data from three tables using Ineer and Outer joins. Write complex
queries using nested queries, Corelated subqueries.
Break
View of a Tables - working with views.
Implement the View of a Table.
Lunch
Stored Procedure and Functions - overview
Implement the Store Procedue and Functions.
Break
Assignment to Join three tables
Find the second maximum salary in the Employee table
Find the name of employee earning maximum salary
Break
Indexes(Heaps, Clustered and Non clustered Indexes, Column store Indexes)
)

Mode
Instructor led – Concepts
Break

Instructor led – Concepts

Break

Instructor led – Hands On

Lunch

Instructor led – Concepts


Instructor led – Hands On

Break
Instructor led – Concepts
Instructor led – Hands On

Break

Assignment - Individual

Instructor led – Concepts


Instructor led – Hands On
Break
Assignment - Individual
Break
Instructor led – Concepts
Instructor led – Hands On
Lunch
Instructor led – Concepts
Instructor led – Hands On
Break

Assignment - Individual

Break
Instructor led – Concepts
Instructor led – Hands On
Azure Storage Ty
DAY 1
Date Time

9:30 - 10:30

10:30 - 10:45

10:45 - 12:00

12:00 - 12:15

12:15 - 13:00

13:00 - 14:00

14:00 - 15:00

15:00 - 15:15

15:15 - 16:15

16:15 - 16:30

16:30 - 17:30

DAY 2
09:30 - 10:30
10:30:10:45
10:45 - 11:45
11:45 - 12:00
12:00 - 13:00
13:00 - 14:00
14:00 - 15:00
15:00 - 15:15
15:15 - 16:15
16:15 - 16:30
16:30 - 17:30

For self learn / Future re


Azure Storage Types(2 Days)
DAY 1
Details

Understand Azure virous Storage types(File format and supported types,


BLOB, Queue, tables)

Break

Learn about Azure BLOB storage

Create an Azure Storage Account by using the Azure portal

Break

Compare Data Lake Storage Gen2 and Azure Blob Sotrage.

Create BLOB storage, host static website, monitor BLOB storage

Lunch

Create BLOB storage, host static website, monitor BLOB storage

Break

Explore the statges for processing big data by using Data Lake storage

Break

Explore the statges for processing big data by using Data Lake storage

DAY 2
Data Lake Gen2 Overview
Break
Container Concept
Break
Access and Authentication

Lunch
Creation of resources

Break
Create a data lake and manage it.
Break
Upload data into Data Lake

https://docs.microsoft.com/en-us/azure/storage/blobs/storage-blobs-overview
Days)

Mode

Instructor led – Concepts

Break
Instructor led – Concepts
Instructor led – Hands On

Assignment - Individual
Break

Instructor led – Concepts

Assignment - Individual

Lunch

Assignment - Individual

Break

IAssignment - Individual

Break

Assignment - Individual

Instructor led – Concepts


Instructor led – Hands On
Break
Instructor led – Concepts
Break
Instructor led – Concepts
Instructor led – Hands On
Lunch
Instructor led – Concepts
Instructor led – Hands On
Break
Assignment - Individual
Break
Instructor led – Concepts
Instructor led – Hands On
Azure

Date Time

09:30 - 10:30

10:30 - 10:45
10:45 - 11:45
11:45 - 12:00
12:00 - 13:00
13:00 - 14:00
14:00 - 15:00
15:00 - 15:15

15:15 - 16:15

16:15 - 16:30

16:30 - 17:30

Date Time

09:30 - 10:30

10:30 - 10:45
10:45 - 11:45

11:45 - 12:00
12:00 - 13:00
13:00 - 14:00

14:00 - 15:00

15:00 - 15:15
15:15 - 16:15
16:15 - 16:30

16:30 - 17:30

Date Time
09:30 - 10:30
10:30 - 10:45
10:45 - 11:45
11:45 - 12:00
12:00 - 13:00
13:00 - 14:00

14:00 - 15:00

15:00 - 15:15

15:15 - 16:15

16:15 - 16:30
16:30 - 17:30
Azure Data Factory(3 days)
DAY 1
Details
ADF: Introduction
What Is Azure Data Factory?
Why We Need It?
How does Data Factory work?
Break
Key Components of Azure Data Factory ELT Vs ETL, data sets , Integration run time ,
parameters ,system variables
Break
Pipeline
Pipeline chaining
Lunch
Understand ADF components
Break

Copy Data Flow activity in ADF


• Azure Data Factory Instance
• How to Connect to Azure SQL Data Base from On-Premise

Break

• Linked Services
• Input & Output Data Set in Azure Data Factory

DAY 2
Details
Control Flow Activity
• Get Metadata Activity
• Filter Activity

Break
If Activity
Append Activity
Wait Activity
Break
ForEach Loop Activity
Lookup Activity
Lunch
Dataflow Transformation
Source Transformation

Break
Sink Transformation
Conditional Split Transformation
Break

Derived Column Transformation


Recap with individual assignment

DAY 3
Details
Integrate ADF with Databricks
Break
Error and Exception handling
Break
Error and Exception handling
Lunch

Debugging

Break

Scheduling and Alerts

Break
Monitor
• Monitor Visually
Azure Monitor
Mode

Instructor led – Concepts

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On
h
Instructor led – Concepts
Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On
*Note to the Instructor - Performance considerations during Copy and
other activities

Instructor led – Concepts


Instructor led – Hands On

Mode

Instructor led – Concepts


Instructor led – Hands On
Instructor led – Concepts
Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On
h

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On
Assignment - Individual

Mode
Instructor led – Concepts

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On
h
Instructor led – Concepts
Instructor led – Hands On
Assignment - Individual

Instructor led – Concepts


Instructor led – Hands On
Assignment - Individual
Assignment - Individual
Instructor led – Hands On
Azure Synapse An
DAY 1
Date Time
09:30 - 10:30
10:30 - 10:45

10:45 - 11:45

11:45 - 12:00

12:00 - 13:00

13:00 - 14:00

14:00 - 15:00

15:00 - 15:15

15:15 - 16:15

16:15 - 16:30
16:30 - 17:30
Azure Synapse Analytics(1 day)
DAY 1
Details
Introduction to Azure Synapse Analytics SQL Data Warehouse
Break

Understand the key features and benefits of SQL DW, Learn


about the distributed architecture and MPP capabilities,
Provisioning a SQL Data Warehouse, Create a dedicated SQL
DW instance in the Azure portal, Configure the necessary
settings, such as , performance tiers and storage options.

Break

Data Ingestion and Preparation, Use Azure Data Factory to


ingest data from various sources into SQL DW, Perform data
preparation tasks like schema modifications and data
transformations, Querying and Analyzing Data.

Lunch

Explore the SQL DW interface and query editorWrite and


execute SQL queries to analyze data , stored in SQL DW,
Understand query performance optimization techniques.

Break

Introduction to Azure Synapse Analytics Serverless, Understand


the key features and benefits of the serverless option, Learn
about the query execution model and cost considerations.

Break
Introduction to Azure Synapse Analytics Serverless, Understand
the key features and benefits of the serverless option, Learn
about the query execution model and cost considerations
(1 day)
Mode
Instructor led – Concepts
Break

Instructor led – Concepts


Instructor led – Hands On

Break

Instructor led – Concepts


Instructor led – Hands On

Lunch

Instructor led – Concepts


Instructor led – Hands On
Assignment - Individual

Break

Instructor led – Concepts


Instructor led – Hands On

Break
Instructor led – Concepts
Instructor led – Hands On
Data Visualisation usi
DA
Date Time

09:30 - 10:15

10:15 - 10:30

10:30 - 11:30

11:30 - 11:45

11:45 - 13:00

13:00 - 14:00

14:00 - 15:00

15:00 - 15:15

15:15 - 16:30

16:30 - 16:45
16:45 - 17:30

DA

9:30 - 10:30

10:30 - 10:45
10:45 - 12:00

12:00 - 12:15

12:15 - 13:00

13:00 - 14:00
14:00 - 15:00
15:00 - 15:15

15:15 - 16:15

16:15 - 16:30

16:30 - 17:30
Data Visualisation using Power BI (2 Days)
DAY 1
Details

Understanding Power BI and exploring its interface


Power BI Data source connection - Connecting to various sources (CSV,
Excel etc)

Break

Data loading and transformation -Eliminating duplicates

Break

Slicers, handling dates, groups, replacing values and parameters

Lunch

Introduction to DAX & Calculated Columns

Break

Implicit and Explicit Measures

Break
Assignment : To reinforce on the topics covered on Day 1

DAY 2

Row level security and Aggregation Functions

Break
Understanding various chart types
Generating native visualizations based on the queries and data model - 1

Break

Generating native visualizations based on the queries and data model - 2

Lunch
Univariate analysis & Bivariate analysis
Break

Reports and Dashboard in Power BI

Break

Power BI Mobile & Recap


I (2 Days)

Mode

Instructor led – Concepts

Break
Instructor led – Concepts
Instructor led – Hands On

Break
Instructor led – Concepts
Instructor led – Hands On

Lunch
Instructor led – Concepts
Instructor led – Hands On

Break
Instructor led – Concepts
Instructor led – Hands On

Break
Assignment - Individual

Instructor led – Concepts


Instructor led – Hands On

Break
Instructor led – Concepts
Instructor led – Hands On

Break
Instructor led – Concepts
Instructor led – Hands On

Lunch
Instructor led – Concepts
Break
Instructor led – Concepts
Instructor led – Hands On
Assignment - Individual
Break
Instructor led – Concepts
Instructor led – Hands On
Python (3 days)
DAY 1
Date Time
09:30 - 10:30
10:30 - 10:45

10:45 - 11:45

11:45 - 12:00

12:00 - 13:00

13:00 - 14:00

14:00 - 15:00

15:00 - 15:15

15:15 - 16:15

16:15 - 16:30

16:30 - 17:30

DAY 2
Date Time
09:30 - 10:30
10:30 - 10:45
10:45 - 11:45
11:45 - 12:00
12:00 - 13:00
13:00 - 14:00

14:00 - 15:00

15:00 - 15:15
15:15 - 16:15
16:15 - 16:30
16:30 - 17:30

DAY 3
Date Time
09:30 - 10:30
10:30 - 10:45
10:45 - 11:45
11:45 - 12:00
12:00 - 13:00
13:00 - 14:00

14:00 - 15:00

15:00 - 15:15
15:15 - 16:15
16:15 - 16:30
16:30 - 17:30
Python (3 days)
DAY 1
Details
Integers and Floating-Point Numbers in Python
Break
Strings in Python, Boolean values in Python, Arithmetic operators in
Python, Comparison Operator in Python

Break

Logical Operators in Python, Membership Operator in Python, String


formatting in Python, Lists in Python.

Lunch

Tuples in Python, Dictionaries in Python

Break

Zip() Function in Python, Enumerate() Function in Python, Counter()


Function in Python

Break

If-else Statements in Python, Range() Function in Python, User


Defined Functions in Python

DAY 2
Details
Advanced: Functions

Break
Positional and Keyword arguments
Break
*args and *kwargs
Lunch

Classes

Break
List Comprehension

Break
Lambda Functions

DAY 3
Details
Introduction to Panda Data Frame, Series, Lists.
Break
Numpy Array, Dictionaries, Sets
Break
Tuples, Map
Lunch

Numpy

Break
Pandas
Break
Matplotlib, Scipy, Scikit-learn
Mode
Instructor led – Concepts
Break

Instructor led – Concepts

Break

Instructor led – Concepts


Instructor led – Hands On

Lunch
Instructor led – Concepts
Instructor led – Hands On
Assignment - Individual
Break

Instructor led – Concepts


Instructor led – Hands On

Break

Instructor led – Concepts


Instructor led – Hands On

Mode
Instructor led – Concepts
Break
Instructor led – Concepts
Instructor led – Hands On
Break
Instructor led – Concepts
Instructor led – Hands On
Lunch
Instructor led – Concepts
Instructor led – Hands On
Assignment - Individual
Break
Instructor led – Concepts
Instructor led – Hands On
Break
Instructor led – Concepts
Instructor led – Hands On

Mode
Instructor led – Concepts
Instructor led – Hands On
Break
Instructor led – Concepts
Instructor led – Hands On
Break
Instructor led – Concepts
Instructor led – Hands On
Lunch
Instructor led – Concepts
Instructor led – Hands On

Break
Assignment - Individual
Break
Assignment - Individual
Pyspark (3 days)
DAY 1
Date Time
09:30 - 10:30
10:30 - 10:45
10:45 - 11:45
11:45 - 12:00
12:00 - 13:00
13:00 - 14:00

14:00 - 15:00

15:00 - 15:15

15:15 - 16:15

16:15 - 16:30

16:30 - 17:30

DAY 2
Date Time
09:30 - 10:30
10:30 - 10:45
10:45 - 11:45
11:45 - 12:00
12:00 - 13:00
13:00 - 14:00
14:00 - 15:00

15:00 - 15:15

15:15 - 16:15

16:15 - 16:30
16:30 - 17:30

DAY 3
Date Time
09:30 - 10:30
10:30 - 10:45
10:45 - 11:45
11:45 - 12:00
12:00 - 13:00
13:00 - 14:00

14:00 - 15:00

15:00 - 15:15

15:15 - 16:15

16:15 - 16:30

16:30 - 17:30
Pyspark (3 days)
DAY 1
Details
Introduction , Overview and Installation
Break
Spark Architecture

Break
Spark programing with Python, Dataframe, Inspecting Data Dataset
Lunch

Clusters, Notebooks, Cluster management

Break

Azure Databricks Architecture - understand architecture of ADB


spark cluster,Read and write Data in Databricks, UDF

Break

Components of Spark & Spark Architecture, Job Lifecycle in Spark,


Applications of Spark, Apache Spark use cases

DAY 2
Details
RDD concepts overview

Break
RDD to DataFrame

Break
Pyspark SQL

Lunch
Perform CRUD operation

Break

Common File Handling operations(read , write , filter , append etc)


Loading CSV into DataFrame

Break
Handling different file formats through Pyspark

DAY 3
Details
Data Cleaning, Subsetting and Cleaning, Filtering DataFrame
Break
Handling Null values
Break
Filter
Drop
Lunch

Various ways of transforming data with examples

Break

Reading data from given dataset (file / table)


Clean and transforma the data

Break

Reading data from given dataset (file / table)


Clean and transforma the data
Mode
Instructor led – Concepts
Break
Instructor led – Concepts

Break
Instructor led – Concepts
Instructor led – Hands On
Lunch
Instructor led – Concepts
Instructor led – Hands On
Assignment - Individual
Break

Instructor led – Concepts


Instructor led – Hands On

Break

Instructor led – Concepts


Instructor led – Hands On

Mode
Instructor led – Concepts
Break
Instructor led – Concepts
Instructor led – Hands On
Break
Instructor led – Concepts
Instructor led – Hands On
Lunch
Instructor led – Concepts
Instructor led – Hands On
Assignment - Individual
Break

Instructor led – Concepts


Instructor led – Hands On

Break
Instructor led – Concepts
Instructor led – Hands On

Mode
Instructor led – Concepts
Instructor led – Hands On
Break
Instructor led – Concepts
Instructor led – Hands On
Break
Instructor led – Concepts
Instructor led – Hands On
Lunch
Instructor led – Concepts
Instructor led – Hands On

Break

Assignment - Individual

Break

Assignment - Individual
Azur
Date Time

09:30 - 10:30

10:30 - 10:45

10:45 - 11:45

11:45 - 12:00

12:00 - 13:00

13:00 - 14:00

14:00 - 15:00

15:00 - 15:15

15:15 - 16:15

16:15 - 16:30
16:30 - 17:30

Date Time
09:30 - 10:30

10:30 - 10:45

10:45 - 11:45

11:45 - 12:00

12:00 - 13:00

13:00 - 14:00

14:00 - 15:00

15:00 - 15:15

15:15 - 16:15

16:15 - 16:30
16:30 - 17:30
Azure Databricks(2 Days)
DAY 1
Details

Databricks overview :Introduction


High Level Architecture
Break
Importing and exploring data in Databricks
Reading data from various sources (e.g., CSV, JSON, Parquet)
Performing basic data exploration and visualization

Break

Introduction to Apache Spark and its role in Databricks


Using DataFrames and Spark SQL for data transformations
Applying common transformations like filtering, aggregating, and joining data

Lunch
Working with libraries in Databricks
Installing and managing external libraries
Scheduling and running jobs for automated data processing
Databricks Deployment and Integration
Break

Integrating Databricks with other Azure services (e.g., Azure Storage, Azure Data Lake)

Break
Best practices for deploying Databricks applications in production

DAY 2
Details
Introduction to Databricks Delta Tables
a. Overview of Databricks and Delta Lake
b. Benefits of Delta Tables over traditional data storage formats
c. Key features and concepts of Delta Tables

Break

Delta Table Architecture


a. Understanding the ACID properties (Atomicity, Consistency, Isolation, Durability)
b. Versioning and transaction log
c. Schema evolution and data lifecycle management

Break
Working with Delta Tables
a. Creating Delta Tables
i. Schema definition
ii. Partitioning and clustering
b. Data ingestion into Delta Tables
i. Batch and streaming data ingestion
ii. Supported file formats and compression techniques
Lunch
c. Querying Delta Tables
i. SQL and DataFrame API
ii. Optimizations and performance tuning
d. Updating and deleting data in Delta Tables
e. Handling schema evolution and table maintenance

Break
Data Quality and Reliability
a. Data integrity and consistency checks
b. Data validation and schema enforcement
c. Time travel and versioning capabilities
d. Optimistic concurrency control and isolation levels
Break
Best Practices and Advanced Topics
a. Performance optimization techniques
b. Delta Table partitioning and clustering strategies
c. Optimizing for streaming data ingestion
d. Integrating Delta Tables with MLflow and ML workloads
e. Data governance and security considerations
Mode

Instructor led – Concepts

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On
Assignment - Individual

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On

Mode
Instructor led – Concepts
Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On

Assignment - Individual
Instructor led – Concepts
Instructor led – Hands On
Azure Containers(1 da
DAY 1
Date Time

09:30 - 10:30

10:30 - 10:45

10:45 - 11:45

11:45 - 12:00

12:00 - 13:00

13:00 - 14:00

14:00 - 15:00

15:00 - 15:15
15:15 - 16:15

16:15 - 16:30

16:30 - 17:30
Azure Containers(1 day)
DAY 1
Details

Introduction to Containers and Containerization


a. Overview of containerization and its benefits
b. Introduction to Docker and Kubernetes
c. Understanding the role of containers in modern application development.

Break
Docker Fundamentals
a. Introduction to Docker and its architecture
b. Docker images and containers
c. Dockerfile: Creating custom Docker images.
d. Docker commands and basic operations
e. Docker Registry: Pushing and pulling images.

Break

Docker in Azure
a. Introduction to Azure Container Registry (ACR)
b. Setting up an ACR and managing container images.
c. Deploying Docker containers in Azure App Service
d. Container orchestration with Azure Container Instances (ACI)

Lunch

Introduction to Kubernetes
a. Overview of Kubernetes and its architecture
b. Kubernetes components: Pods, Deployments, Services
c. Understanding Kubernetes objects and their YAML specifications

Break
Kubernetes in Azure
a. Introduction to Azure Kubernetes Service (AKS)
b. Provisioning and managing an AKS cluster
c. Deploying applications using Kubernetes manifests
d. Scaling and updating applications in AKS
e. Monitoring and logging with Azure Monitor and Azure Log Analytics

Break

Best Practices and Advanced Topics


a. Container security best practices
b. Continuous integration and deployment (CI/CD) for containers
c. Service mesh with Azure Kubernetes Service
d. Monitoring and autoscaling with Kubernetes
Mode

Instructor led – Concepts

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On
Instructor led – Concepts
Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On
Azure Deployment/Devops(
DAY 1
Date Time
09:30 - 10:30
10:30 - 10:45
10:45 - 11:45
11:45 - 12:00
12:00 - 13:00
13:00 - 14:00

14:00 - 15:00

15:00 - 15:15
15:15 - 16:15
16:15 - 16:30
16:30 - 17:30
Azure Deployment/Devops(1 day)
DAY 1
Details
Introduction to DevOps
What and Why DevOps
Break
Code collaboration (Azure Devops/GitHub) ,

Break
Recap on Github Actions
Lunch

Azure CICD pipelines , (ADF , Databricks , Database and Power BI)

Break
Azure CICD pipelines , (ADF , Databricks , Database and Power BI)
Break
Azure CICD pipelines , (ADF , Databricks , Database and Power BI)
day)
Mode
Instructor led – Concepts

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On

Instructor led – Concepts


Instructor led – Hands On
Azure ML Studio(2 days)
DAY 1
Date Time Details

Introduction to Azure Machine Learning,


Overview of Azure, Machine Learning
services and features, Understanding the
09:30 - 10:30
benefits of using Azure Machine
Learning for managing datasets and
experimentation.

10:30 - 10:45 Bre

Managing Datasets in Azure Machine


Learning, Uploading and registering
10:45 - 11:45 datasets in Azure Machine Learning,
Performing data preparation and
transformations.

11:45 - 12:00 Bre

Exploring and visualizing datasets using


Azure Machine Learning tools,
12:00 - 13:00
Experimentation and Hyperparameter
Tuning

13:00 - 14:00 Lun


Creating and managing experiments in
Azure Machine Learning
14:00 - 15:00 Defining and tuning hyperparameters for
machine learning models

15:00 - 15:15 Bre

Tracking and comparing experiment runs


Evaluating and selecting the best-
15:15 - 16:15 performing model
Pipelines in Azure Machine Learning

16:15 - 16:30 Bre

Introduction to Azure Machine Learning


Pipelines
Building and running pipelines for end-
16:30 - 17:30 to-end machine learning workflows
Managing and monitoring pipeline runs
Reusing and sharing pipelines for
reproducibility

DAY 2
Date Time Details
Registering and Managing Models
09:30 - 10:30 Registering trained models in Azure
Machine Learning
Versioning and managing model artifacts

10:30 - 10:45 Bre

Registering and Managing Models


Registering trained models in Azure
10:45 - 11:45
Machine Learning
Versioning and managing model artifacts

11:45 - 12:00 Bre

Creating and deploying model endpoints


in Azure Machine Learning
12:00 - 13:00 Configuring and managing compute
targets for model serving
Testing and monitoring model endpoints

13:00 - 14:00 Lun

Scaling and updating deployed models


14:00 - 15:00 Understanding Compute and Linked
Services

15:00 - 15:15 Bre


Exploring different compute options in
Azure Machine Learning
Provisioning and managing compute
resources
15:15 - 16:15 Configuring compute targets for
experimentation and training
Utilizing linked services for data
integration and access
Azure ML Studio Designer and AutoML

16:15 - 16:30 Bre

Introduction to Azure Machine Learning


Studio Designer
Building machine learning workflows
using drag-and-drop interface
16:30 - 17:30
Automating model selection and
hyperparameter tuning with AutoML
Deploying and managing models created
with AutoML
Studio(2 days)
DAY 1
Mode

Instructor led – Concepts

Break

Instructor led – Concepts

Break

Instructor led – Concepts


Instructor led – Hands On

Lunch
Instructor led – Concepts
Instructor led – Hands On

Break

Instructor led – Concepts


Instructor led – Hands On

Break

Instructor led – Concepts


Instructor led – Hands On

DAY 2
Mode
Instructor led – Concepts
Instructor led – Hands On

Break

Instructor led – Concepts


Instructor led – Hands On

Break

Instructor led – Concepts


Instructor led – Hands On

Lunch

Instructor led – Concepts


Instructor led – Hands On

Break
Assignment - Individual

Break

Instructor led – Concepts


Instructor led – Hands On
Power Platform(1 day)
DAY 1
Date Time Details

Introduction to Power Apps


Overview of Power Apps and its
capabilities
Understanding canvas apps and model-
09:30 - 10:30 driven apps
Exploring the Power Apps interface and
features
Introduction to data sources and
connectors

10:30 - 10:45 Bre

Building your first Power App:


Creating a new canvas app from a
template
Designing the user interface using
10:45 - 11:45
controls, screens, and forms
Configuring data sources and connecting
to external data

11:45 - 12:00 Bre

Adding formulas and logic to control app


behavior
12:00 - 13:00
Previewing and testing the app

13:00 - 14:00 Lun


Advanced App Design:
Customizing app layouts and themes
Working with galleries and data tables
Implementing navigation and app flow
14:00 - 15:00 Utilizing controls for media, charts, and
maps
Implementing user authentication and
security

15:00 - 15:15 Bre

Data Integration and Flow:


Connecting to various data sources
(SharePoint, Excel, SQL, etc.)
Fetching and displaying data from
different sources
15:15 - 16:15 Creating data connections and gateways
Implementing business logic using
formulas
Introduction to Power Automate for app
automation

16:15 - 16:30 Bre


Deployment and Administration:
Publishing and sharing your app with
users
16:30 - 17:30 Managing permissions and security roles
Monitoring app usage and performance
Troubleshooting common issues
Overview of app lifecycle management
atform(1 day)
DAY 1
Mode

Instructor led – Concepts

Break

Instructor led – Concepts

Break

Instructor led – Concepts


Instructor led – Hands On

Lunch
Instructor led – Concepts
Instructor led – Hands On

Break

Instructor led – Concepts


Instructor led – Hands On

Break
Instructor led – Concepts
Instructor led – Hands On

You might also like