Coursera
Coursera Logo

Virtualization, Docker, and Kubernetes for Data Engineering 

  • Offered byCoursera

Virtualization, Docker, and Kubernetes for Data Engineering
 at 
Coursera 
Overview

Duration

26 hours

Start from

Start Now

Total fee

Free

Mode of learning

Online

Official Website

Explore Free Course External Link Icon

Credential

Certificate

Virtualization, Docker, and Kubernetes for Data Engineering
 at 
Coursera 
Highlights

  • Earn a certificate from Duke University
  • Add to your LinkedIn profile
  • 38 quizzes
Details Icon

Virtualization, Docker, and Kubernetes for Data Engineering
 at 
Coursera 
Course details

What are the course deliverables?
  • What you'll learn
  • Master virtualization, containerization, and Docker, including Dockerfile creation and multi-container orchestration with Compose and Airflow.
  • Develop expertise in Kubernetes core concepts, cluster architecture, and deployment using cloud environments, GitHub Codespaces, and AI-driven tools.
  • Navigate data scenarios mastering containerization, deploying apps, and addressing production issues with cloud orchestration and SRE practices.
More about this course
  • Throughout this course, you'll explore virtualization, containerization, and Kubernetes, mastering the very tools that power data engineering in the industry. Each week presents a new set of tools and platforms that are indispensable in data engineering. From mastering Docker and Kubernetes to exploring advanced topics such as AI-driven coding with GitHub Copilot, efficient container image management with Azure and Amazon Elastic Container Registries, and Site Reliability Engineering (SRE) practices, you'll go beyond the basics and acquire the expertise needed to thrive in the dynamic and data-driven landscape of advanced data engineering. Whether you're a current student looking to expand your skills or a working professional aiming to take your expertise to the next level, this course is tailored to equip you with the advanced knowledge and hands-on experience necessary for success.
Read more

Virtualization, Docker, and Kubernetes for Data Engineering
 at 
Coursera 
Curriculum

Virtualization Theory and Concepts

Virtualization

Scaling Applications

Hardware Utilization

Introduction to Virtual Machines

Virtual Box Demo

Container Concepts

Introduction to Docker

Docker Architecture

Welcome to Kubernetes for Data Engineering with Python!

Meet your Instructors: Noah Gift and Kennedy Behrman

Tools and Platforms

What is Virtualization?

What is a Virtual Machine?

Introduction to Containers

Docker: The Container Platform

Spin up a local Docker container

Virtualization

Scaling Applications

Introduction to Virtual Machines

Virtual Box

Containers

Introduction to Docker

Docker Architecture

Virtualization

Meet and Greet (optional)

Let Us Know if Something's Not Working

Using Docker

Docker Client

Creating a Volume

Running a Database in a Container

Building an Image

Dockerfiles

Dockerfile Examples

Orchestration with Docker Compose

Introduction to Airflow

Airflow Demonstration using Compose

Use the Docker Command Line

Creating a Docker Image (Step-by-Step)

Getting Started with Docker Compose

Getting Started with Apache Airflow

Docker vs. Kubernetes: A Primer

Use Docker to Spin Up Airflow

Docker Client

Volumes

Running a Database in a Container

Building an Image

Dockerfiles

Compose

Airflow

Docker

Kubernetes: Container Orchestration in Action

Kubernetes Key Concepts

Kubernetes Clusters

Kubernetes Nodes

Kubernetes Service Deployments

Cloud Developer Workspace Advantage

Key Concepts in the GitHub Ecosystem

Using GitHub Templates

Using GitHub Codespaces

Using OpenAI Codewhisper

Fine-Tuning a Model with Hugging Face

Using GitHub Copilot

GitHub Actions

Running Minikube in GitHub Codespaces

Deploying a Service with Minikube

What is Kubernetes?

Virtualization, Containerization, and Elasticity

Fine-Tune a Pretrained Model

Getting Started with GitHub Copilot

Hello Minikube

Minikube + Kubernetes: A Recap

Deploying FastAPI to AWS with ECR and App Runner

Kubernetes Key Concepts

Kubernetes Clusters

Kubernetes Nodes

Kubernetes Service Deployments

Key Concepts in the GitHub Ecosystem

Running Minikube in GitHub Codespaces

Deploying a Service with Minikube

Kubernetes, GitHub, and Minikube

Building Kubernetes Solutions

Build a Tiny Bash Container using GitHub Codespaces

Build FastAPI Microservice in Cloud9 in Python

Deploy a FastAPI PyTorch Containerized Application to AWS App Runner

Options for Container Orchestration

GCP Cloud Run

Build Microservice in Cloud9 in C#

AWS Copilot - Command Line Interface for Containerized Applications

Load-Testing with Locust

Monitoring Systems

SRE Mindset for MLOps

Operationalize Microservices

CI for Microservices

What is Continuous Delivery?

Using Container Registries with Kubernetes: Azure Container Registry and Amazon Elastic Container Registry (ECR)

Kubernetes and Google Cloud

Deploying Containerized Applications and Kubernetes in the Cloud with AWS

Getting Started with Site Reliability Engineering (SRE)

Continuous Delivery of FastAPI App to AWS App Runner

Final Project Explained

Build a Tiny Bash Container using GitHub Codespaces

Build FastAPI Microservice in Cloud9 in Python

Deploying a FastAPI PyTorch Containerized Application to AWS App Runner

Options for Container Orchestration

GCP Cloud Run

Build Microservice in Cloud9 in C#

AWS Copilot

Load-Testing with Locust

Monitoring Systems

SRE Mindset for MLOps

Operationalize Microservices

CI for Microservices

Continuous Delivery

Kubernetes Data Engineering Solutions

Virtualization, Docker, and Kubernetes for Data Engineering
 at 
Coursera 
Admission Process

    Important Dates

    May 25, 2024
    Course Commencement Date

    Other courses offered by Coursera

    – / –
    3 months
    Beginner
    – / –
    20 hours
    Beginner
    – / –
    2 months
    Beginner
    – / –
    3 months
    Beginner
    View Other 6715 CoursesRight Arrow Icon
    qna

    Virtualization, Docker, and Kubernetes for Data Engineering
     at 
    Coursera 

    Student Forum

    chatAnything you would want to ask experts?
    Write here...