Virtualization, Docker, and Kubernetes for Data Engineering
- Offered byCoursera
Virtualization, Docker, and Kubernetes for Data Engineering at Coursera Overview
Duration | 26 hours |
Start from | Start Now |
Total fee | Free |
Mode of learning | Online |
Official Website | Explore Free Course |
Credential | Certificate |
Virtualization, Docker, and Kubernetes for Data Engineering at Coursera Highlights
- Earn a certificate from Duke University
- Add to your LinkedIn profile
- 38 quizzes
Virtualization, Docker, and Kubernetes for Data Engineering at Coursera Course details
- What you'll learn
- Master virtualization, containerization, and Docker, including Dockerfile creation and multi-container orchestration with Compose and Airflow.
- Develop expertise in Kubernetes core concepts, cluster architecture, and deployment using cloud environments, GitHub Codespaces, and AI-driven tools.
- Navigate data scenarios mastering containerization, deploying apps, and addressing production issues with cloud orchestration and SRE practices.
- Throughout this course, you'll explore virtualization, containerization, and Kubernetes, mastering the very tools that power data engineering in the industry. Each week presents a new set of tools and platforms that are indispensable in data engineering. From mastering Docker and Kubernetes to exploring advanced topics such as AI-driven coding with GitHub Copilot, efficient container image management with Azure and Amazon Elastic Container Registries, and Site Reliability Engineering (SRE) practices, you'll go beyond the basics and acquire the expertise needed to thrive in the dynamic and data-driven landscape of advanced data engineering. Whether you're a current student looking to expand your skills or a working professional aiming to take your expertise to the next level, this course is tailored to equip you with the advanced knowledge and hands-on experience necessary for success.
Virtualization, Docker, and Kubernetes for Data Engineering at Coursera Curriculum
Virtualization Theory and Concepts
Virtualization
Scaling Applications
Hardware Utilization
Introduction to Virtual Machines
Virtual Box Demo
Container Concepts
Introduction to Docker
Docker Architecture
Welcome to Kubernetes for Data Engineering with Python!
Meet your Instructors: Noah Gift and Kennedy Behrman
Tools and Platforms
What is Virtualization?
What is a Virtual Machine?
Introduction to Containers
Docker: The Container Platform
Spin up a local Docker container
Virtualization
Scaling Applications
Introduction to Virtual Machines
Virtual Box
Containers
Introduction to Docker
Docker Architecture
Virtualization
Meet and Greet (optional)
Let Us Know if Something's Not Working
Using Docker
Docker Client
Creating a Volume
Running a Database in a Container
Building an Image
Dockerfiles
Dockerfile Examples
Orchestration with Docker Compose
Introduction to Airflow
Airflow Demonstration using Compose
Use the Docker Command Line
Creating a Docker Image (Step-by-Step)
Getting Started with Docker Compose
Getting Started with Apache Airflow
Docker vs. Kubernetes: A Primer
Use Docker to Spin Up Airflow
Docker Client
Volumes
Running a Database in a Container
Building an Image
Dockerfiles
Compose
Airflow
Docker
Kubernetes: Container Orchestration in Action
Kubernetes Key Concepts
Kubernetes Clusters
Kubernetes Nodes
Kubernetes Service Deployments
Cloud Developer Workspace Advantage
Key Concepts in the GitHub Ecosystem
Using GitHub Templates
Using GitHub Codespaces
Using OpenAI Codewhisper
Fine-Tuning a Model with Hugging Face
Using GitHub Copilot
GitHub Actions
Running Minikube in GitHub Codespaces
Deploying a Service with Minikube
What is Kubernetes?
Virtualization, Containerization, and Elasticity
Fine-Tune a Pretrained Model
Getting Started with GitHub Copilot
Hello Minikube
Minikube + Kubernetes: A Recap
Deploying FastAPI to AWS with ECR and App Runner
Kubernetes Key Concepts
Kubernetes Clusters
Kubernetes Nodes
Kubernetes Service Deployments
Key Concepts in the GitHub Ecosystem
Running Minikube in GitHub Codespaces
Deploying a Service with Minikube
Kubernetes, GitHub, and Minikube
Building Kubernetes Solutions
Build a Tiny Bash Container using GitHub Codespaces
Build FastAPI Microservice in Cloud9 in Python
Deploy a FastAPI PyTorch Containerized Application to AWS App Runner
Options for Container Orchestration
GCP Cloud Run
Build Microservice in Cloud9 in C#
AWS Copilot - Command Line Interface for Containerized Applications
Load-Testing with Locust
Monitoring Systems
SRE Mindset for MLOps
Operationalize Microservices
CI for Microservices
What is Continuous Delivery?
Using Container Registries with Kubernetes: Azure Container Registry and Amazon Elastic Container Registry (ECR)
Kubernetes and Google Cloud
Deploying Containerized Applications and Kubernetes in the Cloud with AWS
Getting Started with Site Reliability Engineering (SRE)
Continuous Delivery of FastAPI App to AWS App Runner
Final Project Explained
Build a Tiny Bash Container using GitHub Codespaces
Build FastAPI Microservice in Cloud9 in Python
Deploying a FastAPI PyTorch Containerized Application to AWS App Runner
Options for Container Orchestration
GCP Cloud Run
Build Microservice in Cloud9 in C#
AWS Copilot
Load-Testing with Locust
Monitoring Systems
SRE Mindset for MLOps
Operationalize Microservices
CI for Microservices
Continuous Delivery
Kubernetes Data Engineering Solutions