Data Engineering with Rust 

Meet Instructor and Course Overview

Introduction to the AI Coding Paradigm Shift

Introduction to cloud-based development environments

Introduction to GitHub Copilot Ecosystem for Rust

Prompt Engineering with GCP BigQuery SQL

Introduction to AWS CodeWhisperer for Rust

Using Google Bard to Enhance Productivity

Continuous Integration with Rust and GitHub Actions

Introducing Rust Sequences and Maps

Print Rust data structures demo

Vector Fruit Salad demo

VecDeque Fruit Salad demo

Linkedin List Fruit Salad demo

Fruit Salad CLI demo

HashMap frequency counter demo

HashMap language compariso

Analyzing UFC Fighter Network Using Graph Centrality in Rust

Storing Unique Fruits Using HashSet in Rust

Maintaining Sorted and Unique Fruits Using BTreeSet in Rust

Creating a Fig Priority Fruit Salad Using Binary Heap in Rust

PageRank algorithm for sports data

Showing shortest path with dijkstra

Detecting Strongly Connected Components: A Deep Dive into Kosaraju's Algorithm

Simple Charting of Data Structures in Rust

Using VS Code, Copilot, and Codespaces to Level Up to Rust from Python

Harness the power of generative AI for software development

The case for using Rust in MLOps

AWS CodeWhisperer FAQ

External Lab: Creating a Fruit Salad with Rust Vectors in GitHub Codespaces

External Lab: Fruit Salad Creation with VecDeque in GitHub Codespaces

External Lab: Fruit Salad Creation with LinkedList in GitHub Codespaces

External Lab: Command Line Fruit Salad Creator in GitHub Codespaces

Rust Collections Docs

Russian Troll Tweet Datasets

When to use a Rust Set

Rust iterators

Neo4J Graph Data Science Library Manual

Calculating Centrality in a UFC Fighter Graph with Rust

External GitHub Lab: Generating Unique Fruits with Rust and HashSet

External GitHub Lab: Generating Unique Fruits with Rust and BTreeSet

External GitHub Lab: Generating Fruit Salad with Rust and BinaryHeap

External GitHub Lab: PageRank Algorithm in Rust

External GitHub Lab: Shortest Path Algorithm in Rust

External GitHub Lab: Community Detection in Rust

External GitHub Lab: Graph Visualization in Rust

Final Week-Reflection

Rust Collections

Exploring Rust Data Structures

Counting Frequency with Rust HashMaps

Weighting Programming Languages with Rust HashMaps

Multi-Factor Authentication

Network Segmentation

Least Privilege Access

Encryption

Mutable fruit salad

Customize fruit salad with a CLI

Data Race example

High Availability

Understanding the Homophonic Cipher: A Cryptographic Technique

Decoding the Secrets of the Caesar Cipher

Creating a Decoder Ring: A Practical Guide

Detecting Duplicates with SHA-3: A Data Integrity Tool

Incident Response

Compliance

Core Concepts in Concurrency

Dining Philosophers

Web Crawl Wikipedia with Rayon

Intelligent Chatbot with Tokio

Multi-threaded deduplication with Rust

Energy Efficiency Python vs Rust

Concurrency Stress test with a GPU

Host Efficiency Serverless Optimization problem

Customize fruit salad with a CLI

Meet Safe and Unsafe

Ownership and Lifetimes

The Perils Of Ownership-Based Resource Management (OBRM)

RustCrypto: Hashes

Rust Software Security: A Current State Assessment

External GitHub Lab: Creating a Decoder Ring: A Practical Guide

Concurrency and Parallelism

Data Races and Race Conditions

Send and Sync

Atomics

Distributed Computing and Concurrency

Challenges and Opportunities in Distributed

Final Week-Reflection

Safety, Security and Concurrency with Rust

Mutable fruit salad

Data Race

Lab: Dining Philosophers

Process CSV files in Rust

Using Cargo Lambda with Rust

List files on AWS EFS with Rust

Use AWS S3 Storage

Use AWS S3 Storage from Rust

Write encrypted data to tables or Parquet files

What is Colab?

Using Bard to enhance notebook development

Exploring Life Expectency in a Notebook

Load a DataFrame with sensitive data

Using MLFlow with Databricks Notebooks

End to End ML with MLFlow and Databricks

Exploring global life expectancy with Polars

Cloud Developer Workspace Advantage

Onboarding to GCP with Python and Rust

Using GCP Cloud Shell with Rust

Learn AWS CloudShell

Prototyping AI APIs with AWS CloudShell

Cloud9 with CodeWhisperer

Demo GCP App Engine Rust Deploy

Containerized Rust Actix Microservice on AWS

Rust CSV Cookbook

Apache Parquet Official Native Rust Implementation

External GitHub Lab: Using Polars DataFrame CLI

Polars is a highly performant DataFrame library for manipulating structured data

Chapter 2-Week 2 (Up and Running with Cloud Computing)

Chapter 3 - Week 3: Virtualization and Containers

What is the AWS SDK for Rust?

Final Week-Reflection

Quiz3: Rust Data Engineering Libraries and Tools

Jack and the Beanstalk Data Pipelines

Open Source Data Engineering - Pros and Cons

Core Components of Data Engineering Pipelines

Rust AWS Step Functions Pipeline

Rust AWS Lambda Async S3 Size Calculator

What is Distroless?

Demo Deploying Rust Microservices on GCP

Introduction to Hugging Face Hub

Rust GPU Hugging Face Translator

Rust PyTorch High-Performance Options

EFS ONNX Rust Inference with AWS Lambda

Theory behind model fine-tuning

Doing Fine Tuning

Selecting the correct database on GCP

Rust SQLite Hugging Face Zero Shot Classifier

Prompt Engineering for BigQuery

Big Query to Colab Pipeline

Exploring Data with Big Query

Using Public Datasets for Data Science

Querying Log files with BigQuery

There is no one size database

Course Conclusion

Architectural Patterns to Build End-to-End Data Driven Applications on AWS

Data Preparation and Feature Engineering in ML

"Distroless" Container Images

Introduction to ONNX

Ready-to-use NLP pipelines and Transformer-based models

Hugging Face NLP Course documentation

Hugging Face Fine-Tuning a pretrained model

About SQLite

Appropriate Uses For SQLite

What is BigQuery?

Final Week- Reflection

Designing Data Processing Systems in Rust

Final Course Quiz