Duke University - Scripting with Python and SQL for Data Engineering
- Offered byCoursera
Scripting with Python and SQL for Data Engineering at Coursera Overview
Duration | 19 hours |
Total fee | Free |
Mode of learning | Online |
Difficulty level | Intermediate |
Official Website | Explore Free Course |
Credential | Certificate |
Scripting with Python and SQL for Data Engineering at Coursera Highlights
- Earn a Certificate upon completion from Coursera
Scripting with Python and SQL for Data Engineering at Coursera Course details
- In this third course of the Python, Bash and SQL Essentials for Data Engineering Specialization, you will explore techniques to work effectively with Python and SQL
- We will go through useful data structures in Python scripting and connect to databases like MySQL
- Additionally, you will learn how to use a modern text editor to connect and run SQL queries against a real database, performing operations to load and extract data
- Finally, you will use extracted data from websites using scraping techniques. These skills will allow you to work effectively when data is not readily available, or when spatial queries are required to extract useful information from databases
Scripting with Python and SQL for Data Engineering at Coursera Curriculum
Working with Data in Python
Welcome to Scripting with Python and SQL for Data Engineering
Meet your Course Instructor: Alfredo Deza
Overview of Key Concepts
Introduction to Working with Data in Python
Introduction to Python Data Structures
Using Lists to Save and Retrieve Data in Python
Using Dictionaries to Save and Retrieve Data in Python
Overview of Lesson Common Data Structures in Python
Recap of Data Structures in Python
Introduction to Choosing Data Structures in Python
Iterating Over Lists and Dictionaries in Python
Iterating Over Other Data Structures in Python
Storing Data Between Data Structures in Python
Recap of Mapping Data Structures in Python
Introduction to Data Sources and Formats in Python
Loading Data from Files and File Paths in Python
Working with JSON in Python
Saving Data from Python to Disk
Recap of Persisting and Loading Data in Python
Meet your Supporting Instructors: Kennedy Behrman and Noah Gift
Course Structure and Discussion Etiquette
Python Lists and Dictionaries
Build a notebook that reformats data into JSON
Using Data Structures in Python
Working with Data in Python
Python Scripting and SQL
Introduction to Python Scripting and SQL
Introduction to Scripting in Python
Creating a Script as a Module in Python
Traversing the File System with a Script in Python
Recap of Python Scripting Basics
Introduction to Embedded Databases
What is SQLite?
Creating and Connecting to a SQLite Database in Python
Saving and Querying from a SQLite Database in Python
Recap of SQLite and Python
Introduction to Querying with SQL in Python
Basic SQL Commands in Python
Extracting Distinct Data using SQL in Python
Searching with SQL in Python
Recap of Querying with SQL in Python
Minimal Python, Chapter 2: Learn to Store Data
Create a Reporting Script for File Sizes
Python Scripting and SQL
Web Scraping using Python
Introduction to Web Scraping using Python
Introduction to Extracting Data from Unstructured HTML
Challenges with Web Data
Parsing HTML with HTMLParser in Python
Recap of Web Scraping Techniques in Python
Introduction to Scrapy and XPath in Python
Creating a Web Scraping Project with Scrapy in Python
Parsing Data with XPath and Scrapy Shell
Using Scrapy Spider for Web Scraping
Recap of Scrapy and XPath in Python
Overview of Challenges with Web Scraping
Scraping Locally
Persisting Data in CSV and JSON Formats
Persisting Data to a SQLite Database
Recap of Persistence and Efficacy with Web Scraping
Parsing Techniques with HTMLParser
Efficient Scraping Techniques
Build a Web Scraping Tool
Web Scraping using Python
Working with MySQL
Introduction to Working with MySQL
Introduction to VSCode with MySQL
Connecting to a MySQL Server
Recap of VSCode with MySQL
Challenges of Running MySQL Queries
Using VSCode to Execute MySQL Queries
Recap of Running MySQL Queries
Challenges with Importing to Databases
Importing CSV Data into MySQL
Exporting Data from MySQL
Recap of Importing and Exporting Data in MySQL
Working with VSCode and MySQL
Loading and Exporting Data using MySQL
Working with MySQL