Week 11 - Building ETL Pipelines

This session will introduce how to build ETL (Extract, Transform, Load) pipelines using Python. We’ll learn how to connect to a SQLite database using the sqlite3 library, fetch data from an API using the requests library, and perform ETL operations to clean and transform the data before loading it into a target system.

Goals

1. import sqlite3 library and connect to a SQLite database
2. execute SQL queries using sqlite3 in Python
3. use requests library to fetch data from an API
4. extract, transform, and load data using Python

Slides

• SQL in Python:
• Building ETL Pipelines:

Labs

• 

Resources

• ABS: Web Scraping
• ABS: SQLite Databases