Using ETL process to Extract, Transform, and Load local data into a PostgreSQL database

Project Data Modeling with Cassandra as part of Udacity's Data Engineering Nanodegree

ETL data pipeline (API + apache airflow + PostgreSQL)

Build an Airflow pipeline from Amazon s3 to Amazon Redshift

Youtube Trending Videos Analysis

Example project implementing best practices and testing for PySpark data pipelines.

Project for Udacity Data Engineering Nanodegree. Designing a relational database schema and building an ETL pipeline.

Generalization of the ETL experience.

DSND Disaster Response Pipelines Project

Curso de analise de BI - IGTI

Modeled the data with Apache Cassandra and completed an ETL pipeline using Python. Tables in Apache Cassandra to run queries are created and the ETL pipeline that transfers data from a set of CSV files within a directory are defined to create a streamlined CSV file to model and insert data into Apache Cassandra tables.

applying data warehouses tools and AWS to build an ETL pipeline for a database hosted on Redshift. loading data from AWS S3 bucket to staging tables on Redshift and executing SQL statements that create the analytics tables from these staging tables.

An introductory tutorial about Python Luigi. ETL

Created an automated pipeline that takes in new data from a movie set. Performed the appropriate transformations, and loaded the data into existing tables. Performed the ETL process by adding the data to a PostgreSQL database.

This project aims to classify and analyze the public sentiment on COVID vaccination across time, languages and countries. It's divided in 3 parts: data collection and transformation;exploratory analysis and data visualization with a dashboard; topic modelation and sentiment analysis.

Data Engineering Nano Degree Programm of Udacity - Project 3 - Project: Data Warehouse

An implementation of the data integration process Extract, Transform, Load (ETL)

In this script, I created an ETL pipeline that extracts datasets from the AWS S3 source bucket on a scheduled basis, creates a report using transformations and load the transformed data to another AWS S3 target bucket.

Database Schema & ETL pipeline for Song Play Analysis | Bosch AI Talent Accelerator Scholarship Program