ETL

Configuration and data workflows for an instance of Apache Airflow for the DDR ecosystem

Simulation of a real hospital scenario with a ML model in production

Crawl and extract Home Depot's schema.org/Products.

Official weather data ETL for wind energy project evaluation in El Calafate, Argentina.

Live data source that can be used for data engineering, data warehouse and etl development.

Live data source that can be used for data engineering, data warehouse and etl development.

Live data source that can be used for data engineering, data warehouse and etl development.

Stack Exchange releases "data dumps" of all its publicly available content roughly every three months via archive.org.

This project is an example and a framework for building ETL for this data with Apache Spark and Java.