ETL

Configuration and data workflows for an instance of Apache Airflow for the DDR ecosystem

This project/library contains common elements related to ETL processes...

Advanced data synchronization framework.

Reporting for MIT Club of Northern California

В данном проекте находятся два задания, написанные на Python и реализующие выполнение цепочек задач (DAG) в среде Airflow

Simulation of a real hospital scenario with a ML model in production

Crawl and extract Home Depot's schema.org/Products.

This is a ETL pipeline that will gather data from a jobs list CSV dataset, with their respective salaries and functions, and make a MySQL database with the average salary of each type of job.

Official weather data ETL for wind energy project evaluation in El Calafate, Argentina.

target-core is a Singer Target which intend to work with regular Singer Tap. The Goal is to use this package as a foundation to build other targets focusing on the core features, reducing the energy spent on maintaining the common parts.

ETL to get energy load shapes for dataport pecanstreet.

tap-core is a Singer Tap which intend to work with regular Singer Targets. The Goal is to use this package as a foundation to build other taps focusing on the core features, reducing the energy spent on maintaining the common parts.

No code self-runnable micro ETL

Quick and dirty pipeline to prepare a dataset for mobility studies, starting from a collection of CDRs.

Interfaces/base classes for the Soong framework.

Live data source that can be used for data engineering, data warehouse and etl development.