ETL

Configuration and data workflows for an instance of Apache Airflow for the DDR ecosystem

This project/library contains common elements related to ETL processes...

Advanced data synchronization framework.

Reporting for MIT Club of Northern California

В данном проекте находятся два задания, написанные на Python и реализующие выполнение цепочек задач (DAG) в среде Airflow

Simulation of a real hospital scenario with a ML model in production

Official weather data ETL for wind energy project evaluation in El Calafate, Argentina.

target-core is a Singer Target which intend to work with regular Singer Tap. The Goal is to use this package as a foundation to build other targets focusing on the core features, reducing the energy spent on maintaining the common parts.

tap-core is a Singer Tap which intend to work with regular Singer Targets. The Goal is to use this package as a foundation to build other taps focusing on the core features, reducing the energy spent on maintaining the common parts.

Quick and dirty pipeline to prepare a dataset for mobility studies, starting from a collection of CDRs.

Live data source that can be used for data engineering, data warehouse and etl development.

Moved to: https://github.com/atviriduomenys/spinta

A Python extract, transform, load (ETL) pipeline for the CityPulse Smart City dataset.

Amaxa is a new data loader and ETL (extract-transform-load) tool for Salesforce, designed to support the extraction and loading of complex networks of records in a single operation.

Primary repo now on GitHub: https://github.com/davidmreed/amaxa

Beetle aims to be a comprehensive ETL solution for transforming NOSQL data to relational structure.

Process responsible for load data from devops to SSPO.

ETL de extracción de datos de una base de datos postgresql como archivos CSV, conversión a JSON y carga de estos en Elastic Search

Este projeto consiste dos softwares criados pelos alunos do 5º ano de computação e cartografia do IME, por ocasião da ORF 2020 em Manaus, em apoio ao CCOp do CMA. O objetivo dos softwares é realizar ETL para BI.

Scrappy learning and experiments