spark

testing-case to run Stackable Spark-Operator to run any SQL query (on a PostgreSQL) e.g. for copying data. A Micronaut service creates a gRPC service

"Cloud container data analytics, statistical modeling, and machine learning on distributed databases". "A free opensource alternative to SPSS, SAS, MATLAB, PowerBI, Tableau and Alteryx". Runs on Linux, Windows, MacOS, and in the cloud via containers.

This web app finds the best configuration of a Spark Application given the hardware of the cluster

Stack Exchange releases "data dumps" of all its publicly available content roughly every three months via archive.org.

This project is an example and a framework for building ETL for this data with Apache Spark and Java.

Spark on docker. running on composer or docker swarm