Skip to content

Draft: MVP Docker Stateful Executor

Georgi N. Georgiev requested to merge ggeorgiev/docker-stateful into ggeorgiev/fault-tolerance

⚠ Based on !4906

This is an MPV based on the Fault Tolerance feature: #36951.

The MVP has a very narrow scope. The only intended and tested use case is when the Runner is killed during a long running command. It will then reattach itself and resume. It doesn't account for stderr, too long logs causing docker logs to start omitting log lines etc. etc.

It has two purposes:

  1. Validate that the assumptions the StatefulExecutor makes work across executors and not only in Kubernetes
  2. Add a bit of details how this would run with Step Runner.

Considering the Step Runner POC integration at !4555 this should give us a glimpse into how the two functionalities can work together.

Video demo:

Screen_Recording_2024-08-26_at_23.57.39

Edited by Georgi N. Georgiev

Merge request reports