Skip to content

Geo: Increase parallelism by scheduling project repositories by shard

Stan Hu requested to merge sh-geo-shard-specific-sync into master

In #3147 (closed), we discussed how we can increase the throughput of repository sync by scheduling them based on the shard. This MR changes the behavior of RepositorySyncWorker so that it:

  1. Finds all healthy shards
  2. Schedules a RepositoryShardSyncWorker for each healthy shard

Closes #3147 (closed)

Edited by Stan Hu

Merge request reports