Switch Comparison Pipeline to be dynamic (!143) · Merge requests · GitLab.org / Quality Department / GitLab Performance Tool

Grant Young requested to merge gy-compare-improvements into master Apr 03, 2020

MR Updates the Comparison Pipeline as follows:

Switches the comparison pipeline to use new custom GitLab images (Images MR - performance-images!1 (merged)) with updated performance test data
Pipeline now utilizes new Dynamic Child Pipelines feature to generate the pipeline config dynamically via a new script
Pipeline will also now only test the previous 5 released versions at runtime
Comparison results now show percentage point changes against the ideal target of 500ms instead of straight percentage changes between two results. This results in less "spiky" and more representative percentage changes as all the results are pinned against the same target.
General improvements and updates

Edited Apr 08, 2020 by Grant Young

Switch Comparison Pipeline to be dynamic