Parse timestamp metrics from build log
from gitlab-runner#2505 (comment 40484261) , build logs will be annotated with markers like: \rsection_start:1505492007:clone\r
and \rsection_end:1505492107:clone\r
- We need to create a new table:
ci_build_trace_sections
with:byte_start, byte_end, date_start, date_end, name
, - Parse markers once build is finished,
- Store markers in a separate table.
This allows us later to:
- Create analytics how long each section took, or how long jobs in pipeline spend on cloning,
- Create a timeline of whole pipeline showing overlap between sections,
- Make collapsable sections as part of job, or sections to be separate traces displayed,
- Make data accessible via API or be pushed to other systems for accounting (via webhooks?).
Let's keep the marker implementation details on gitlab-runner#2505 (closed)
cc: @ayufan @bikebilly