Support pipeline job context in Duo Chat
Context
This serves two purposes:
- This is an iteration to add more context to Duo Chat so that we can better meet user expectation chat knows important contexts in GitLab.
- This helps the team learn how to add more contexts efficiently, so that we can even more context in the future more quickly than we can do so now.
The questions that users ask in relation to pipelines are outlined in &14085.
There is also the (GA) - Root-cause analysis of failing pipeline ... (&13080 - closed) feature, which addresses the need of getting a pipeline failure explained. The grouppipeline execution had intended to also make the chat aware of the pipeline context, but had to postpone this to post GA. (In the GA version the feature will use a tool to do the entire job, including collecting the context.) As pipeline context is important to users the groupduo chat can pick this up in this issue here (unless there is already an issue, @rutshah / @carolinesimpson please confirm there isn't or close this issue and point @juan-silva to the other issue).
Proposal
- Build a prototype that can read the pipeline job.
- Modify the agent prompt to make use of this new tool.
- Develop a test dataset that will check how effective this solution is using the bash questions in the parent epic.
- Incorporate the new tool into the Chat for every page it is available.
- Allow the user to specify the Pipeline.
- Align the behavior with existing contexts for issues and epics so that it is easy to understand for users.
Pricing and Packaging: Duo Enterprise add-on required
This feature enables users to ask about pipelines in chat. While (GA) - Root-cause analysis of failing pipeline ... (&13080 - closed) answers the most important question "What is the root cause for my pipeline to fail?", we know from feedback (see parent epic) that users expect to be able to ask their specific questions about pipelines in the chat as well using natural language. Hence this feature here.
The Duo Root Cause Analysis features are packaged as Duo Enterprise features, we want to make sure the pipeline-related questions in chat are in the same add-on tier. Hence, the requirement for this feature here is that it adheres to the Duo Enterprise tier and is not available in the Duo Pro add-on.