Skip to content

Improve the chat accuracy to 70%

Gosia Ksionek requested to merge mk-improve-the-chat-accuracy-to-70 into master

What does this MR do and why?

Slight polish of the prompts to bring better results.

Screenshots or screen recordings

Before After
Screenshot_2023-06-26_at_12.43.40 Screenshot_2023-06-26_at_14.52.28Screenshot_2023-06-26_at_14.52.38Screenshot_2023-06-26_at_14.52.52

How to set up and validate locally

  1. Setup GitLab Chat using instructions: https://docs.gitlab.com/ee/development/ai_features.html#testing-gitlab-chat-with-predefined-questions
  2. Observe rake task accuracy results.

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Merge request reports

Loading