Skip to content

Vertex AI Search for Documentation tool

Mark Chao requested to merge vertex-ai-search-for-doc-tool into master

What does this MR do and why?

  • Create client specifically for GitLab Documentation search
    • The endpoint it talks to would handle both question embedding and embedding nearest neighbor search
  • Add ai_gateway_docs_search feature flag to guard this WIP feature
    • This would also change the direct Anthropic call to be using AI Gateway

Part of #451215 (closed)

MR acceptance checklist

Please evaluate this MR against the MR acceptance checklist. It helps you analyze changes to reduce risks in quality, performance, reliability, security, and maintainability.

How to set up and validate locally

This feature is WIP so we will be testing existing functionality.

Ensure ai_gateway_docs_search is off and ask a typical documentation question such as "How do I clone a repository?". Verify that the response is good.

Edited by Mark Chao

Merge request reports