Skip to content

Cache API response from Vertex AI API

mo khan requested to merge mokhax/409143/cache-responses into master

What does this MR do and why?

This change caches responses from the Vertex AI API for a period of 5 minutes.

https://gitlab.com/gitlab-org/gitlab/-/issues/409143

MR acceptance checklist

This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.

Edited by Vasilii Iakliushin

Merge request reports

Loading