Added retry for embedding api call. (!188) · Merge requests · GitLab.org / ModelOps / AI Model Validation and Research / AI Evaluation / Prompt Library · GitLab

Hongtao Yang requested to merge fix-eval-500 into main Jan 04, 2024

What does this merge request do and why?

Added retry to embedding api call, to resolve the 500 internal error during code-suggestions eval pipeline.

Ref: https://gitlab.com/gitlab-org/modelops/ai-model-validation-and-research/prompt-library/-/issues/127

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Merge request checklist

I've ran the affected pipeline(s) to validate that nothing is broken.
Tests added for new functionality. If not, please raise an issue to follow up.
Documentation added/updated, if needed.