Bump anthropic from 0.7.7 to 0.8.0
What does this merge request do and why?
Bump anthropic from 0.7.7
to 0.8.0
.
This is mainly to address a memory leak issue when Client.with_options
is used.
Two notable changes that I think will be beneficial to AI Gateway.
- avoid leaking memory when
Client.with_options
is used (#275) (5e51ebd) - ensure retried requests are closed (#261) (5d9aa75)
Full changelog.
How to set up and validate locally
Numbered steps to set up and validate the change are strongly suggested.
- Check out to this merge request's branch.
- Ensure a local Docker image built successfully.
docker buildx build --platform linux/amd64 \ -t ai-gateway:dev .
- Run a local service on Docker.
docker run --platform linux/amd64 --rm \ -p 5052:5052 \ -e AUTH_BYPASS_EXTERNAL=true \ -v $PWD:/app -it ai-gateway:dev
- Run a cURL command to test code generations
curl --request POST \ --url http://codesuggestions.gdk.test:5052/v2/code/generations \ --header 'Content-Type: application/json' \ --header 'X-Gitlab-Authentication-Type: oidc' \ --data '{ "prompt_version": 2, "project_path": "awesome_project", "project_id": 23, "current_file": { "file_name": "main.go", "content_above_cursor": "", "content_below_cursor": "" }, "prompt": "write me a Dr Seus poem about GitLab AIDevSecOps for 30 words\n", "model_provider": "anthropic" }' { "id": "id", "model": { "engine": "anthropic", "name": "claude-2.0", "lang": "go" }, "experiments": [], "object": "text_completion", "created": 1703047941, "choices": [ { "text": "\nHere is a 30-word Dr. Seuss-style poem about GitLab AIDevSecOps:\n\nGitLab AI, GitLab AI, \nHelping devs and secops play.\nWith tools to scan, tools to fix,\nBugs and risks it nix and nix. \nCI/CD pipelines it fuels,\nTo push code that nobody rues.\nSo hurray for GitLab AI, \nMaking app sec easy as pie!", "index": 0, "finish_reason": "length" } ] }
Merge request checklist
-
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
Edited by Shinya Maeda