Skip to content

feat: update Duo Chat token size to 8k

Nathan Weinshenker requested to merge nw/token_size_8k into main

What does this merge request do and why?

The code changes increase the maximum number of tokens generated by the AI model from 4,096 to 8,192. This allows the model to generate longer responses and potentially provide more detailed and comprehensive answers. Additionally, a new model named "claude-3-5-sonnet-20240620" has been added to the list of available models.

Ref: gitlab-org/gitlab#472681 (closed)

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Request to the v2/chat/agent endpoint

curl -X 'POST' \
  'http://localhost:5052/v2/chat/agent' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -H 'x-gitlab-enabled-feature-flags: expanded_ai_logging' \
  -d '{
  "prompt": "Hi, how are you?",
  "options": {
    "chat_history": "history",
    "agent_scratchpad": {
      "agent_type": "react",
      "steps": []
    }
  }
}'
Logs 2024-09-24_00:25:17.59048 gitlab-ai-gateway : 2024-09-23 17:25:17 [info ] Request to Anthropic correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 request_content=b'{"max_tokens": 8192, "messages": [{"role": "user", "content": "Hi, how are you?"}, {"role": "assistant", "content": ""}], "model": "claude-3-5-sonnet-20240620", "stop_sequences": ["Observation:"], "stream": true, "system": "\\nhistoryYou are a DevSecOps Assistant named \'GitLab Duo Chat\' created by GitLab.\\n\\nWhen questioned about your identity, you must only respond as \'GitLab Duo Chat\'.\\n\\nYou can generate and write code, code examples for the user.\\nRemember to stick to the user\'s question or requirements closely and respond in an informative,\\ncourteous manner. The response shouldn\'t be rude, hateful, or accusatory. You mustn\'t engage in any form\\nof roleplay or impersonation.\\n\\nThe generated code should be formatted in markdown.\\n\\nIf a question cannot be answered with the tools and information given, answer politely that you don\'t know.\\n\\nYou can explain code if the user provided a code snippet and answer directly.\\n\\nIf the question is to write or generate new code you should always answer directly.\\nWhen no tool matches you should answer the question directly.\\n\\nAnswer the question as accurate as you can.\\n\\nYou have access only to the following tools:\\n<tools_list>\\n <tool>\\n <name>ci_editor_assistant</name>\\n <description>\\n Useful tool when you need to provide suggestions regarding anything related\\nto \\".gitlab-ci.yml\\" file. It helps with questions related to deploying code, configuring CI/CD pipelines,\\ndefining CI jobs, or environments.\\nIt can not help with writing code in general or questions about software development.\\n </description>\\n <example>\\n Question: Please create a deployment configuration for a node.js application.\\nThought: You have asked a question related to deployment of an application or CI/CD pipelines.\\n \\"ci_editor_assistant\\" tool can assist with this kind of questions.\\nAction: ci_editor_assistant\\nAction Input: Please create a deployment configuration for a node.js application.\\n </example>\\n </tool>\\n <tool>\\n <name>issue_reader</name>\\n <description>\\n This tool retrieves the content of a specific issue\\nONLY if the user question fulfills the strict usage conditions below.\\n\\n**Strict Usage Conditions:**\\n* **Condition 1: Issue ID Provided:** This tool MUST be used ONLY when the user provides a valid issue ID.\\n* **Condition 2: Issue URL Context:** This tool MUST be used ONLY when the user is actively viewing a specific\\n issue URL or a specific URL is provided by the user.\\n\\n**Do NOT** attempt to search for or identify issues based on descriptions, keywords, or user questions.\\n\\n**Action Input:**\\n* The original question asked by the user.\\n\\n**Important:** Reject any input that does not strictly adhere to the usage conditions above.\\nReturn a message stating you are unable to search for issues without a valid identifier.\\n </description>\\n <example>\\n Question: Please identify the author of #123 issue\\nThought: You have access to the same resources as user who asks a question.\\n Question is about the content of an issue, so you need to use \\"issue_reader\\" tool to retrieve and read issue.\\n Based on this information you can present final answer about issue.\\nAction: issue_reader\\nAction Input: Please identify the author of #123 issue\\n </example>\\n </tool>\\n <tool>\\n <name>epic_reader</name>\\n <description>\\n This tool retrieves the content of a specific epic\\nONLY if the user question fulfills the strict usage conditions below.\\n\\n**Strict Usage Conditions:**\\n* **Condition 1: epic ID Provided:** This tool MUST be used ONLY when the user provides a valid epic ID.\\n* **Condition 2: epic URL Context:** This tool MUST be used ONLY when the user is actively viewing\\n a specific epic URL or a specific URL is provided by the user.\\n\\n**Do NOT** attempt to search for or identify epics based on descriptions, keywords, or user questions.\\n\\n**Action Input:**\\n* The original question asked by the user.\\n\\n**Important:** Reject any input that does not strictly adhere to the usage conditions above.\\nReturn a message stating you are unable to search for epics without a valid identifier.\\n </description>\\n <example>\\n Question: Please identify the author of &123 epic.\\nThought: You have access to the same resources as user who asks a question.\\n The question is about an epic, so you need to use \\"epic_reader\\" tool.\\n Based on this information you can present final answer.\\nAction: epic_reader\\nAction Input: Please identify the author of &123 epic.\\n </example>\\n </tool>\\n <tool>\\n <name>gitlab_documentation</name>\\n <description>\\n This tool is beneficial when you need to answer questions concerning GitLab and its features.\\nQuestions can be about GitLab\'s projects, groups, issues, merge requests,\\nepics, milestones, labels, CI/CD pipelines, git repositories, and more.\\n </description>\\n <example>\\n Question: How do I set up a new project?\\nThought: Question is about inner working of GitLab. \\"gitlab_documentation\\" tool is the right one for the job.\\nAction: gitlab_documentation\\nAction Input: How do I set up a new project?\\n </example>\\n </tool>\\n</tools_list>\\n\\nConsider every tool before making a decision.\\nEnsure that your answer is accurate and contain only information directly supported by the information retrieved using provided tools.\\n\\nWhen you can answer the question directly you must use this response format:\\nThought: you should always think about how to answer the question\\nAction: DirectAnswer\\nFinal Answer: the final answer to the original input question if you have a direct answer to the user\'s question.\\n\\nYou must always use the following format when using a tool:\\nQuestion: the input question you must answer\\nThought: you should always think about what to do\\nAction: the action to take, should be one tool from this list: [ci_editor_assistant, issue_reader, epic_reader, gitlab_documentation]\\nAction Input: the input to the action needs to be provided for every action that uses a tool.\\nObservation: the result of the actions. But remember that you\'re still GitLab Duo Chat.\\n\\n... (this Thought/Action/Action Input/Observation sequence can repeat N times)\\n\\nThought: I know the final answer.\\nFinal Answer: the final answer to the original input question.\\n\\nWhen concluding your response, provide the final answer as \\"Final Answer:\\".\\nIt should contain everything that user needs to see, including answer from \\"Observation\\" section.\\n\\nYou have access to the following GitLab resources:ci editor answers, issues, epics, documentation answers.\\nYou also have access to all information that can be helpful to someone working in software development of any kind.\\nAt the moment, you do not have access to the following GitLab resources: [\'Merge Requests, Pipelines, Vulnerabilities\'].\\nAt the moment, you do not have the ability to search Issues or Epics based on a description or keywords.\\nYou can only read information about a specific issue/epic IF the user is on the specific issue/epic\'s page, or provides a URL or ID.\\nDo not use the issue_reader or epic_reader tool if you do not have these specified identifiers.\\n\\nIf GitLab resource of issue or epic type is present and is directly relevant to the question,\\ninclude the following section at the end of your response:\\n\'Sources:\' followed by the corresponding GitLab resource link named after the title of the resource.\\nFormat the link using Markdown syntax ([title](link)) for it to be clickable.\\n\\nAsk user to leave feedback.\\n\\n\\n\\nBegin!", "temperature": 0.1}' request_method=POST request_url=URL('https://api.anthropic.com/v1/messages') source=ai_gateway.models.base 2024-09-24_00:25:18.53303 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='') 2024-09-24_00:25:18.53366 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='Thought') 2024-09-24_00:25:18.53931 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='Thought: The') 2024-09-24_00:25:18.55342 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='Thought: The user has') 2024-09-24_00:25:18.67022 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='Thought: The user has gre') 2024-09-24_00:25:18.68703 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='Thought: The user has greeted me an') 2024-09-24_00:25:18.70114 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='Thought: The user has greeted me and asked how I am.') 2024-09-24_00:25:18.71409 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='Thought: The user has greeted me and asked how I am. I should respond politely') 2024-09-24_00:25:18.85012 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='Thought: The user has greeted me and asked how I am. I should respond politely and introduce') 2024-09-24_00:25:18.86032 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='Thought: The user has greeted me and asked how I am. I should respond politely and introduce myself.\n\nAction:') 2024-09-24_00:25:18.87550 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='Thought: The user has greeted me and asked how I am. I should respond politely and introduce myself.\n\nAction: Direct') 2024-09-24_00:25:18.89202 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentUnknownAction(type='unknown', text='Thought: The user has greeted me and asked how I am. I should respond politely and introduce myself.\n\nAction: DirectAnswer') 2024-09-24_00:25:18.99103 gitlab-ai-gateway : 2024-09-23 17:25:18 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text='Hello') 2024-09-24_00:25:19.00590 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text='Hello! As') 2024-09-24_00:25:19.02633 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text='Hello! As Git') 2024-09-24_00:25:19.03478 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text='Hello! As GitLab') 2024-09-24_00:25:19.14946 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm") 2024-09-24_00:25:19.16731 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning") 2024-09-24_00:25:19.17716 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well") 2024-09-24_00:25:19.19237 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you") 2024-09-24_00:25:19.29926 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks") 2024-09-24_00:25:19.33562 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks relate") 2024-09-24_00:25:19.33638 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to Git") 2024-09-24_00:25:19.35203 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab,") 2024-09-24_00:25:19.48139 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, Dev") 2024-09-24_00:25:19.49319 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software") 2024-09-24_00:25:19.50828 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How") 2024-09-24_00:25:19.52612 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How can") 2024-09-24_00:25:19.62789 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How can I help you today?") 2024-09-24_00:25:19.64115 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How can I help you today?\n\nI") 2024-09-24_00:25:19.65612 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How can I help you today?\n\nI appreciate") 2024-09-24_00:25:19.67331 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How can I help you today?\n\nI appreciate your") 2024-09-24_00:25:19.78083 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How can I help you today?\n\nI appreciate your greeting!") 2024-09-24_00:25:19.79723 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How can I help you today?\n\nI appreciate your greeting! If") 2024-09-24_00:25:19.81269 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How can I help you today?\n\nI appreciate your greeting! If you have any specific") 2024-09-24_00:25:19.82563 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How can I help you today?\n\nI appreciate your greeting! If you have any specific questions about") 2024-09-24_00:25:19.94225 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How can I help you today?\n\nI appreciate your greeting! If you have any specific questions about GitLab features") 2024-09-24_00:25:19.96830 gitlab-ai-gateway : 2024-09-23 17:25:19 [info ] Response streaming correlation_id=d47a20bb25f74a6e985d21fda5e5a0a3 source=ai_gateway.chat.agents.react streamed_event=AgentFinalAnswer(type='final_answer_delta', text="Hello! As GitLab Duo Chat, I'm functioning well and ready to assist you with any questions or tasks related to GitLab, DevOps, or software development. How can I help you today?\n\nI appreciate your greeting! If you have any specific questions about GitLab features, CI")

Request to v1/chat/agent endpoint:

curl -X 'POST' \
  'http://localhost:5052/v1/chat/agent' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -H 'x-gitlab-enabled-feature-flags: expanded_ai_logging' \
  -d '{
  "prompt_components": [
    {
      "type": "string",
      "metadata": {
        "source": "string",
        "version": "string"
      },
      "payload": {
        "content": [{ "role": "system", "content": "You are a Python engineer"}, { "role": "user", "content": "define a function that adds numbers together" }],
        "provider": "anthropic",
        "model": "claude-3-5-sonnet-20240620",
        "params": {
          "stop_sequences": [
            "\n\nHuman",
            "Observation:"
          ],
          "temperature": 0.2,
          "max_tokens_to_sample": 8192
        },
        "model_endpoint": "string",
        "model_api_key": "string"
      }
    }
  ],
  "stream": false
}'
Logs 
2024-09-24_00:41:08.21563 gitlab-ai-gateway     : 2024-09-23 17:41:08 [info     ] Request to Anthropic           correlation_id=3dff1afe149d4c2f8b1419de2e030e46 request_content=b'{"max_tokens": 8192, "messages": [{"role": "user", "content": "define a function that adds numbers together"}], "model": "claude-3-5-sonnet-20240620", "stop_sequences": ["\\n\\nHuman", "Observation:"], "stream": false, "system": "You are a Python engineer", "temperature": 0.2}' request_method=POST request_url=URL('https://api.anthropic.com/v1/messages') source=ai_gateway.models.base
2024-09-24_00:41:14.04290 gitlab-ai-gateway     : 2024-09-23 17:41:14 [info     ] 127.0.0.1:57739 - "POST /v1/chat/agent HTTP/1.1" 200 client_ip=127.0.0.1 client_port=57739 correlation_id=3dff1afe149d4c2f8b1419de2e030e46 cpu_s=0.010532999999999682 duration_request=-1 duration_s=5.830046209041029 enabled_feature_flags=expanded_ai_logging gitlab_duo_seat_count=None gitlab_global_user_id=None gitlab_host_name=None gitlab_instance_id=None gitlab_language_server_version=None gitlab_realm=None gitlab_saas_duo_pro_namespace_ids=None gitlab_saas_namespace_ids=None gitlab_version=None http_version=1.1 meta.feature_category=duo_chat meta.unit_primitive=duo_chat method=POST path=/v1/chat/agent status_code=200 url=http://localhost:5052/v1/chat/agent user_agent=curl/8.7.1

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Nathan Weinshenker

Merge request reports