Skip to content

Increase the default max_output_tokens for code-bison to 2048

Alexander Chueshev requested to merge ac/code-bison-increase-output-tokens into main

The max allowed max_output_tokens for code-bison is 2048. We need to increase the number of output tokens in order to check the model output when the user triggers the generation mode.

Ref: gitlab-org/gitlab!128987 (merged)

Edited by Alexander Chueshev

Merge request reports