Skip to content

Decrease number of tokens

Allison Browne requested to merge ab-decrease-number-of-tokens into master

What does this MR do and why?

We saw some requests that were coming back with INVALID_ARGUMENT. We realized it was due to the input length.

After tweaking down the multiplier we found that even 2.5 was to high in some real scenarios.

Here we adjust the multiplier to 2.

Edited by Allison Browne

Merge request reports