Skip to content

Reduce number of tokens sent for RCA

Allison Browne requested to merge ab-adjust-max-characters-rca into master

What does this MR do and why?

Reduce number of tokens sent for RCA

We see that 15% of RCA calls are failing due to the sent prompt being too long. Here we reduce the multiplier by .5 which will send over a smaller dataset.

Tokenization libraries were non-existent for ruby when this feature was built. Tokenization algorithms look different depending on the model.

Issue: #464585 (closed)

Edited by Allison Browne

Merge request reports