Reduce number of tokens sent for RCA
What does this MR do and why?
Reduce number of tokens sent for RCA
We see that 15% of RCA calls are failing due to the sent prompt being too long. Here we reduce the multiplier by .5 which will send over a smaller dataset.
Tokenization libraries were non-existent for ruby when this feature was built. Tokenization algorithms look different depending on the model.
Issue: #464585 (closed)
Edited by Allison Browne