Skip to content

Add support for eval with additional context

Allen Cook requested to merge acook/chat_context_eval into main

What does this merge request do and why?

Adds context-aware chat eval

How to set up and validate locally

poetry run eli5 duo-chat evaluate-context --evaluate-with-llm

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Allen Cook

Merge request reports

Loading