-
Add resolved and completed SWE evaluators 0 of 2 checklist items completed
- Merged
- 13
- Approved
updated -
feat: add codesuggestions client for litellm 0 of 2 checklist items completed
- Merged
- 8
- Approved
updated -
feat: add SWE evaluation to Duo Workflow 0 of 2 checklist items completed
- Merged
- 6
- Approved
updated -
feat: add fireworks inference provider support 0 of 2 checklist items completed
- Merged
- 3
- Approved
updated -
feat: update evaluators to Claude 3.5 Sonnet 1 of 2 checklist items completed
- Merged
- 3
- Approved
updated -
feat: add openai as cs eval client 0 of 2 checklist items completed
- Merged
- 2
- Approved
updated -
feat: add gemini client 0 of 2 checklist items completed
- Merged
- 6
- Approved
updated -
feat: add groq provider for CS 0 of 2 checklist items completed
- Merged
- 7
- Approved
updated -
feat: add cerebras client support 0 of 2 checklist items completed
- Merged
- 6
- Approved
updated -
feat: update code-suggestions evaluation scripts 0 of 2 checklist items completed
- Merged
- 4
- Approved
updated -
Add support for eval with additional context 0 of 2 checklist items completed
- Merged
- 16
- Approved
updated -
feat: support model_provider argument in code suggestions evaluation 0 of 2 checklist items completed
- Merged
- 7
updated -
chore: update code suggestions evaluation guide 0 of 2 checklist items completed
- Merged
- 16
updated -
feat: add code generation client to test xray RAG with libraries 0 of 2 checklist items completed
- Merged
- 33
- Approved
updated -
docs: add guide to testing x-ray rag with code gen 1 of 2 checklist items completed
- Merged
- 9
- Approved
updated -
feat: add cli param to run dataset splits 0 of 2 checklist items completed
- Merged
- 2
- Approved
updated -
feat: add vertex client, embeddings similarity score 0 of 2 checklist items completed
- Merged
- 18
- Approved
updated -
Raise exception when encountering errors from gitlab client 0 of 2 checklist items completed
- Merged
- 7
- Approved
updated -
Update docs with cli args and access steps 1 of 2 checklist items completed
- Merged
- 5
updated -
Add intent param to cli to run code generation 0 of 2 checklist items completed
- Merged
- 4
- Approved
updated