Tags

Version v0.6.0
- Add suppor for slash commands
- Add response time measurement to code suggestion
- Migrate daily run pipelines to GitLab CI

Version v0.5.0

- Update docs
- Upgrade dependencies
- Fix bugs around structured prompt

Version 0.4.0.
- Removes `input_adapter`. Break existing configs and requires new config format.
- Introduces new code-creation pipeline
- Added mixtral

Version v0.3.7

Version v0.3.6

Version 0.3.5

New Features:
- Support output results to local files
- New config field (`output_sinks`) to write results to multiple locations
- Added ability to compare with ground truth with code generation datasets

Optimization:
- Reduce the number of text-embedding API calls by 50% in similarity score metric

Misc:
- Added test coverage report in CI
- Better logging
- Upgrade python to 3.11.8

Version 0.3.0

- Various bug fixes.
- Introduce a new config format where the user can specify one or more metrics.
- Introduce a new metric "Collective LLM Judge"
- Add a new field to the output table to show the timestamp of the pipeline run.

Bug fix for question ID

Additional error check