Skip to content

Merge evaluation pipelines

Hongtao Yang requested to merge refactor-eval-pipeline into main
  • Merge the existing 3 pipelines into 1.
  • Added lang_id, testcase_id, prompt_id and symbol count to the output file.
  • Change all entities from NamedTuple to dataclass.
  • Extract dataflow IO into a separate module.
Edited by Hongtao Yang

Merge request reports