Skip to content

Pull LangSmith datasets as part of the CI job

Alexander Chueshev requested to merge ac/sync-datasets-ci-job into main

What does this merge request do and why?

This MR provides a manual CI job to run the ELI5 sync command and upload the datasets to the LFS repo. Please, note that after merging this MR, I'll create a scheduler to run this job only against the main branch.

Part of #40 (comment 2143234528).

How to set up and validate locally

Manually trigger the langsmith:pull job to produce an MR similar to !182 (closed).

Merge request checklist

  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Alexander Chueshev

Merge request reports