Pull LangSmith datasets as part of the CI job
What does this merge request do and why?
This MR provides a manual CI job to run the ELI5 sync command and upload the datasets to the LFS repo.
Please, note that after merging this MR, I'll create a scheduler to run this job only against the main
branch.
Part of #40 (comment 2143234528).
How to set up and validate locally
Manually trigger the langsmith:pull
job to produce an MR similar to !182 (closed).
Merge request checklist
-
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
Edited by Alexander Chueshev