Pull examples from LangSmith
What does this merge request do and why?
This MR provides a new CLI command to sync local datasets with LangSmith by pulling changes. Part of #40 (comment 2143234528). We will wrap this CLI command into a CI job to automate the process.
How to set up and validate locally
- Check out to this merge request's branch.
- Update your .env file
- Install dependencies.
poetry install
- Check the existing commands ELI5 provides:
poetry run eli5 datasets --help
- Download the datasets:
poetry run eli5 datasets sync <your folder>
- Wait for 10 minutes
- Try to download the datasets again:
poetry run eli5 datasets sync <your folder> # no new changes added
- Make any changes in LangSmith - create new dataset, add an example, etc.
- Get the new changes locally:
poetry run eli5 datasets sync <your folder>
Merge request checklist
-
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
Ref: #40 (closed)
Edited by Alexander Chueshev