Adding PUSH from ELI5 Datasets to LangSmith in the Form of CREATE with Splits
What does this merge request do and why?
This is the other half of syncing data from the ELI5/datasets => LangSmith.
Originally there was a plan to create a fully separate mode under the datasets sync
command but it was realised that if we use splits (which are defined in the documentation attached to this MR) we could extend the datasets create
command
How to set up and validate locally
- Check out to this merge request's branch.
- Update your .env file
- Install dependencies.
poetry install
- Check the existing commands ELI5 provides:
poetry run eli5 datasets --help
- Push a test datasets to LangSmith:
poetry run eli5 datasets create <dataset name> <path to the dataset file> --upsert --split <split name>
- Wait several minutes and then check in LangSmith
Merge request checklist
-
Tests added for new functionality. If not, please raise an issue to follow up. -
Documentation added/updated, if needed.
Closes:
Edited by Stephan Rayner