1.1.0 protected

Patrick Gress

@patrick.daniel.gress

0db46612 · Merge branch 'split_by_regex' into 'main' · Jun 16, 2024

- Adding support for multiple tokenizers
- Added support for specifying tokenizer in text file source