lexer

Simple tokenizer and lexer library.

Single Line Operations Processor (SLOP) is an extensible expression language using it's own grammar system. Results are derived from expression strings which can be stored in anything i.e. database records, annotations in code, documents etc.

For my compiler theory class in college, the students each built a compiler from the ground up for a fictional language, C-. This is the lexer, which parses the text of the program into a tokenized format.