Skip to content

Tokenizer rework to better limit allowed characters

Nathaniel Craig Fisher requested to merge tokenizer-update into main

Closes #31 (closed) Restricts allowed characters for variable names to lower and upper case letters, as well as digits in a non-primary position. Reworks the tokenizefunction to allow optional spacing between most operators and the "=" keyword.

Merge request reports