Skip to content

Basic Tokenizer - Creates tokens - enabling for creation of personal syntax; removal of unwanted characters etc

Notifications You must be signed in to change notification settings

spydaz/ClassTokenizer

Repository files navigation

ClassTokenizer

Basic Tokenizer - Creates tokens - enabling for creation of personal syntax; removal of unwanted characters etc