Tokenizer: moved test-only tokenize()
to SimpleTokenizer
/ several cleanups
#3973
Loading
tokenize()
to SimpleTokenizer
/ several cleanups
#3973