Tokenizer: moved test-only tokenize()
to SimpleTokenizer
/ several cleanups
#3968
Loading
tokenize()
to SimpleTokenizer
/ several cleanups
#3968