Tokenizer: moved test-only tokenize()
to SimpleTokenizer
/ several cleanups
#6264
Loading
tokenize()
to SimpleTokenizer
/ several cleanups
#6264