Tokenizer: moved test-only tokenize()
to SimpleTokenizer
/ several cleanups
#9814
Loading
tokenize()
to SimpleTokenizer
/ several cleanups
#9814