Tokenizer: moved test-only tokenize()
to SimpleTokenizer
/ several cleanups
#13628
Job | Run time |
---|---|
29m 7s | |
29m 7s |
tokenize()
to SimpleTokenizer
/ several cleanups
#13628
Job | Run time |
---|---|
29m 7s | |
29m 7s |