Tokenizer: moved test-only tokenize()
to SimpleTokenizer
/ several cleanups
#9814
Job | Run time |
---|---|
14s | |
14s |
tokenize()
to SimpleTokenizer
/ several cleanups
#9814
Job | Run time |
---|---|
14s | |
14s |