Tokenizer: moved test-only tokenize() to SimpleTokenizer / several cleanups
#2092
| Job | Run time |
|---|---|
| 5m 5s | |
| 5m 5s |
tokenize() to SimpleTokenizer / several cleanups
#2092
| Job | Run time |
|---|---|
| 5m 5s | |
| 5m 5s |