Tokenizer: moved test-only `tokenize()` to `SimpleTokenizer` / several cleanups #14786

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
build (windows-2019, debug)	41s
build_qt (windows-2019, 5.15.2)	31s
build (windows-2019, release)	33s
build_qt (windows-2019, 6.6.0)	28s
build (windows-2022, debug)	3m 24s
build_qt (windows-2022, 5.15.2)	27s
build (windows-2022, release)	2m 10s
build_qt (windows-2022, 6.6.0)	21s
	8m 35s