Improve safe chunk validation #14610

Job	Run time
Event File	2s
detect ci trigger	3s
ubuntu-latest py3.10	8m 19s
ubuntu-latest py3.12	9m 55s
macos-latest py3.10	6m 28s
macos-latest py3.12	5m 53s
windows-latest py3.10	12m 0s
windows-latest py3.12	12m 1s
ubuntu-latest py3.10 bare-minimum	1m 42s
ubuntu-latest py3.10 min-all-deps	7m 8s
ubuntu-latest py3.12 all-but-numba	7m 16s
ubuntu-latest py3.11 all-but-dask	6m 10s
ubuntu-latest py3.12 flaky	1m 50s
	1h 18m 47s

Provide feedback