Problems with pre-industrial restart files

[MartinDix]

The pre-industrial config has an atmosphere start dump in /g/data/access/payu/access-esm/input/pre-industrial/start_dump and also sets
restart: /g/data/access/payu/access-esm/restart/pre-industrial. E.g.
https://github.com/coecms/access-esm/blob/129f7542798bc7fd714872cf2e8212b4a708661c/config.yaml#L16C1-L16C73

However in practice payu ignores pre-industrial.astart and uses restart_dump.astart file from /g/data/access/payu/access-esm/restart/pre-industrial and this one is corrupt, e..g https://forum.access-hive.org.au/t/confused-on-running-a-pre-industrial-test-of-access-esm1-5-with-payu/1656/8. The model fails with a FP error in the UM almost immediately.

If /g/data/access/payu/access-esm/restart/pre-industrial/atmosphere/restart_dump.astart is removed so that pre-industrial.astart is used the model runs ok. Alternately copy that file and skip the separate specification of the atmospheric start file.

However the atmospheric restart file doesn't match either PI-01.astart-01010101 or PI-02.astart-01010101 and so the experiment doesn't reproduce a standard run.

Using the correct PI-01 010101 restart files does not reproduce the original run. It was done on raijin and likely used a much older compiler.

Using the PI-02 010101 restarts does match the PI-02 run (which was done on gadi). These files are in /g/data/vk83/experiments/inputs/access-esm1p5/pre-industrial/restart/