gcc+mpich bugs with FMS and ufs-weather-model

[climbfuji]

From the release notes of FMS 2022.01 (https://github.com/NOAA-GFDL/FMS/releases/tag/2022.01):

Known Issues
The MPICH MPI implementation is unsupported when used alongside GCC 10 or 11 due to compilation issues with the mixed precision reals. MPICH can still be used to compile FMS with GCC 9 or earlier, or with other compilers.
GCC 11.1.0 is unsupported due to compilation issues with select type. The issue appears to be resolved in later GCC releases

Also, from a recent PR made to the ufs-weather-model (ufs-community/ufs-weather-model#1147):

WARNING: We are currently using mpich MPI library with the gnu compilers on Hera and SGI MPT on Cheyenne. mpi_f08 module in mpich, when compiled with the current versions of the gnu compilers, has some issues and MPT does not provide mpi_f08 module at all. Which means this PR will require us to switch to OpenMPI, which will require hpc-stack to be rebuild on these two platforms. Do we want to do that? Do we want to make (working) mpi_f08 module a requirement for ufs-weather-model?

Further, the homebrew version of mpich on macOS doesn't support mpi_f08, but homebrew open-mpi does. I tried to compile mpich manually with [email protected], and ./configure said that Fortran 2008 is not supported.

To me, this means that we should switch to using open-mpi as mpi provider with gcc, clang, apple-clang to avoid these problems altogether.