Improvement to the software stack related to Caliper and Hatchet.

[adrienbernede]

We now use Caliper and Hatchet in some CI jobs.

Caliper is installed with Spack, but requires some external packages to be set to install quickly. We may consider another version of python, and many systems do not have elfutils installed, so we need to install it too.

Hatchet is installed in the gapps working directory for the default system python. Here too we may consider other versions of python, and attempt to make the software stack more coherent.

The attempt to use an upstream spack instance sometime worked, and sometimes failed. It will be mandatory to improve the reliability of this method if we want to use it in CI.

See @jonesholger comments in #291 for reference of the above points.