-
Notifications
You must be signed in to change notification settings - Fork 14
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Upgrade to spack-stack 1.8.0 for running standalone #118
Comments
FYI I tried giving this a shot for release 1.7.0, but |
Great, thank you! It will be great to use the spack-stack for running EMC_verif-global standalone! I'll update the title to reflect 1.8.0. |
I successfully ran using spack-stack 1.6.0 on S4.
See the changes on my fork, branch migration/spack/stack The change I made in the code is not backward compatible, however, it is easy to adjust it for backward compatibility with matplotlib 3.3 and below. There is still a couple of things to fix
Plotted with spack stack (see the number on top of the top left panel) We can also notice a big change in the data as presented: Look inside the South America for the bottom left panel of each of the plot; the difference is big. For the two bottom panel, there seems to be no negative value with HPC stack, while there are negative values with spack-stack. |
This is interesting, thanks for putting this out @InnocentSouopgui-NOAA. What if you do ncview on the two files? I guess I first want to make sure all is well with the MET and METplus installations. If it is the external libraries, I would suspect using ncview the files would look the same. If you need help investigating and there is a way to get this all on Hera, I can help investigate. |
@malloryprow, I put the tes data on hera at /scratch2/NESDIS/nesdis-rdo1/Innocent.Souopgui/verif_global_input_data |
@malloryprow, that looks consistent with what I got using spack stack on S4. |
I did a little more investigations, |
We might need to move quickly to spack stack. |
Tank you for the investigation @InnocentSouopgui-NOAA! @DavidHuber-NOAA Is there a status update for spack-stack v1.8.0? |
@malloryprow The tentative release date is the end of July/beginning of August. This is the issue that is tracking the Python upgrade: JCSDA/spack-stack#1038. |
@InnocentSouopgui-NOAA Which version of spack stack were you using the produced the good plots? This was on S4 correct? |
I used spack-stack 1.6.0 on S4. |
Thanks! That is interesting. I was never able to get the standalone working with 1.6.0 on Hera. I had to us the gsi-addon because that is where MET and METplus were installed but then that version's python didn't have the needed python modules like cartopy to use. |
I also built MET using spack-stack to be able to do that on S4. So I have MET built with spack-stack on s4 as well. |
Also important to say that with spack-stack, python packages come as modules. So you have to load cartopy, matplotlib. numpy, etc. like other modules
before it is available for use in python. |
I have a test installation of PR JCSDA/spack-stack#1252 on Hera. I will be trying it out today to run step2 plotting (g2g, g2o, and precip) as well as maps2d. If you would like to play around with it, I believe this is the load sequence that will be needed:
|
Ah, that is great news, thanks! |
@malloryprow I have been able to run verif-global through the step1 jobs successfully, but the step2 jobs and maps2d are failing. Would you mind taking a look at my branch and seeing if I have something misconfigured? For instance, the log file My working directory is available here on Hera: |
I'll try to give it a look here today. I have some EVS PRs I need to work through that are my priority right now. I'll definitely look at it this week. |
Sounds good, thanks @malloryprow! |
I ran a test for grid2grid step 2 and I'm seeing the same errors your seeing. I'm using different data though (operational GFS stat files). |
Are we sure everything is okay with this python installation? I can even get a simple matplotlib plot to be created with it. https://matplotlib.org/stable/gallery/lines_bars_and_markers/simple_plot.html |
EMC_verif-global standalone will update to using the spack-stack modules in the next spack-stack release (June-July timeframe).
The text was updated successfully, but these errors were encountered: