Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PixelReplaceStep returns strange output filenames from save_results=True #8904

Closed
stscijgbot-jp opened this issue Oct 18, 2024 · 5 comments
Closed

Comments

@stscijgbot-jp
Copy link
Collaborator

Issue JP-3784 was created on JIRA by Ned Molter:

Running the PixelReplaceStep using regression test data from nirspec/ifu as follows:

fn = glob.glob(stem + "jw01249*_cal.fits")
container = datamodels.ModelContainer(fn)
PixelReplaceStep.call(container, save_results=True, skip=False)

returns filenames that look like "step_PixelReplaceStep_3_pixelreplacestep.fits".  The output filenames should be updated to be more descriptive and more closely match other steps.  Each input model in the list is still saved separately according to an index, so setting this fix as low priority.

@stscijgbot-jp
Copy link
Collaborator Author

Comment by Jane Morrison on JIRA:

Ned Molter Could you give me a little more information. For spec3 we need to run from an association since that  is where the names to assign to output products are taken. I do not think you can run the spec3 pipeline just using a Container. Was an association also set up in the regression test ?

@stscijgbot-jp
Copy link
Collaborator Author

Comment by Jane Morrison on JIRA:

Ned Molter I looked at the regression tests and I am not seeing where this test might have been. Could you tell me the test you were trying to add the pixel_replacement save results ?

 

@stscijgbot-jp
Copy link
Collaborator Author

Comment by Ned Molter on JIRA:

Hi Jane, this was not itself a regression test.  It was tested using the regression test data in our regtest suite (test_bigdata/jwst-pipeline/dev/nirspec/ifu/jw01249*_cal.fits.

 

You are right that an association would normally be used as input to spec3, but a container is a valid input to an individual step, and indeed containers are passed between steps during the spec3 pipeline.  

 

For other steps, I believe the asn ID in the output filenames is taken from container.asn_table["asn_id"], so for the step run I wrote above it might have been a more representative test if that were assigned manually; however, I don't think that would change the result.

 

It would be good to test what happens here if the individual step is run on an association as you suggest, as well as what you get when you run the entire calwebb_spec3 on an asn with pixel_replace.save_results=True

@stscijgbot-jp
Copy link
Collaborator Author

Comment by Melanie Clarke on JIRA:

Fixed by #9019

Will be in build 11.3, not 11.2.

@stscijgbot-jp
Copy link
Collaborator Author

Comment by Melanie Clarke on JIRA:

Closing - no INS testing needed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant