Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gradient Checkpointing Error #310

Open
shenoynikhil opened this issue Mar 23, 2024 · 1 comment
Open

Gradient Checkpointing Error #310

shenoynikhil opened this issue Mar 23, 2024 · 1 comment

Comments

@shenoynikhil
Copy link

shenoynikhil commented Mar 23, 2024

I was trying to use gradient checkpointing with TorchMD model. For some reason, I get this gradient mismatch whenever the warning pops up

if not mask.all():
warnings.warn(
(
f"Skipping gradients for {(~mask).sum()} atoms due to vector features being zero. "
"This is likely due to atoms being outside the cutoff radius of any other atom. "
"These atoms will not interact with any other atom unless you change the cutoff."
)
)

@RaulPPelaez
Copy link
Collaborator

I believe this should be ok to ignore if you are ok with its message (a.i. you know the cutoff is such that some atoms are left alone). If you know for a fact this is not the case but the message pops up anyway then this is a bug.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants