Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

wrong module for OpenCLIP ViT-L/14 laion400m_e32 #12

Open
candemircan opened this issue Aug 1, 2024 · 0 comments
Open

wrong module for OpenCLIP ViT-L/14 laion400m_e32 #12

candemircan opened this issue Aug 1, 2024 · 0 comments

Comments

@candemircan
Copy link

Hey Lukas,

Hope you're well :) I believe the weights you learned for the OpenCLIP ViT-L/14 laion400m_e32 are for the module visual.ln_post and not visual as the folder name suggests in this repo.

Using visual.ln_post with this model in thingsvision returns 768 dimensional features, whereas visual returns 512 dimensional features. The weight matrices in transforms/OpenCLIP_ViT-L-14_laion400m_e32/visual/transform.npz are 768 by 768, matching visual.ln_post

I'm pointing this out because the mismatch of names causes issues when calling the .align method in thingsvision

cheers :)
Can

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant