Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optim-wip: Add the CLIP ResNet 50x4 model #927

Open
wants to merge 4 commits into
base: optim-wip
Choose a base branch
from
Open

Optim-wip: Add the CLIP ResNet 50x4 model #927

wants to merge 4 commits into from

Conversation

ProGamerGov
Copy link
Contributor

@ProGamerGov ProGamerGov commented Apr 26, 2022 •
edited
Loading

  • Added the CLIP ResNet 50x4 model used in the 'Multimodal Neurons in Artificial Neural Networks' research paper: https://distill.pub/2021/multimodal-neurons/
  • To make it easier to conduct research, the CLIP ResNet 50x4 model is divided into two parts; the image model and the text model.

I have a couple tutorials ready that use this model. I also have another PR ready that implements the tokenizer for the text model, using torchtext's CLIPTokenizer.

@ProGamerGov ProGamerGov force-pushed the optim-wip-clip-vis branch from 3dca15b to e9598ea Compare May 13, 2022 21:21
@ProGamerGov
Copy link
Contributor Author

The CLIP PRs are: #927, #943, #945, #961, #965, #966, #968

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
cla signed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ProGamerGov @facebook-github-bot