Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add eval results for snowflake arctic embed 2.0 (medium and large) #60

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

sfc-gh-pyu
Copy link

No description provided.

@Samoed
Copy link
Collaborator

Samoed commented Dec 4, 2024

You should add revision of model to folder name instead of no_revision_available and also add it to model_meta.json

@KennethEnevoldsen
Copy link
Contributor

Hei @sfc-gh-pyu congratulations on the release very happy to see the PR. If you have a model implementation we would also very much welcome a PR with the implementation over on mteb. You can see an implementation of the models here.

@sfc-gh-pyu
Copy link
Author

@Samoed where can I find / generate revision of the model?

@KennethEnevoldsen
Copy link
Contributor

It should match the revision on the huggingface repo

@dbuades
Copy link
Contributor

dbuades commented Dec 20, 2024

Hello! The implementation of these two models is now merged in mteb with embeddings-benchmark/mteb#1574. @sfc-gh-pyu Would you like me to run the models on these tasks using that implementation?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants