Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding new datasets and new LLMs #1

Open
jihyukkim-nlp opened this issue Jul 28, 2024 · 0 comments
Open

Adding new datasets and new LLMs #1

jihyukkim-nlp opened this issue Jul 28, 2024 · 0 comments

Comments

@jihyukkim-nlp
Copy link

jihyukkim-nlp commented Jul 28, 2024

Hello, thank you for publishing awesome work and sharing codes!

I would like to to apply MoP to other datasets and other LLMs.

  • Could you give us some guidance on adding new models or new datasets?

In addition, for having experiments on shared datasets,

  • I am also wondering what each directory/file means in this link.

For example, bbh directory contains three inner-directories such as raw, raw_original, and source. And, each of the three contains execute and induce.
How is each of them used for experiments?

Best regards,
Jihyuk Kim

@jihyukkim-nlp jihyukkim-nlp changed the title Guidance for dataset/LLM extension Adding new datasets and new LLMs Jul 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant