Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sdxl fine tunes #53

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Conversation

matt-bornstein
Copy link

This is a new tab to run a bunch of SDXL fine tunes on a single prompt.

It pulls models from https://replicate.com/collections/sdxl-fine-tunes.

The hard-ish part is deciding how to prompt each model. I hard-coded templates for a bunch of them in lib/sdxlfinetunes.js. If the app encounters a model not in that set, it uses llama2 to guess at the format from a single example. The logic for this is in pages/api/predictions/sdxlfinetunes.js.

This could be improved in various ways:

  • Store the templates in supabase instead of hard coded
  • Add more templates for the rest of the models
  • Pull more example prompts for each model before guessing (few shot vs single shot)
  • Improve llama2 prompt in some other way

I'm sure I broke a bunch of conventions etc, so happy to change anything

@vercel
Copy link

vercel bot commented Sep 11, 2023

@matt-bornstein is attempting to deploy a commit to the Replicate Team on Vercel.

A member of the Team first needs to authorize it.

@vercel
Copy link

vercel bot commented Oct 19, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
zoo ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 19, 2023 5:58pm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant