BentoML
question: How to use replica in BentoML? #4887
Unanswered
Dawnfz-Lenfeng
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am using the BentoVLLM. How do I configure the service file to use the
replicafeature?Do I need to use the Ray engine for this? I'm not very familiar with these configurations.
Beta Was this translation helpful? Give feedback.
All reactions