请教推理服务部署方案 #331
lazycg0427
started this conversation in
General
请教推理服务部署方案
#331
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
我已经训练了多个模型,我希望将这些模型都放置在同一台服务器上节约成本,同时将推理封装成服务,方便使用。请问有推荐的方案吗?
Beta Was this translation helpful? Give feedback.
All reactions