Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

建议添加modelbox-serving的使用说明 #327

Open
luoyangustc opened this issue Nov 16, 2022 · 5 comments
Open

建议添加modelbox-serving的使用说明 #327

luoyangustc opened this issue Nov 16, 2022 · 5 comments

Comments

@luoyangustc
Copy link

看可执行文件里有modelbox-serving的二进制, 但是book的文档里没找到使用方法,可以增加文档介绍么?

@pymumu
Copy link
Contributor

pymumu commented Nov 16, 2022

这两天增加。可以问一下你是什么场景使用modelbox-serving吗?

@luoyangustc
Copy link
Author

ok, 看二进制名字应该是在部署推理服务时使用, 我正好也是想部署服务使用,但是没找到使用文档说明。

@pymumu
Copy link
Contributor

pymumu commented Nov 16, 2022

这个是模型serving的,类似TF-Serving,如果部署服务,就是modelbox进程就可以。

@luoyangustc
Copy link
Author

嗯嗯 我理解两个应该都可以部署推理服务的, 底层是一样的么? serving 是封了一个web的框架?

@pymumu
Copy link
Contributor

pymumu commented Nov 16, 2022

serving只是简化了modelbox图的配置,serveing是基于modelbox进程的。
modelbox进程里面集成了web框架,可以对外提供REST-API服务。具体可以看hello-world的例子

https://modelbox-ai.com/modelbox-book/cases/hello-world.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants