Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

这种情况是正常的吗? #3

Open
MarchBeta2087 opened this issue Nov 13, 2024 · 1 comment
Open

这种情况是正常的吗? #3

MarchBeta2087 opened this issue Nov 13, 2024 · 1 comment

Comments

@MarchBeta2087
Copy link

image

这个是不是就只是加载了模型,没有页面?

@hansjohn
Copy link
Collaborator

hansjohn commented Dec 2, 2024

是的,你现在只是启动了推理的后端,如果你想在InfiniteBench上评测我们的框架,可以参考evaluation
当然,你也可以用以下的脚本来在自己的数据上进行推理:

from utils import read_yaml
from pipeline import BasePipeline

# modify the config, the example configuration file is located in the `config/` directory.
map_reduce_config = read_yaml(
    '/path/to/your/config.yaml')

# modify context and question
context ='your context'
qestion = 'your question'
chunk_size=4096

pipline = BasePipeline(map_reduce_config)
result = pipline.run(doc=context, question=qestion,chunk_size=chunk_size)

print('===============Final Result===============\n')
print(result)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants