We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
I'm evaluating with the officially supported tasks/models/datasets.
'Python': '3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0]', 'TorchVision': '0.16.0a0', 'lmdeploy': "not installed:No module named 'lmdeploy'", 'numpy_random_seed': 2147483648, 'opencompass': '0.3.7+', 'sys.platform': 'linux', 'transformers': '4.37.2'
from gradio_client import Client, handle_file
CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 python run.py ./configs/eval_llama3_instruct.py --datasets mmlu ifeval --hf-num-gpus 8 --model-kwargs torch_dtype=torch.bfloat16
ImportError: cannot import name 'handle_file' from 'gradio_client'
推理完成之后因为插件版本报错测评全是‘--’,但是所有推理的文件都在,怎么继续评测?
The text was updated successfully, but these errors were encountered:
加一个--reuse latest就可以了
Sorry, something went wrong.
tonysy
No branches or pull requests
Prerequisite
Type
I'm evaluating with the officially supported tasks/models/datasets.
Environment
'Python': '3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0]',
'TorchVision': '0.16.0a0',
'lmdeploy': "not installed:No module named 'lmdeploy'",
'numpy_random_seed': 2147483648,
'opencompass': '0.3.7+',
'sys.platform': 'linux',
'transformers': '4.37.2'
Reproduces the problem - code/configuration sample
from gradio_client import Client, handle_file
Reproduces the problem - command or script
CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 python run.py ./configs/eval_llama3_instruct.py --datasets mmlu ifeval --hf-num-gpus 8 --model-kwargs torch_dtype=torch.bfloat16
Reproduces the problem - error message
ImportError: cannot import name 'handle_file' from 'gradio_client'
Other information
推理完成之后因为插件版本报错测评全是‘--’,但是所有推理的文件都在,怎么继续评测?
The text was updated successfully, but these errors were encountered: