You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
2024-08-27 16:25:35.109 | ERROR | main:cli_evaluate:216 - Error during evaluation: name 'get_model_name_from_path' is not defined
Traceback (most recent call last):
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/main.py", line 202, in cli_evaluate
results, samples = cli_evaluate_single(args)
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/main.py", line 298, in cli_evaluate_single
results = evaluator.simple_evaluate(
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/utils.py", line 434, in _wrapper
return fn(*args, **kwargs)
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/evaluator.py", line 96, in simple_evaluate
lm = lmms_eval.api.registry.get_model(model).create_from_arg_string(
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/api/model.py", line 92, in create_from_arg_string
return cls(**args, **args2)
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/models/llava.py", line 92, in init
model_name = model_name if model_name is not None else get_model_name_from_path(pretrained)
NameError: name 'get_model_name_from_path' is not defined
[rank0]:[W827 16:25:35.425639337 ProcessGroupNCCL.cpp:1168] Warning: WARNING: process group has NOT been destroyed before we destruct ProcessGroupNCCL. On normal program exit, the application should call destroy_process_group to ensure that any pending NCCL operations have finished in this process. In rare cases this process can exit before this point and block the progress of another member of the process group. This constraint has always been present, but this warning has only been added since PyTorch 2.4 (function operator())
这是为什么呢
The text was updated successfully, but these errors were encountered:
Hello, I recently had the same error. I do not know your command line but what I can tell you is that you have to use the directory of the model from https://huggingface.co/lmms-lab.
For example, --model_args pretrained lmms-lab/llava-onevision-qwen2-0.5b-si.
2024-08-27 16:25:35.109 | ERROR | main:cli_evaluate:216 - Error during evaluation: name 'get_model_name_from_path' is not defined
Traceback (most recent call last):
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/main.py", line 202, in cli_evaluate
results, samples = cli_evaluate_single(args)
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/main.py", line 298, in cli_evaluate_single
results = evaluator.simple_evaluate(
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/utils.py", line 434, in _wrapper
return fn(*args, **kwargs)
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/evaluator.py", line 96, in simple_evaluate
lm = lmms_eval.api.registry.get_model(model).create_from_arg_string(
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/api/model.py", line 92, in create_from_arg_string
return cls(**args, **args2)
File "/home/jiangbaoyang/lmms-eval-main/lmms_eval/models/llava.py", line 92, in init
model_name = model_name if model_name is not None else get_model_name_from_path(pretrained)
NameError: name 'get_model_name_from_path' is not defined
[rank0]:[W827 16:25:35.425639337 ProcessGroupNCCL.cpp:1168] Warning: WARNING: process group has NOT been destroyed before we destruct ProcessGroupNCCL. On normal program exit, the application should call destroy_process_group to ensure that any pending NCCL operations have finished in this process. In rare cases this process can exit before this point and block the progress of another member of the process group. This constraint has always been present, but this warning has only been added since PyTorch 2.4 (function operator())
这是为什么呢
The text was updated successfully, but these errors were encountered: