Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AQW量化模型失败 #1274

Closed
tt1121 opened this issue Jul 3, 2024 · 3 comments
Closed

AQW量化模型失败 #1274

tt1121 opened this issue Jul 3, 2024 · 3 comments

Comments

@tt1121
Copy link

tt1121 commented Jul 3, 2024

Describe the bug
AQW量化模型,最后一步报错,也没有提示错误在哪里。
怎么确认问题在哪里?

Your hardware and system info
cuda 12.2
unbuntu 24.0.3
GPU A6000
torch 2.3.0

Additional context
Add any other context about the problem here(在这里补充其他信息)

image

@tastelikefeet
Copy link
Collaborator

是不是千问2-7b-instruct啊,这模型量化是会遇到问题的

@i-yoyocat
Copy link

是不是千问2-7b-instruct啊,这模型量化是会遇到问题的

Yes,我量化这个版本跟楼上一样。我再试试Qwen1.5-7B-Chat去

@i-yoyocat
Copy link

是不是千问2-7b-instruct啊,这模型量化是会遇到问题的

Yes,我量化这个版本跟楼上一样。我再试试Qwen1.5-7B-Chat去

新的swift好了,Qwen2-7b-instruct也可以了

@tt1121 tt1121 closed this as completed Jul 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants