Support evaluation of HumanEval dataset when k > 1 in pass@k 支持HumanEval k > 1 in pass@k的情况 #326
vansin
started this conversation in
Community Task
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Support evaluation of HumanEval dataset when k > 1 in pass@k
支持HumanEval k > 1 in pass@k的情况
Please read #248
请认真阅读 #248
Task Information
Repository:OpenCompass
Difficulty:Hard
Points:50
Estimated Time Consumption:3 days
Task Status
Claimant's Github ID:None
Claim Time:None
PR Link:None
Points to Note
在评论区回复
Claim the mission
并填写问卷领取任务,填写问卷后请及时添加 OpenCompass 小助手微信(微信ID:van-sin
)获取报名结果~完成任务后提交 PR 标题请以 [SIG] 开头,提交后将 PR 链接回复到本 Disucssion 评论区,我们会第一时间审核您的贡献。
Beta Was this translation helpful? Give feedback.
All reactions