Skip to content

Issues: AILab-CVC/SEED-Bench

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

20 Open 9 Closed
20 Open 9 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

huggingface Leaderboard not working
#31 opened Nov 4, 2024 by LindiaC
Data source for "Transit Maps" model: not listed in this repository? also not listed on Huggingface?
#29 opened Jun 27, 2024 by miku2000
1
Wrong Question Types in SEED-Bench1
#28 opened May 17, 2024 by littlepenguin89106
3
Question about evaluation input format
#27 opened May 11, 2024 by yellow-binary-tree
1
any plan to release the original images for SEED-Bench-2-Plus?
#25 opened May 3, 2024 by hjeun
1
Question on multi-image input
#24 opened Mar 18, 2024 by auhowielau
2
[bugs] LLaVA-Evaluation : RuntimeError: Expected all tensors to be on the same device
#21 opened Jan 31, 2024 by JJJYmmm
1
Muti-GPUs Evaluation
#20 opened Jan 31, 2024 by JJJYmmm
Question on how task27 generates images
#19 opened Jan 16, 2024 by JunZhan2000
2
a lot of data with more questions than pictures in SEED-Bench-2 level L2, is this reasonable?
#15 opened Dec 12, 2023 by nemonameless
5
In-Context Example Selection Process
#14 opened Dec 2, 2023 by mustafaadogan
1
VLMs vs LLMs evaluation
#12 opened Oct 22, 2023 by idan-tankel
1
Easy way to probe result examples?
#11 opened Sep 22, 2023 by chancharikmitra
1
Request for the interface of minigpt4 and llava
#10 opened Sep 22, 2023 by Richar-Du
2
Reproduce the Qwen-VL SOTAs results
#9 opened Sep 4, 2023 by jinze1994
2
Support for evaluation of other VLM models like MiniGPT-4, mPLUG-Owl, Llava, and VPGTrans
#8 opened Aug 30, 2023 by WesleyHsieh0806
2
This benchmark could lead to wrong conclusion.
#7 opened Aug 23, 2023 by dannyhung1128
3
Add InstructBlip Flan-T5-xl and InstructBlip Flan-T5-xxl
#5 opened Aug 7, 2023 by brianjking
1
Update for mPLUG-Owl
#3 opened Aug 2, 2023 by MAGAer13
1
Update for Otter-Image-MPT7B and Otter-Video
#1 opened Aug 1, 2023 by Luodian
1
ProTip! Add no:assignee to see everything that’s not assigned.