a_okvqa
|
A-OKVQA |
Knowledge, MCQ, MultiModal
|
ai2d
|
AI2D |
Knowledge, MultiModal, QA
|
air_bench_chat
|
AIR-Bench-Chat |
Audio, InstructionFollowing, QA
|
air_bench_foundation
|
AIR-Bench-Foundation |
Audio, Knowledge, MCQ
|
baby_vision
|
BabyVision |
MultiModal, QA, Reasoning
|
blink
|
BLINK |
Knowledge, MCQ, MultiModal
|
cc_bench
|
CCBench |
Knowledge, MCQ, MultiModal
|
cc_ocr_v2
|
CC-OCR-V2 |
Grounding, MultiLingual, MultiModal, QA
|
chartqa
|
ChartQA |
Knowledge, MultiModal, QA
|
charxiv
|
CharXiv |
MultiModal, QA, Reasoning
|
cmmmu
|
CMMMU |
Chinese, Knowledge, MultiModal, QA
|
cmmu
|
CMMU |
Knowledge, MCQ, MultiModal, QA
|
common_voice_15
|
CommonVoice15 |
Audio, MultiLingual, SpeechRecognition
|
count_qa
|
CountQA |
MultiModal, QA, Reasoning
|
docvqa
|
DocVQA |
Knowledge, MultiModal, QA
|
emb_spatial_bench
|
EmbSpatial-Bench |
MCQ, MultiModal, Reasoning
|
erqa
|
ERQA |
MCQ, MultiModal, Reasoning
|
fleurs
|
FLEURS |
Audio, MultiLingual, SpeechRecognition
|
general_vmcq
|
General-VMCQ |
Custom, MCQ, MultiModal
|
general_vqa
|
General-VQA |
Custom, MultiModal, QA
|
gsm8k_v
|
GSM8K-V |
Math, MultiModal, Reasoning
|
hallusion_bench
|
HallusionBench |
Hallucination, MultiModal, Yes/No
|
hipho
|
HiPhO |
Math, MultiModal, QA, Reasoning
|
infovqa
|
InfoVQA |
Knowledge, MultiModal, QA
|
librispeech
|
LibriSpeech |
Audio, SpeechRecognition
|
logic_vista
|
LogicVista |
MCQ, MultiModal, Reasoning
|
maritime_ocr_bench
|
Maritime-OCR-Bench |
MultiModal, QA
|
math_verse
|
MathVerse |
MCQ, Math, MultiModal, Reasoning
|
math_vision
|
MathVision |
MCQ, Math, MultiModal, Reasoning
|
math_vista
|
MathVista |
MCQ, Math, MultiModal, Reasoning
|
measure_bench
|
MeasureBench |
MultiModal, QA, Reasoning
|
medxpertqa
|
MedXpertQA |
MCQ, Medical, MultiModal, Reasoning
|
mia_bench
|
MIA-Bench |
InstructionFollowing, MultiModal, QA
|
micro_vqa
|
MicroVQA |
Knowledge, MCQ, Medical, MultiModal
|
mm_bench
|
MMBench |
Knowledge, MultiModal, QA
|
mm_star
|
MMStar |
Knowledge, MCQ, MultiModal
|
mmau
|
MMAU |
Audio, MCQ
|
mmmu
|
MMMU |
Knowledge, MultiModal, QA
|
mmmu_pro
|
MMMU-PRO |
Knowledge, MCQ, MultiModal
|
msr_vtt
|
MSR-VTT |
ImageCaptioning, MultiModal, Video
|
msvd
|
MSVD |
ImageCaptioning, MultiModal, Video
|
mvbench
|
MVBench |
MCQ, MultiModal, Video
|
ocr_bench
|
OCRBench |
Knowledge, MultiModal, QA
|
ocr_bench_v2
|
OCRBench-v2 |
Knowledge, MultiModal, QA
|
olmocr_bench
|
olmOCR-Bench |
MultiModal, QA
|
olympiad_bench
|
OlympiadBench |
Math, Reasoning
|
omni_bench
|
OmniBench |
Knowledge, MCQ, MultiModal
|
omni_doc_bench
|
OmniDocBench |
Knowledge, MultiModal, QA
|
omni_doc_bench_v1_6
|
OmniDocBench-v1.6 |
Knowledge, MultiModal, QA
|
perception_bench
|
PerceptionBench |
MultiModal, QA
|
phyx_mc
|
PhyX-MC |
MCQ, MultiModal, Reasoning
|
phyx_oe
|
PhyX-OE |
MultiModal, QA, Reasoning
|
pmc_vqa
|
PMC-VQA |
MCQ, Medical, MultiModal
|
pope
|
POPE |
Hallucination, MultiModal, Yes/No
|
real_world_qa
|
RealWorldQA |
Knowledge, MultiModal, QA
|
ref_adv_s
|
Ref-Adv-s |
Grounding, MultiModal, Reasoning
|
science_qa
|
ScienceQA |
Knowledge, MCQ, MultiModal
|
screenspot_pro
|
ScreenSpot-Pro |
Agent, Grounding, MultiModal
|
seed_bench_2_plus
|
SEED-Bench-2-Plus |
Knowledge, MCQ, MultiModal, Reasoning
|
simple_vqa
|
SimpleVQA |
MultiModal, QA, Reasoning
|
slake
|
SLAKE |
Medical, MultiModal, QA
|
surds
|
SURDS |
Grounding, MultiModal, QA, Reasoning
|
tir_bench
|
TIR-Bench |
MultiModal, QA, Reasoning
|
torgo
|
TORGO |
Audio, SpeechRecognition
|
tvbench
|
TVBench |
MCQ, MultiModal, Video
|
videomme_v2
|
Video-MME-v2 |
MCQ, MultiModal, Video
|
visfactor
|
VisFactor |
MultiModal, QA, Reasoning
|
visulogic
|
VisuLogic |
MCQ, Math, MultiModal, Reasoning
|
vlms_are_biased
|
VLMs Are Biased |
MultiModal, QA, Reasoning
|
vqav2
|
VQAv2 |
MultiModal, QA
|
vstar_bench
|
V*Bench |
Grounding, MCQ, MultiModal
|
vtcbench
|
VTCBench |
LongContext, MultiModal, QA, Reasoning, Retrieval
|
wenet_speech
|
WenetSpeech |
Audio, SpeechRecognition
|
world_vqa
|
WorldVQA |
Knowledge, MultiModal, QA
|
zerobench
|
ZeroBench |
Knowledge, MultiModal, QA
|
