VisIT-Bench-Leaderboard / visitbench_leaderboard_Single~Image_Sep132023.tsv
yonatanbitton's picture
Upload visitbench_leaderboard_Single~Image_Sep132023.tsv
9032812
raw
history blame contribute delete
785 Bytes
Category Model Elo # Matches Win vs. Reference (w/ # ratings)
Single Image human_verified_reference 1402 5597 ---
Single Image llava13b_output 1128 5399 18.35% (n=474)
Single Image mPLUG-Owl prediction 1117 5390 15.87% (n=479)
Single Image LlamaAdapter-v2 prediction 1084 5416 14.17% (n=487)
Single Image Lynx(8B) predictions 1046 758 11.76% (n=136)
Single Image instruct_blip_output 1021 5396 14.14% (n=502)
Single Image otter 962 5397 7.03% (n=498)
Single Image visual_gpt_davinci003_output 953 5414 1.57% (n=509)
Single Image Octopus V2 prediction 952 994 5.29% (n=170)
Single Image MiniGPT-4 prediction 938 5393 3.37% (n=505)
Single Image openflamingo 851 5397 2.95% (n=508)
Single Image panda_gpt_13b_output 801 5397 2.70% (n=518)
Single Image mmgpt_output 747 5402 0.19% (n=526)