How models perform on this prompt
GPT-4.1 Mini
Model answer: 27
GPT-4.1 Nano
Model answer: 27
Arcee.ai Spotlight
Model answer: 36
ChatGPT-4o
Model answer: 26
Claude 3.5 Haiku
Model answer: 25
Claude 3.7 Sonnet
Model answer: Based on what I can see in the image, there appear to be approximately 20-25 bottles of Sprite in the refrigerator or cooler. The green bottles are arranged on the white rack shelves, with some standing upright and others lying on their sides. It's difficult to give an exact count because some bottles may be partially obscured by others.
Claude 4 Opus
Model answer: I can see multiple green Sprite bottles in this refrigerator image. Let me count them carefully... I count approximately 24 bottles visible in the image.
Claude 4 Sonnet
Model answer: 24
Cohere Aya Vision 32B
Model answer: 48
Cohere Aya Vision 8B
Model answer: 21
GPT-4.1
Model answer: 22
Gemini 1.5 Flash
Model answer: 20
Gemini 1.5 Pro
Model answer: 22
Gemini 2.0 Flash
Model answer: 30
Gemini 2.0 Flash Lite
Model answer: 36
Gemini 2.5 Flash Preview
Model answer: 33
Gemini 2.5 Flash-Lite Preview
Model answer: 36
Gemini 2.5 Pro Preview
Model answer: 28
Gemma 3 27b
Model answer: 28
Gemma 3 4B
Model answer: 33
Llama 3 11B Vision
Model answer: 36
Llama 4 Maverick 17B
Model answer: 47
Llama 4 Scout 17B
Model answer: 32
Mistral Medium 3
Model answer: 29.
Mistral Small 3.1 24B
Model answer: 48
Mistral Small 3.1 24b
Model answer: 44
OpenAI O1
Model answer: 24
OpenAI O3
Model answer: 22
OpenAI O4 Mini
Model answer: 17
OpenAI o3-pro
Model answer: 26
Phi 4 Multimodal
Model answer: 50
Qwen 2.5 VL 7B
Model answer: 36