Prompt: Count bottles
2 out of 19 models answer this prompt correctly.
Contribute a Prompt
Have an idea for a prompt? Open a pull request on the project repository!
How models perform on this prompt
GPT-4.1 Mini
Model answer: 27
GPT-4.1 Nano
Model answer: 27
ChatGPT-4o
Model answer: 28
Claude 3.5 Haiku
Model answer: 25
Claude 3.7 Sonnet
Model answer: Based on what I can see in the image, there appear to be approximately 20-25 bottles of Sprite in the refrigerator or cooler. The green bottles are arranged on the white rack shelving, with some standing upright and others lying on their sides.
Cohere Aya Vision 32B
Model answer: 48
Cohere Aya Vision 8B
Model answer: 21
GPT-4.1
Model answer: 22
Gemini 2.0 Flash
Model answer: 30
Gemini 2.0 Flash Lite
Model answer: 35
Gemini 2.5 Flash Preview
Model answer:
Gemini 2.5 Pro Preview
Model answer: 28
Gemma 3 27b
Model answer: 31
Llama 3 11B Vision
Model answer: 38
Llama 4 Scout 17B
Model answer: 32
Mistral Small 3.1 24b
Model answer: I can't determine the exact number of bottles.
OpenAI O1
Model answer: 17
OpenAI O4 Mini
Model answer: 23
Qwen 2.5 VL 7B
Model answer: 34