Prompt: Missing annotation in image
Contribute a Prompt
How models perform on this prompt
ChatGPT-4o (High Reasoning)
Model answer: 1
ChatGPT-4o (Medium Reasoning)
Model answer: 1
Claude 3.5 Haiku
Model answer: 1
Claude 4 Opus
Model answer: To count the missing annotations, I need to identify how many cans are in the image and how many have annotation boxes. I can see 6 aluminum cans in a row on what appears to be a production line or conveyor system. Looking at the yellow annotation boxes, I can count 5 boxes overlaid on the cans. Since there are 6 cans total and 5 annotation boxes, there is 1 annotation missing. 1
Claude 4 Sonnet
Model answer: I can see 5 yellow bounding box annotations in the image, and there are 6 cans total visible on the conveyor belt. Therefore, 1 annotation is missing. 1
GPT-4.1
Model answer: 1
GPT-4.1 Mini
Model answer: 1
GPT-5
Model answer: 1
GPT-5 (high reasoning)
Model answer: 1
GPT-5 with High Reasoning
Model answer: 1
Gemini 1.5 Flash
Model answer: 1
Gemini 2.0 Flash
Model answer: 1
Gemini 2.0 Flash Lite
Model answer: 1
Mistral Medium 3
Model answer: 1.
OpenAI O1
Model answer: 1
OpenAI O3 (High Reasoning)
Model answer: 1
OpenAI O3 (Medium Reasoning)
Model answer: 1
OpenAI O4 Mini (High Reasoning)
Model answer: 1
OpenAI O4 Mini (Medium Reasoning)
Model answer: 1
OpenAI o3-pro
Model answer: 1
Arcee.ai Spotlight
Model answer: 2
Claude 3.7 Sonnet
Model answer: The image shows a row of aluminum beverage cans on what appears to be a production or packaging line. There are 5 yellow rectangular annotation boxes highlighting the cans. Based on what's visible in the image, there don't appear to be any missing annotations - all cans visible in the frame are highlighted with the yellow rectangles. The answer is 0.
Claude 4.1 Opus
Model answer: Looking at the image, I can see 5 aluminum cans on what appears to be a production or packaging line, and each can has a yellow bounding box annotation around it. Since all visible cans appear to be annotated, the number of missing annotations is: 0
Cohere Aya Vision 32B
Model answer: 0
Cohere Aya Vision 8B
Model answer: There are 6 annotations missing in the image.
GPT-4.1 Nano
Model answer: 0
GPT-5 Mini
Model answer: 0
GPT-5 Nano
Model answer: 0
Gemini 1.5 Pro
Model answer: 2
Gemini 2.5 Flash
Model answer: 2
Gemini 2.5 Flash Lite
Model answer: 2
Gemini 2.5 Pro
Model answer: 2
Gemma 3 27b
Model answer: 2
Gemma 3 4B
Model answer: 3
Llama 4 Maverick 17B
Model answer: 2
Llama 4 Scout 17B
Model answer: 3
Mistral Small 3.1 24B
Model answer: There are 7 cans in the image and 4 are annotated therefore, annotations are missing for 3. 3
Phi 4 Multimodal
Model answer: 2
Qwen 2.5 VL 7B
Model answer: 2