How models perform on this prompt
Arcee.ai Spotlight
Model answer: No.
ChatGPT-4o
Model answer: No
Claude 3.5 Haiku
Model answer: No. The majority of the coffee berries in this image are still green, which indicates they are unripe. Only a few berries are starting to turn red, signaling that the coffee plant is not yet ready for harvesting.
Claude 3.7 Sonnet
Model answer: No. The image shows coffee cherries that are predominantly green, with only a few scattered red berries visible. Coffee cherries are ready to harvest when they turn a bright red color, indicating ripeness. Since the vast majority of the cherries in this image are still green, the coffee plant is not yet ready to harvest.
Claude 4 Opus
Model answer: No.
Claude 4 Sonnet
Model answer: No
Cohere Aya Vision 32B
Model answer: No
Cohere Aya Vision 8B
Model answer: No.
GPT-4.1
Model answer: No.
GPT-4.1 Mini
Model answer: No
GPT-4.1 Nano
Model answer: No
Gemini 1.5 Flash
Model answer: no
Gemini 1.5 Pro
Model answer: No.
Gemini 2.0 Flash
Model answer: no
Gemini 2.0 Flash Lite
Model answer: no
Gemini 2.5 Flash Preview
Model answer: no
Gemini 2.5 Pro Preview
Model answer: no
Gemma 3 27b
Model answer: no
Gemma 3 4B
Model answer: no
Llama 3 11B Vision
Model answer: No.
Llama 4 Maverick 17B
Model answer: No.
Llama 4 Scout 17B
Model answer: no
Mistral Medium 3
Model answer: No
Mistral Small 3.1 24B
Model answer: No
Mistral Small 3.1 24b
Model answer: No.
OpenAI O1
Model answer: no
OpenAI O3
Model answer: no
OpenAI O4 Mini
Model answer: No
OpenAI o3-pro
Model answer: no
Phi 4 Multimodal
Model answer: No yes after now aggregate not now to only, but after - otherwise, in in yes to on in only not in on married though stretch not with so as on in partition in combined in ready to in in additional in farm in operating indirectly in
Qwen 2.5 VL 7B
Model answer: No.