adjustable glasses illustration eye chart illustration clipboard illustration lenses illustration

Prompt: Object orientation

36 out of 52 models answer this prompt correctly.
Prompt: Is the item the right side up or upside down? Return only 'right side up' or 'upside down'.
Answer: upside down
Submitted by: Roboflow
Object orientation

Contribute a Prompt

How models perform on this prompt

ChatGPT-4o (Medium Reasoning)

Model answer: {"answer": "upside down"}

View more tests run on this model

Claude 3.5 Haiku

Model answer: Upside down

View more tests run on this model

Claude 3.7 Sonnet

Model answer: Upside down

View more tests run on this model

Claude 4 Opus

Model answer: upside down

View more tests run on this model

Claude 4 Sonnet

Model answer: upside down

View more tests run on this model

Claude 4.1 Opus

Model answer: upside down

View more tests run on this model

Claude 4.6 Opus

Model answer: {"answer": "upside down"}

View more tests run on this model

GLM 4.6v

Model answer: { "answer": "upside down" }

View more tests run on this model

GPT-4.1

Model answer: {"answer": "upside down"}

View more tests run on this model

GPT-4.1 Mini

Model answer: {"answer": "upside down"}

View more tests run on this model

GPT-4.1 Nano

Model answer: {"answer": "upside down"}

View more tests run on this model

GPT-5 Mini

Model answer: {"answer": "upside down"}

View more tests run on this model

GPT-5 Nano

Model answer: {"answer": "upside down"}

View more tests run on this model

GPT-5.4

Model answer: {"answer":"upside down"}

View more tests run on this model

Gemini 2.5 Flash Lite

Model answer: {"answer": "upside down"}

View more tests run on this model

Gemini 2.5 Pro

Model answer: {"answer": "upside down"}

View more tests run on this model

Gemini 3 Flash

Model answer: {"answer": "upside down"}

View more tests run on this model

Gemini 3 Flash (Tools)

Model answer: {"answer": "upside down"}

View more tests run on this model

Gemini 3.1 Pro

Model answer: {"answer": "upside down"}

View more tests run on this model

Gemini 3.1 Pro (Tools)

Model answer: {"answer": "upside down"}

View more tests run on this model

Gemma 3 27b

Model answer: upside down

View more tests run on this model

Grok 4

Model answer: {"answer": "upside down"}

View more tests run on this model

Grok 4.1 Fast

Model answer: {"answer": "upside down"}

View more tests run on this model

Kimi k2.5

Model answer: {"answer": "upside down"}

View more tests run on this model

Llama 4 Scout 17B

Model answer: upside down

View more tests run on this model

Mistral Medium 3

Model answer: upside down

View more tests run on this model

Mistral Small 3.1 24B

Model answer: upside down

View more tests run on this model

Molmo2 8B

Model answer: {"answer": "upside down"}

View more tests run on this model

OpenAI O1

Model answer: {"answer": "upside down"}

View more tests run on this model

OpenAI O4 Mini (Medium Reasoning)

Model answer: {"answer": "upside down"}

View more tests run on this model

Qwen 3.5 122B (A10B)

Model answer: {"answer": "upside down"}

View more tests run on this model

Qwen 3.5 27B

Model answer: {"answer": "upside down"}

View more tests run on this model

Qwen 3.5 4B

Model answer: { "answer": "upside down" }

View more tests run on this model

Qwen 3.5 9B

Model answer: { "answer": "upside down" }

View more tests run on this model

Qwen 3.5 Plus

Model answer: {"answer": "upside down"}

View more tests run on this model

Reka Edge

Model answer: { "answer": "upside down" }

View more tests run on this model

Arcee.ai Spotlight

Model answer: right side up

View more tests run on this model

Cohere Aya Vision 32B

Model answer: right side up

View more tests run on this model

Cohere Aya Vision 8B

Model answer: right side up

View more tests run on this model

Cosmos Reason2 2B

Model answer: {"answer": "right side up"}

View more tests run on this model

Cosmos Reason2 8B

Model answer: {"answer": "right side up"}

View more tests run on this model

Gemini 2.0 Flash

Model answer: {"answer": "right side up"}

View more tests run on this model

Gemini 2.0 Flash Lite

Model answer: { "answer": "right side up" }

View more tests run on this model

Gemini 2.5 Flash

Model answer: {"answer": "right side up"}

View more tests run on this model

Gemma 3 4B

Model answer: right side up

View more tests run on this model

Llama 4 Maverick 17B

Model answer: right side up

View more tests run on this model

Phi 4 Multimodal

Model answer: right side up

View more tests run on this model

Qwen 2.5 VL 7B

Model answer: right side up

View more tests run on this model

Qwen 3.5 0.8B

Model answer: The item in question is a bottle of sunscreen labeled "SPXF 2", placed on the right side of a conveyor belt. The bottle appears upright and correctly oriented — not rotated or inverted. Therefore, it is not upside down. {"answer": "right side up"}

View more tests run on this model

Qwen 3.5 2B

Model answer: {"answer": "right side up"}

View more tests run on this model

Qwen 3.5 35B (A3B)

Model answer: {"answer": "right side up"}

View more tests run on this model

SmolVLM2 2.2B

Model answer: right side up

View more tests run on this model