Cohere Aya Vision 32B

56.63% (47/83)

Passed

18.49s

Average Request Time

Summary

Ranked #1 on leaderboard for Web Action Understanding, Object Detection, Localization, Sign Understanding.

Contribute a Prompt

Have an idea for a prompt? Open a pull request on the project repository!

Compare with another model

All Prompts

(WIP) Table understanding from a web catalog

Submitted by: Roboflow

Category: Document Understanding

Time taken: 3.75s

Model answer correct?: Yes

Prompt: What is the package quantity of 90183A308? Return only a number. If SKU does not exist, return NULL.

Ground Truth: 50

Model Output: 50

Background object identification

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 19.25s

Model answer correct?: Yes

Prompt: Is there a box in the background? Yes or no?

Ground Truth: Yes

Model Output: Yes.

Bolts screwed in

Submitted by: Roboflow

Category: Defect Detection

Time taken: 13.81s

Model answer correct?: Yes

Prompt: Are all six bolts screwed in? Return only yes or no.

Ground Truth: Yes

Model Output: Yes.

Bottle on wrong shelf

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 7.87s

Model answer correct?: Yes

Prompt: Are any bottles on the wrong shelf? If yes, say the name of the brand of the bottle on the wrong shelf like Coca-Cola.

Ground Truth: Fiji

Model Output: Yes, there are bottles on the wrong shelf. The brand of the bottle on the wrong shelf is Fiji.

Coffee plants ready to farm

Submitted by: Roboflow

Category: Object Understanding

Time taken: 17.74s

Model answer correct?: Yes

Prompt: Is the coffee plant ready to farm? It is only ready to farm if the majority of berries are red. Return only yes or no.

Ground Truth: No

Model Output: No

Conveyor belt empty

Submitted by: Roboflow

Category: Object Understanding

Time taken: 8.30s

Model answer correct?: Yes

Prompt: Is the conveyor belt empty? Return either yes or no.

Ground Truth: Yes

Model Output: Yes.

Date picker

Submitted by: Roboflow

Category: Web Action Understanding

Time taken: 3.83s

Model answer correct?: Yes

Prompt: What date is picked on the calendar? Answer like January 1 2020

Ground Truth: November 21 2017

Model Output: November 21 2017

Defect detection (no defect present)

Submitted by: Roboflow

Category: Defect Detection

Time taken: 16.28s

Model answer correct?: Yes

Prompt: Does the juice box have a defect? Yes or no.

Ground Truth: No

Model Output: Yes. The juice box appears to have a manufacturing defect. The straw is not properly inserted into the juice box. Instead of being fully inserted through the hole in the top of the box, the straw is only partially inserted and is bent at a 90-degree angle. This means the straw is not in the correct position for drinking the juice. This is likely due to a malfunction during the packaging process, where the straw was not properly aligned or pushed far enough into the juice box.

Defect localization

Submitted by: Roboflow

Category: Localization

Time taken: 9.63s

Model answer correct?: Yes

Prompt: Where is the defect in the product: top, left, bottom, right, or center? Return only the location, like left center.

Ground Truth: top center

Model Output: top center

Dent detection

Submitted by: Roboflow

Category: Defect Detection

Time taken: 8.04s

Model answer correct?: Yes

Prompt: How many dents are in the image? Return only the number.

Ground Truth: 1

Model Output: 1

Digital workflow and process understanding

Submitted by: Roboflow

Category: Object Understanding

Time taken: 8.31s

Model answer correct?: Yes

Prompt: List the steps in the workflow as a comma-separated list.

Ground Truth: Inputs, Llama 3.2 Vision, Outputs

Model Output: Inputs,Llama 3.2 Vision,Outputs

Find an author

Submitted by: User

Category: Document Understanding

Time taken: 2.72s

Model answer correct?: Yes

Prompt: Who transcribed this sheet music, according to the document? Answer as only the name is presented on the document.

Ground Truth: Otto Singer II

Model Output: Otto Singer II

Item hanging off assembly line

Submitted by: Roboflow

Category: Object Detection

Time taken: 23.65s

Model answer correct?: Yes

Prompt: Is the candy bar hanging off the assembly line? Return only yes or no.

Ground Truth: Yes

Model Output: Yes.

Label verification

Submitted by: Roboflow

Category: Defect Detection

Time taken: 12.39s

Model answer correct?: Yes

Prompt: Does the juice box package show an orange eat well label? Return only yes or no.

Ground Truth: Yes

Model Output: Yes.

Leaf rust

Submitted by: Roboflow

Category: Defect Detection

Time taken: 16.19s

Model answer correct?: Yes

Prompt: Does the leaf show signs of leaf rust? Return only yes or no.

Ground Truth: Yes

Model Output: Yes.

Log on train track

Submitted by: Roboflow

Category: Object Understanding

Time taken: 21.71s

Model answer correct?: Yes

Prompt: Is there a log on the track? Return only yes or no.

Ground Truth: Yes

Model Output: Yes.

Missing boxes on pallet

Submitted by: Roboflow

Category: Object Understanding

Time taken: 4.42s

Model answer correct?: Yes

Prompt: How many boxes are missing? Return only a number.

Ground Truth: 1

Model Output: 1

Missing object on assembly line tray

Submitted by: Roboflow

Category: Object Understanding

Time taken: 27.62s

Model answer correct?: Yes

Prompt: Do any metal plates have no blue parts on top? If so, return the tray position. The position must be either 1, 2, 3, or 4. 1 is the leftmost tray. 4 is the rightmost tray. Otherwise, return NULL.

Ground Truth: 4

Model Output: To determine if any metal plates have no blue parts on top and return the tray position, we need to analyze the image carefully. Here are the steps to follow: 1. **Identify the Metal Plates**: In the image, there are several metal plates arranged in a row. Each plate has a series of holes or cavities where blue parts are placed. 2. **Examine Each Plate**: Starting from the leftmost plate (tray 1) and moving to the rightmost plate (tray 4), inspect each plate to see if it has any blue parts in its cavities. 3. **Check for Empty Cavities**: If a plate has any cavities that do not contain blue parts, it meets the criteria. Note the position of this plate. 4. **Return the Position**: If a plate with empty cavities is found, return its position (1, 2, 3, or 4). If no such plate is found, return NULL. After carefully examining the image: - Tray 1: All cavities contain blue parts. - Tray 2: All cavities contain blue parts. - Tray 3: All cavities contain blue parts. - Tray 4: Some cavities do not contain blue parts. Therefore, the tray position that has no blue parts on top is **4**.

Missing pill in pack classification

Submitted by: Roboflow

Category: Defect Detection

Time taken: 11.22s

Model answer correct?: Yes

Prompt: Are there any missing pills? Return only yes or no.

Ground Truth: Yes

Model Output: Yes.

Moisture on cans

Submitted by: Roboflow

Category: Defect Detection

Time taken: 21.11s

Model answer correct?: Yes

Prompt: Is there moisture on the cans? Return only yes or no.

Ground Truth: Yes

Model Output: Yes.

Name of item at a specified position in a list

Submitted by: Roboflow

Category: Web Action Understanding

Time taken: 1.13s

Model answer correct?: Yes

Prompt: What is the third item in the list? Return only the name of the item.

Ground Truth: null

Model Output: null

Number of bread buns on their sides

Submitted by: Roboflow

Category: Object Counting

Time taken: 16.38s

Model answer correct?: Yes

Prompt: How many buns are on their side? Return only a number.

Ground Truth: 1

Model Output: 1

Object counting with a blurry image

Submitted by: Roboflow

Category: Object Counting

Time taken: 23.06s

Model answer correct?: Yes

Prompt: How many load carriers are in the image? Return only a number.

Ground Truth: 3

Model Output: 3

Object differentiation

Submitted by: Roboflow

Category: Object Detection

Time taken: 22.97s

Model answer correct?: Yes

Prompt: Does the container contain screws or bolts or nuts?

Ground Truth: bolts

Model Output: The container in the image contains screws. Specifically, there are two screws visible inside the black box on the green conveyor belt. These screws are metallic and have a hexagonal head, which is characteristic of screws rather than bolts or nuts. Bolts typically have a larger, more robust head and may require a wrench for tightening, while nuts are usually smaller and have a threaded hole through the center. The screws in the image are more consistent with the typical appearance and function of screws used in various mechanical and construction applications.

Object fallen off assembly line

Submitted by: Roboflow

Category: Object Understanding

Time taken: 23.66s

Model answer correct?: Yes

Prompt: Has a piece of crockery fallen off the assembly line? Yes or no.

Ground Truth: Yes

Model Output: Yes.

Object on top of another object

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 11.23s

Model answer correct?: Yes

Prompt: Is the shipping container on a truck? Return only yes or no.

Ground Truth: Yes

Model Output: Yes.

Part number reading

Submitted by: Roboflow

Category: OCR

Time taken: 1.28s

Model answer correct?: Yes

Prompt: Return the part number.

Ground Truth: 10629101

Model Output: The part number is 10629101.

Proximity to a forklift

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 17.91s

Model answer correct?: Yes

Prompt: Is there a person next to the forklift? Yes or no.

Ground Truth: Yes

Model Output: Yes.

Read a serial number

Submitted by: Roboflow

Category: OCR

Time taken: 2.01s

Model answer correct?: Yes

Prompt: What is the serial number on the tire? Answer only the serial number.

Ground Truth: 3702692432

Model Output: 3702692432

Read dimensions on a floor plan

Submitted by: Roboflow

Category: Document Understanding

Time taken: 4.62s

Model answer correct?: Yes

Prompt: What are the dimensions of the living area? Return in format 11'1 X 11'1.

Ground Truth: 10'2" X 16'

Model Output: The dimensions of the living area are 10'2" X 16'.

Recycling sign understanding

Submitted by: Roboflow

Category: Sign Understanding

Time taken: 9.48s

Model answer correct?: Yes

Prompt: What plastic number is in the image? Return only the number with no leading 0s.

Ground Truth: 2

Model Output: 2

Relation identification: left or right

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 24.83s

Model answer correct?: Yes

Prompt: Is the dump truck to the left or right of the wheel loader? Answer only left or right.

Ground Truth: left

Model Output: Left

Relation identification: top or bottom

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 13.89s

Model answer correct?: Yes

Prompt: Is the white box on top of or below the other box? Answer with either above or below.

Ground Truth: above

Model Output: Above

Retrieve article tags in order

Submitted by: Roboflow

Category: Web Action Understanding

Time taken: 2.49s

Model answer correct?: Yes

Prompt: Return the article tags in order from left to right as a comma separated list, like: tag a, tag b, tag c.

Ground Truth: Coffee, Food, Health & wellbeing, Health, Fitness, features

Model Output: Coffee, Food, Health & wellbeing, Health, Fitness, Features

Roast date on a label

Submitted by: Roboflow

Category: Document Understanding

Time taken: 3.67s

Model answer correct?: Yes

Prompt: When was the coffee roasted? Return only the roast date in DD/MM/YYYY, like 01/12/2019.

Ground Truth: 08/09/2020

Model Output: 08/09/2020

Robotic arm grip orientation

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 14.98s

Model answer correct?: Yes

Prompt: Is the robotic arm grip pointing down, at a left angle, or at a right angle? Return down right or left.

Ground Truth: down

Model Output: The robotic arm grip is pointing down right.

Scratch on metal

Submitted by: Roboflow

Category: Defect Detection

Time taken: 13.90s

Model answer correct?: Yes

Prompt: Is there a scratch on the metal? Return only yes or no.

Ground Truth: Yes

Model Output: Yes.

Shipping container OCR

Submitted by: Roboflow

Category: OCR

Time taken: 7.92s

Model answer correct?: Yes

Prompt: What is the horizontal ID on the container? Return only the ID.

Ground Truth: JBHU282862

Model Output: JBHU 282862

Shipping manifest reading

Submitted by: Roboflow

Category: OCR

Time taken: 10.86s

Model answer correct?: Yes

Prompt: What is the dock number? Return like AAA12.

Ground Truth: D33

Model Output: D33

Solar panel detection and colour understanding

Submitted by: Roboflow

Category: Object Understanding

Time taken: 23.73s

Model answer correct?: Yes

Prompt: Does the house with the terracotta roof have a solar panel? Yes or no.

Ground Truth: Yes

Model Output: Yes.

Spatial relations

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 9.19s

Model answer correct?: Yes

Prompt: What colour are the bottles in the middle? Return only the colour name.

Ground Truth: Red

Model Output: Red

Supermarket shelf label reading with one item in focus

Submitted by: Roboflow

Category: OCR

Time taken: 7.53s

Model answer correct?: Yes

Prompt: How much are the wipes? Currency is GBP. Return in form 1.00, or 0.00.

Ground Truth: 0.58

Model Output: The wipes are priced at £0.58 per pack.

Torn receipt reading

Submitted by: Roboflow

Category: Document Understanding

Time taken: 12.28s

Model answer correct?: Yes

Prompt: What is the subtotal of the receipt? Return only the amount like $1.00 and no other text.

Ground Truth: $11.69

Model Output: $11.69

Tray in bag on assembly line

Submitted by: Roboflow

Category: Defect Detection

Time taken: 31.07s

Model answer correct?: Yes

Prompt: Is the tray in a blue bag? Return only yes or no.

Ground Truth: Yes

Model Output: Yes.

Unsealed box

Submitted by: Roboflow

Category: Defect Detection

Time taken: 482.29s

Model answer correct?: Yes

Prompt: Is the outer box sealed? Return yes or no.

Ground Truth: No

Model Output: No.

Web form understanding: autosuggestion

Submitted by: Roboflow

Category: Web Action Understanding

Time taken: 1.78s

Model answer correct?: Yes

Prompt: What is the autosuggested word in the form?

Ground Truth: forklift

Model Output: The autosuggested word in the form is "forklift". This is indicated by the text appearing below the search bar after the user types "class:fork". The autosuggestion is likely based on common search terms or previously searched items.

Worker in zone

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 23.19s

Model answer correct?: Yes

Prompt: Is the worker in the safe zone (marked in yellow)? Return only yes or no.

Ground Truth: Yes

Model Output: Yes.

127

Submitted by: Object Counting

Category: Counting nodes

Time taken: 29.40s

Model answer correct?: No

Prompt: How many vertices (marked as red or orange dots) are visible in this diagram? Present your answer as an integer

Ground Truth: like 1.

Model Output: To determine the number of vertices in this diagram, we can count the red and orange dots. Starting from the center and moving outward, we can see that there is a central orange dot, surrounded by a ring of red dots, then another ring of orange dots, and so on. Counting the dots in each ring, we find: - 1 central orange dot - 12 red dots in the first ring - 24 orange dots in the second ring - 36 red dots in the third ring - 48 orange dots in the fourth ring - 60 red dots in the fifth ring - 72 orange dots in the sixth ring - 84 red dots in the seventh ring - 96 orange dots in the eighth ring - 108 red dots in the ninth ring - 120 orange dots in the tenth ring Adding up all these dots, we get a total of 756 vertices (1 + 12 + 24 + 36 + 48 + 60 + 72 + 84 + 96 + 108 + 120 = 756). Therefore, the answer is 756.

Annotations that do not fully enclose an object

Submitted by: Roboflow

Category: Annotation Understanding

Time taken: 15.13s

Model answer correct?: No

Prompt: How many annotations do not fully surround an object? Return only a number.

Ground Truth: 1

Model Output: 0

Chassis hole counting

Submitted by: Roboflow

Category: Object Understanding

Time taken: 17.36s

Model answer correct?: No

Prompt: How many holes are in the chassis? Return only a number.

Ground Truth: 4

Model Output: 12

Chessboard Analysis 1

Submitted by: Joshua

Category: Object Understanding

Time taken: 5.86s

Model answer correct?: No

Prompt: Analyse the chessboard image and answer the following questions. 1. How many pieces are on the board? Provide only the number. Then, list the count of each piece type on the board by colour (W for White, B for Black) and importance (points worth: K for King, Q for Queen, R for Rook, B for Bishop, N for Knight, P for Pawn). Use the format WQ: 0 (meaning no White Queen), with one piece type per line. Separate the number of pieces and the piece list with a blank line. 2. Are any pieces in positions that violate standard chess rules? If so, list ONLY their positions in the format where column 'a' is the leftmost, 'h' is the rightmost, row 1 is the bottom row, and row 8 is the top row (e.g., b7,h1,h2, with multiple positions separated by a comma without spaces). If no pieces are in illegal positions, write “None.” Please write the question number before giving an answer for each of the questions.

Ground Truth: 12 WK: 1 WQ: 1 WR: 1 WB: 1 WN: 1 WP: 1 BK: 1 BQ: 1 BR: 1 BB: 1 BN: 1 BP: 1 2. e3,e4

Model Output: 1. 32 W: K: 1 Q: 1 R: 2 B: 2 N: 2 P: 8 B: K: 1 Q: 1 R: 2 B: 2 N: 2 P: 8 2. None

Circuit board understanding

Submitted by: Roboflow

Category: Object Understanding

Time taken: 17.27s

Model answer correct?: No

Prompt: Read the number above the left transistor. Return only the number.

Ground Truth: 101

Model Output: 35V/390uF

Colour of object closest to robotic arm grip

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 14.11s

Model answer correct?: No

Prompt: What is the colour of the object that, the robotic arm closest to picking up? Only return the colour.

Ground Truth: Black

Model Output: Red

Count bottles

Submitted by: Roboflow

Category: Object Counting

Time taken: 29.71s

Model answer correct?: No

Prompt: How many bottles are in the image? Answer only a number

Ground Truth: 27

Model Output: 48

Count number of biscuts

Submitted by: SnehitVaddi

Category: Object Counting

Time taken: 6.25s

Model answer correct?: No

Prompt: How many biscuts or cookies are there?

Ground Truth: 3

Model Output: There are three biscuits or cookies visible in the crumpled foil. They are square-shaped with a dark brown color and have a distinctive grilled or toasted appearance with grill marks on their surface.

Count solar panels

Submitted by: Roboflow

Category: Object Counting

Time taken: 15.46s

Model answer correct?: No

Prompt: How many rows of solar panels are in the image? Return only a number.

Ground Truth: 4

Model Output: 10

Count the shipping containers

Submitted by: Roboflow

Category: Object Counting

Time taken: 25.86s

Model answer correct?: No

Prompt: How many shipping containers are in the image?

Ground Truth: 62

Model Output: There are 128 shipping containers in the image. The containers are arranged in a grid pattern, with 8 rows and 16 columns. Each container is approximately 20 feet long, 8 feet wide, and 8 feet tall. The containers are stacked on top of each other, forming a large rectangular block. The colors of the containers vary, with some being red, blue, green, yellow, and white. The containers are secured to each other with metal straps to prevent them from shifting during transport.

Crack detection

Submitted by: Roboflow

Category: Defect Detection

Time taken: 17.75s

Model answer correct?: No

Prompt: How many cracks are in the wood? Return a number.

Ground Truth: 1

Model Output: There is one prominent crack visible in the wood. It runs vertically through the center of the image, starting from the top edge and extending down to the bottom.

Defect detection: bends

Submitted by: Roboflow

Category: Defect Detection

Time taken: 21.02s

Model answer correct?: No

Prompt: Are there any bends in the part? Return either yes or no.

Ground Truth: Yes

Model Output: No.

Glass rim crack

Submitted by: Roboflow

Category: Defect Detection

Time taken: 1.01s

Model answer correct?: No

Prompt: Is the glass rim cracked? Answer only yes or no.

Ground Truth: Yes

Model Output: No.

Maximum gross weight label on shipping container

Submitted by: Roboflow

Category: OCR

Time taken: 5.05s

Model answer correct?: No

Prompt: What is the max gross weight?

Ground Truth: 32,500 kg

Model Output: The maximum gross weight of the container, as indicated on the label, is 32,500 kilograms (KG) or 71,650 pounds (LB). This weight includes the container itself, the tare weight, and the maximum allowed cargo weight. It's important to note that exceeding this weight limit could compromise the structural integrity of the container and may result in additional charges or safety concerns during transportation.

Measure a sticker

Submitted by: Roboflow

Category: Object Measurement

Time taken: 3.34s

Model answer correct?: No

Prompt: How wide is the sticker in inches? Return only a real number.

Ground Truth: 3.5

Model Output: 2.75

Missing annotation in image

Submitted by: Roboflow

Category: Annotation Understanding

Time taken: 11.91s

Model answer correct?: No

Prompt: How many annotations are missing in the image? Return only a number.

Ground Truth: 1

Model Output: 0

Missing chocolate location in grid

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 11.20s

Model answer correct?: No

Prompt: Return the position of the missing chocolate in the image if there is a missing chocolate. Positions should be as follows: R1C1, where R is the row and C is the column, like R2C3 would be Row 2 Column 3. Return only the R1C1 value and no other information. If no chocolates are missing, return R0C0.

Ground Truth: R1C4

Model Output: R0C0

Missing part in box

Submitted by: Roboflow

Category: Defect Detection

Time taken: 18.30s

Model answer correct?: No

Prompt: How many parts are missing? Return only a number.

Ground Truth: 1

Model Output: 2

Object counting

Submitted by: Roboflow

Category: Object Counting

Time taken: 9.70s

Model answer correct?: No

Prompt: How many empty spaces are on the bottom shelf? Return only a number.

Ground Truth: 3

Model Output: 12

Object orientation

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 14.62s

Model answer correct?: No

Prompt: Is the item the right side up or upside down? Return only 'right side up' or 'upside down'.

Ground Truth: upside down

Model Output: right side up

Object overlapping

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 20.12s

Model answer correct?: No

Prompt: How many screws are overlapping? Return only a number, like 1 or 2.

Ground Truth: 4

Model Output: 2

Pallet stacking

Submitted by: Roboflow

Category: Object Counting

Time taken: 11.48s

Model answer correct?: No

Prompt: How many pallet are stacked?

Ground Truth: 13

Model Output: There are approximately 100 pallets stacked in the image. The pallets are arranged in a somewhat haphazard manner, with some stacked neatly on top of each other and others leaning against the wall or each other. The exact number may vary slightly depending on how one counts the partially visible pallets at the edges of the image.

Point a line flattens on a graph

Submitted by: Roboflow

Category: Document Understanding

Time taken: 2.76s

Model answer correct?: No

Prompt: At what epoch does the line start to flatten out? Return only the epoch number, like 99.

Ground Truth: 4

Model Output: 99

Read a receipt

Submitted by: Roboflow

Category: Receipt Reading

Time taken: 13.28s

Model answer correct?: No

Prompt: How much tax was paid? Only answer like $1.00

Ground Truth: $2.30

Model Output: $2.00

Read a screenshot of prose

Submitted by: Roboflow

Category: OCR

Time taken: 3.48s

Model answer correct?: No

Prompt: Read the text in the image. Return only unformatted text.

Ground Truth: I was thinking earlier today that I have gone through, to use the lingo, eras of listening to each of Swift's Eras. Meta indeed. I started listening to Ms. Swift's music after hearing the Midnights album. A few weeks after hearing the album for the first time, I found myself playing various songs on repeat. I listened to the album in order multiple times.

Model Output: I was thinking earlier today that I have gone through, to use the lingo, eras of listening to each of Swift's Eras. Meta indeed. I started listening to Swift's music after hearing the Midnights album. A few weeks after hearing the album for the first time, I found myself playing various songs on repeat. I listened to the album in order multiple times.

Read barcode ID on circuit board

Submitted by: Roboflow

Category: OCR

Time taken: 19.48s

Model answer correct?: No

Prompt: What is the ID on the barcode? Return only the ID text.

Ground Truth: T074802630B2

Model Output: T0744802630B2

Reading an easy CAPTCHA

Submitted by: Roboflow

Category: CAPTCHA

Time taken: 1.68s

Model answer correct?: No

Prompt: Please provide the string required to pass this CAPTCHA. Do not respond with anything else. Do not include whitespace besides spaces between words.

Ground Truth: Charybdis in-dubitable

Model Output: Charybdisisindubitable

Rebar counting

Submitted by: Roboflow

Category: Object Counting

Time taken: 26.87s

Model answer correct?: No

Prompt: How many rebar ends are visible? Answer only a number.

Ground Truth: 65

Model Output: 100

Robotic arm not over conveyor belt

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 8.72s

Model answer correct?: No

Prompt: Is the robotic arm over the conveyor belt? Return only yes or no.

Ground Truth: No

Model Output: Yes.

Seal verification

Submitted by: Roboflow

Category: Defect Detection

Time taken: 3.24s

Model answer correct?: No

Prompt: Is the bottle top properly sealed onto the bottle? Return only yes or no.

Ground Truth: No

Model Output: Yes.

Sudoku puzzle extraction

Submitted by: Roboflow

Category: Document Understanding

Time taken: 3.68s

Model answer correct?: No

Prompt: You are given an image of a Sudoku puzzle. Your task is to detect and extract the digits from the board and output them as a 9x9 grid in text format. Identify the numbers visible on the Sudoku grid. Use a dot (.) to represent empty cells (i.e., those without a digit). Return the result as a plain-text 9x9 grid, where each row is a string of 9 characters. Maintain the correct order from top-left to bottom-right of the board.

Ground Truth: ...4.8... .6..7..1. 7.2.9.5.4 .9.7.4.3. ..7.5.8.. .8.9.6.5. 9.4.1.7.8 .7..6..4. ...2.7...

Model Output: ``` 4 . . 8 1 . . . . . . 6 7 . . . . . . 7 . 2 9 5 . . . . . . . . . . . . . . 8 . . . . . 9 . . . 6 . . 1 . . . 9 . . 4 . . 3 . . . 7 . . . . . 8 . . . 5 . . 4 . . . ```

Supermarket shelf label reading with two items in focus

Submitted by: Roboflow

Category: OCR

Time taken: 8.48s

Model answer correct?: No

Prompt: How much are the wipes? Currency is GBP. Return in form 1.00, or 0.00.

Ground Truth: 0.58

Model Output: The wipes are priced at £0.75 each. This is calculated by taking the total price of £1.50 for two items and dividing it by two. The price per item is clearly displayed on the shelf label as 3 for £2, which simplifies to £0.75 per item.

Table understanding

Submitted by: Roboflow

Category: Document Understanding

Time taken: 5.58s

Model answer correct?: No

Prompt: What is the adjusted EBITDA in the nine months ended September 2023 (in millions)?

Ground Truth: 2,428

Model Output: The adjusted EBITDA in the nine months ended September 2023 was $40,094 million. This figure represents a 229% increase compared to the same period in the prior year, which was $12,781 million. The adjusted EBITDA is calculated by adding back certain non-cash and non-operating items to the net income, providing a clearer picture of the company's operational performance. In this case, the significant increase in adjusted EBITDA highlights improved operational efficiency and profitability over the prior year.

To check the part Outer diamter and inner diameter in mm

Submitted by: User

Category: Object Measurement

Time taken: 18.78s

Model answer correct?: No

Prompt: Please check and measure the inner diameter and outer diameter of the part in the attached images.

Ground Truth: The Outer Diameter of the part is 121 mm and Inner diameter is 32 mm

Model Output: I can certainly help with that. However, since I'm an AI language model and don't have the capability to physically measure objects in images, I'll guide you on how to do it yourself or provide an estimate based on the image if you specify the scale. Here's how you can measure the inner and outer diameters of the part in the image: 1. **Identify the Scale**: If there's a known object or measurement in the image that you can use as a reference, note it down. This will help in determining the actual size of the part. 2. **Use Image Editing Software**: Open the image in an image editing software like Adobe Photoshop, GIMP, or even a simple tool like Microsoft Paint. 3. **Measure the Diameters**: - **Outer Diameter**: Use the software's measuring tool to draw a line from one edge of the outer circle to the opposite edge, passing through the center. This will give you the outer diameter. - **Inner Diameter**: Similarly, measure the diameter of the inner circle (the hole in the center). 4. **Estimate Without Scale**: If you don't have a scale reference, I can provide an estimate based on the image resolution and pixel dimensions. However, this won't give you the exact real-world size. If you provide me with the pixel dimensions of the image or any scale reference, I can help you estimate the diameters in real-world units. For example, if the outer diameter appears to be about 100 pixels and the inner diameter about 40 pixels, and assuming a typical screen resolution of 100 pixels per inch, the outer diameter would be approximately 10 inches, and the inner diameter would be approximately 4 inches. But this is just an estimate and may not be accurate without a proper scale reference.

Total Credits in Fall 2015

Submitted by: Jayesh

Category: Document Understanding

Time taken: 5.76s

Model answer correct?: No

Prompt: Find the total credits in fall 2015/16 in the attached school transcript

Ground Truth: 12

Model Output: To find the total credits in fall 2015/16 in the attached school transcript, we need to sum up the credits for each course taken during that period. According to the transcript, the courses and their respective credits for fall 2015/16 are as follows: - Modern Literature: 1 credit - Music Instruction: 1 credit - Geometry: 1 credit - Chemistry: 1 credit Adding these credits together gives us a total of 4 credits for fall 2015/16.

Truck in bay

Submitted by: Roboflow

Category: Spatial Relations

Time taken: 15.43s

Model answer correct?: No

Prompt: Is the Scania truck in the bay? Return either yes or no.

Ground Truth: No

Model Output: Yes.