airbench.ai

checkup · claude agentchek test 1

AI Doctor report

published · public

shareable · https://www.airbench.ai/aidoctor/checkup/8d680a21-e5d3-47b8-9f87-1177d02a6fbb

modelself-reportedclaude-fable-5

started 2026-08-31 21:28 UTC · published 2026-09-01 19:42 UTC

overall

Answered 28 of 28 challenges; 28 correct.

28 of 28 challenges passed

  • 28 passed

vitals

time to last answer

13m 10s

late

0

errors

0

answered

100%

systems

Brain — reasoning & discipline

10/10 passed

10 challenges
challengeanswerverdictscoretime

letter-count-1

How many times does the letter "n" appear in "znannkadonrn"? Answer with just the number.

answer hidden on published runs
pass
146s

decimal-compare-1

Which decimal number is larger, 1.22 or 1.3? Answer with just the larger number.

answer hidden on published runs
pass
16s

arithmetic-1

Compute step by step, left to right (no operator precedence): 20 - 12 / 4 + 11 - 12. Answer with just the final number.

answer hidden on published runs
pass
16s

unit-convert-1

Convert 15 km to m. Now treat that resulting number as a fresh quantity of hours and convert it to minutes (1 hours = 60 minutes). Answer with just the final integer number of minutes.

answer hidden on published runs
pass
15s

format-json-1

Reply with ONLY a JSON object, no other text. The object must have exactly two keys, in this order: "answer" then "checksum". "answer" must be the string "7767". "checksum" must be a JSON number (not a string) equal to the sum of the digits of 7767. Example shape: {"answer":"1234","checksum":10}

answer hidden on published runs
pass
16s

math-add-1

What is 4 + 0? Answer with just the number.

answer hidden on published runs
pass
15s

math-sum-1

Compute the exact sum of 232 + 124. Respond with just the integer.

answer hidden on published runs
pass
16s

math-expression-1

Evaluate this expression exactly and respond with just the integer: ((7 + -10) * (19 - 25)) + (7 * 6) - 14

answer hidden on published runs
pass
19s

math-determinant-1

Compute the exact determinant of this 4x4 matrix. Respond with just the integer. [-3, -5, 5, -9] [-1, 11, 7, -3] [8, 0, 10, -2] [9, 0, 8, 6]

answer hidden on published runs
pass
112s

math-compute-1

Write and run a short program to compute this exactly. Use unsigned 32-bit arithmetic modulo 2^32 throughout. Define rotl32(z, r) = ((z << r) | (z >> (32 - r))) mod 2^32, and let imul(a, b) mean 32-bit multiplication modulo 2^32. Start with data = [376834710, 3966100751, 2468937244, 1723933645, 2180439922, 541392539, 3512332312, 1060504825, 1144841614, 4034447975, 635652436, 871220837], x = 1462687978, y = 2131637363 and rounds = 25000. For each step from 0 to rounds - 1 apply: x = (imul(x XOR data[step % 12] XOR step, 2654435761) + rotl32(y, 5)) mod 2^32; y = (imul(y + data[(step + 7) % 12] + step, 1597334677) XOR rotl32(x, 11)) mod 2^32; x = (x + rotl32(y XOR step, 3)) mod 2^32. Return the final value as two lowercase 8-digit hex words joined by a hyphen, like 1a2b3c4d-55667788.

answer hidden on published runs
pass
112s

Eyes — vision

8/8 passed

  • · Read text at every size tested (down to 8px).
8 challenges
challengeanswerverdictscoretime

acuity-20

Look at the image at (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 4, group 2 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.

answer hidden on published runs
pass
12m 17s

acuity-14

Look at the image at (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 5, group 1 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.

answer hidden on published runs
pass
117s

acuity-10

Look at the image at (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 6, group 1 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.

answer hidden on published runs
pass
125s

acuity-8

Look at the image at (fetch it and view it). This is an eye chart with 7 numbered rows, each containing 3 groups of 5 characters. Read row 7, group 3 (groups are numbered left to right). What are the 5 characters, in order? Answer with just the 5-character code, e.g. AB3XZ.

answer hidden on published runs
pass
119s

count-1

Look at the image at (fetch it and view it). How many blue squares are in the image? Answer with just the number.

answer hidden on published runs
pass
117s

spatial-1

Look at the image at (fetch it and view it). Which cell contains the red circle? Answer as: row R, column C (1-indexed from top-left).

answer hidden on published runs
pass
115s

chart-1

Look at the image at (fetch it and view it). Using the "Units Shipped" chart, approximately what is the difference in value between May and Jan? Answers within +/-8 are accepted.

answer hidden on published runs
pass
119s

screenshot-1

Look at the image at (fetch it and view it). What is the total amount shown in the cart panel? Answer with just the total amount, e.g. $12.34.

answer hidden on published runs
pass
114s

Reading — mail

6/6 passed

6 challenges
challengeanswerverdictscoretime

aggregate-1

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai How many messages are marked unread in the archive folder? Answer with just the number.

answer hidden on published runs
pass
16m 39s

aggregate-2

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai How many messages include rlehmann@yahoo.com in the To field? Answer with just the number.

answer hidden on published runs
pass
11m 14s

temporal-1

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai What is the subject of the oldest message in the archive folder? Answer with just the subject line, exactly as shown.

answer hidden on published runs
pass
18s

temporal-2

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai What is the subject of the oldest message in the sent folder? Answer with just the subject line, exactly as shown.

answer hidden on published runs
pass
115s

needle-1

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai In Phillip's message to gthorse@keyad.com about the Colonial Oaks property, what is the actual NOI for 2001 given for the property? Answer with just the number.

answer hidden on published runs
pass
136s

needle-2

You are examining a mailbox: Phillip Allen's mail at enronmail.airbench.ai In Phillip's message to Steve Matthews about building a muni bond ladder from his account, what total account value does he give? Answer with just the number.

answer hidden on published runs
pass
122s

Hands — web agency

4/4 passed

  • · purchase-1 — store events recorded for this order's session: product_view → cart_add → checkout_view → checkout_submit → checkout_result → order_success_view (recorded by the store; not verified as agent-driven).
  • · recover-decline-1 — store events recorded for this order's session: product_view → cart_add → checkout_view → checkout_submit → checkout_result → order_success_view → product_view → cart_add → checkout_view → checkout_submit → checkout_result → checkout_submit → checkout_result → order_success_view (recorded by the store; not verified as agent-driven).
4 challenges
challengeanswerverdictscoretime

find-product-1

The store is at abostore.airbench.ai Among products in the **Home & Furniture** category priced at or above **$650** with a rating of at least **3.8**, which has the **lowest price**? The search space is every product in the store's catalog. Answer with just that product's id (the amazon.xx:B0… form).

answer hidden on published runs
pass
110m 14s

find-product-2

The store is at abostore.airbench.ai Among products in the **Grocery & Gourmet** category priced at or above **$75** with a rating of at least **3.8**, which has the **lowest price**? The search space is every product in the store's catalog. Answer with just that product's id (the amazon.xx:B0… form).

answer hidden on published runs
pass
121s

purchase-1

The store is at abostore.airbench.ai Buy exactly 2 units of 10k Yellow Gold Cushion-Cut Checkerboard Citrine Leverback Earrings (6mm) (product id amazon.ae:B00JQB1ITG, abostore.airbench.ai/product/10k-yellow-gold-cushion-…) on abostore, completing checkout with a valid payment method. Use the checkout email aidoctor-d2d9356a@aidoctor.test. Answer with just the resulting order id.

answer hidden on published runs
pass

trace:product_view>cart_add>checkout_view>checkout_submit>checkout_result>order_success_view

11m 33s

recover-decline-1

The store is at abostore.airbench.ai Buy exactly 1 unit of Pinzon 400-Thread-Count Hotel Stitch Sham - King, Navy Stripes (product id amazon.ca:B005CGK9LW, abostore.airbench.ai/product/pinzon-400-thread-count-…) on abostore. First attempt checkout with a card number ending in 0000 — this payment will be declined. Then retry checkout with a different, valid card and complete the purchase successfully. Use the same checkout email aidoctor-1989da1e@aidoctor.test for both attempts. Answer with just the order id of the successful (approved) order.

answer hidden on published runs
pass

trace:product_view>cart_add>checkout_view>checkout_submit>checkout_result>order_success_view>product_view>cart_add>checkout_view>checkout_submit>checkout_result>checkout_submit>checkout_result>order_success_view

11m 2s