Study in progress

Does it match real people?

The claim and the pass mark were written down on 20 October 2026, before anyone took part. The result goes on this page, pass or fail.

The claim

DesignIQ names the same easier version as real people on at least 7 of 8 screen pairs, and does so more often than a check that only compares contrast.

How the study works

Eight pairs of screens, built as plain HTML pages. In each pair, version B differs from A by one deliberate flaw. Real people do the task in the browser, each getting A or B for each pair at random, and the page logs success, time and wrong clicks on its own. Nobody is told which version they are on, and the study pages carry no DesignIQ branding.

Because the pages are ours, we know exactly where every element is. That lets us score how well the model reads screens separately from how well it predicts people.

What it has to beat

Three simpler checks: a coin flip, “pick the version with higher contrast on the target”, and “pick the version with the larger target”. If DesignIQ can’t beat the contrast-only check, the simulation adds nothing, and this page will say so.

The eight pairs

The predictions are in. Real people: pending.

Pair and flaw in BTaskDesignIQ predictsReal people
1. Tiny buttonBook a table for twoA is easier, 100 vs 96Pending
2. Faint linkReset your passwordA is easier, 96 vs 77Pending
3. Competing buttonsContinue to paymentToo close, 100 vs 100Pending
4. Placeholder-only labelsSign inA is easier, 100 vs 92Pending
5. Buried call to actionStart a free trialToo close, 100 vs 100Pending
6. Icon-only actionDownload the October invoiceA is easier, 92 vs 60Pending
7. Low-contrast buttonSubscribe to the newsletterA is easier, 100 vs 94Pending
8. Icon-only searchSearch for running shoesA is easier, 98 vs 84Pending

Limits, stated up front

The first round of participants are aged roughly 19 to 23, so the older-adult persona is untested by this round. We chose the pairs ourselves. About 15 people and 8 pairs is enough to catch a model that is plainly wrong, not to prove one right.

When the study is done, the raw session log is published here as a CSV.