Audit your app

AI Website Audit: What Automated Checks Catch and Miss

An AI website audit is fast and consistent but cannot confirm everything. See a real sample report and how to pair it with a person.

An AI website audit reads your public pages the same way every time, which makes it good at repeatable checks: broken links, dead buttons, a main button hidden on a phone, a headline the rest of the page disagrees with. What it can't tell you is whether your claims are true, whether the tone fits your customers, or what happens behind a login. Run the audit first, then bring in a person for whatever's left.

If you built your site with an AI tool, you probably want a second opinion before customers see it. What matters is which questions each one can answer.

What is an AI website audit, and how is it different from a human review?

It's software that opens your live public pages, looks at what a visitor would see, and reports back against a fixed list of questions. You usually get a score and a list of fixes.

A human review is a person doing the same job by hand. They open the site, try to get something done, and notice how it feels along the way.

Ours is the first kind. No person reads your app. An AI scores it against a fixed rubric, the same list of questions for every site, which is why it comes back in minutes. The fixed list is both the strength and the limit: every site gets the same questions, and only what a public page shows can count as an answer.

What does an automated audit actually do on your site?

I'll walk you through what ours does, based on how the product works today.

  • It reads the page the way a visitor gets it, looking at the rendered page plus desktop and mobile screenshots. It covers public pages only, so it sees what a customer sees at your link and nothing behind a login.
  • It clicks through. It follows public pages and buttons, and it may submit your forms once with clearly labeled test entries.
  • It scores six areas. Each one gets a "What works" note, a "Slop tells" note, and top fixes ranked by impact.
  • It gives a verdict, a one-line label on the report, such as "Real product".
  • It checks for AI generator fingerprints and reads competitor pages. The comparison uses real pages the audit fetched, and it points out where others explain themselves better than you do.

What does an automated audit catch well?

Anything repeatable. Software doesn't get tired, and it never forgets to check the phone version.

  • Dead ends. Links that fail and buttons that do nothing. A tool can click through your public links and buttons far faster than you can by hand, and it writes down which ones failed. It also writes down what it didn't finish, which matters, as the next section shows.
  • Trust basics. Whether a visitor can find a way to reach you and read your policies.
  • The phone view. Under Mobile and Access, whether something on the small screen stands between the visitor and your main action.
  • Mixed messages. Under Clarity and Promise, whether your opening lines and the rest of the page tell the same story.
  • Generator leftovers. The fingerprint check looks for the defaults AI builders leave behind, and the report says so when it finds none.
  • Consistency. Every site gets the same questions, so you can see whether a fix moved a score.

What did a real run find, and what could it not settle?

We ran the audit on our own site, ismyappslop.com, on 28 September 2026. It scored 92 out of 100 with the verdict "Real product". The recorded evidence shows 6 pages crawled, 21 links checked (0 broken), and 9 buttons clicked (0 dead). The lowest score was Mobile and Access, at 75.

The reason? The report says the cookie banner (the small notice asking about tracking) is overly large on mobile and obscures the main call-to-action button when the page first loads. The "Where to start" panel puts the fix first: shrink the banner's height on mobile. Yes, that's our own banner.

The same report is just as useful for what it wouldn't claim:

What the audit sawWhat the report did with itWhat still needs a person
The cookie banner covers the main button on a phoneListed it as a Mobile and Access slop tell, with the shrink fix ranked 1You check the page on your own phones and decide how big a banner is acceptable
The "Opt out" button on that banner showed no visible responseListed it twice: under "Not confirmed" in the recorded evidence, and as a Flow and Usability slop tell, where fix 1 is to give the button visible feedbackSomeone with access to the consent setup checks whether the choice was saved
3 pages were "not fully clicked in the time we allow": /cookie-notice, /?hl=a, and /contactSaid so plainlyYou open those pages yourself

The "Opt out" line teaches the most. The click happened, but nothing visible followed, and a visitor-level read can't tell "nothing happened" from "it worked quietly". So the report does 2 honest things at once. It treats the missing response as a usability problem worth fixing, and it labels the underlying question "not confirmed" and leaves it open for someone who can look.

The unclicked pages are a second reminder. A tool is fast, but it works inside a time limit, and a good report lists what it skipped.

What do automated audits miss?

The first is whether a claim is true. A tool can see that a price is shown. It can't know that the price is right, or that "trusted by" has anyone behind it. If a ranked fix suggests adding a customer counter or a testimonial line, use it only with a real number or a real quote.

Then there's fit. A page can pass every check and still sound wrong for your buyers, and only someone who knows your customers knows the words they use.

It also misses anything that happens after the screen: whether a saved setting stays saved, whether the receipt email shows up an hour later, whether the payment goes through.

And it misses real-world variety, because one run is one snapshot. web.dev makes this point about speed measurement. If search is your worry, a website SEO audit checklist covers that side separately. A lab test loads a page in a controlled setup with set network and device conditions, while real visitors arrive on many devices and networks and behave in many ways. See web.dev on lab and field data. The same caution fits any single automated read.

What does a human review add, and where does it fall short?

A person brings judgment. They read your page as a first-time visitor and ask 3 plain questions: do I understand this, do I trust it, and do I know what to do next? They notice the awkward moments that technically work, like wording that sounds a little off.

People have their own limits, of course. A person is slower and costs more, and 2 people notice different things. Friends are polite. Someone who knows your product well skips the confusing parts without realizing it. That's the case for letting the audit go first. It clears the repeatable problems cheaply, so the human time goes to what only a human can judge.

I once wrote in Build the Damn Thing about the temptation every founder knows: "My site looks like it was designed by a 5 year old hopped up on Halloween candy, let me just throw a lot of money at it so I can make my MVP great." And then: "Yes, money can make your MVP better looking, but it still won't tell you if it's something people will actually buy."

How do you combine both without doing the work twice?

  1. Run the audit on your live public URL. Skip the staging link and anything behind a login.
  2. Read the verdict and the lowest-scoring area first. Our report points to its first ranked fix, so you start in one place instead of reading everything.
  3. Check each top fix yourself. Open the page and repeat the click, on a real phone as well as a laptop.
  4. Sort what you find into 3 piles: confirmed, could not reproduce, and "not confirmed". The third pile, plus any pages the report says it didn't finish, is your list for anyone with access to the settings, the code, or the payment setup.
  5. Fix the confirmed ones one at a time. That way you can tell which change did what.
  6. Then put it in front of a person, with one job to do while you stay quiet.
  7. If you changed a lot, audit again. Compare the new report with the old one.

To read a report well, see our guide on what a good audit report includes. For the walkthrough in step 6, see our website UX audit guide.

When do you need more than an audit and a few testers?

When the stakes outgrow what a public page can show. That includes taking payments, holding private customer data, working in areas like health or money, or going in front of press or investors.

At that point, bring in the right specialist: a security reviewer, an accessibility specialist who works with disabled users, a developer for the code, or a lawyer for legal questions. Our audit isn't a security review or a full accessibility audit, it isn't legal advice, and a score is never a certificate of anything. What it does well is tell you what a visitor meets on day one, and which fix to make first.

Source, read 5 October 2026: web.dev on lab and field data (updated 18 July 2022).