ObservationsMeasurement and KPIs
My audit tool said 68 of 75 pages had no meta description. They did.
In short
The site's bot protection showed my crawler a challenge page, so the tool was auditing the wrong thing.
What I did
My audit tool flagged 68 of 75 pages on a cleaning website as missing a meta description. I checked several of them on the live site, and they had one. The site's anti-bot protection was showing my crawler a challenge page instead of the real page.
Where
A cleaning services website, 2026
What changed
I marked every crawl-based finding for that site as unreliable until the crawler is allowed through.
What you should do
If an audit finds the same problem on almost every page, check a few by hand. It may be the crawler, not the site.
How long it took
Ten minutes to check
Bot protection is a security layer that blocks automated visitors, often by showing a test page instead of the real one.
Why it matters
An audit tool is an automated visitor. If it is blocked, it reads the test page and reports problems that do not exist. Acting on that report would waste time and could break things that were fine.
How to check your own site
- Compare a few flagged pages in the tool with the same pages in your browser.
- If they differ, allow your tool’s crawler in the security settings and run the audit again.
At a glance
68 of 75pages wrongly flagged
1challenge page the tool was reading
10 minutesto find out
What this changed in how I work
When a tool reports something on nearly every page, I now suspect the tool first.
End of Lab entry No. 074
- Bing showed one of my guides 377,071 times in four weeks, and almost nobody clicked9 Nov 2026
- A question with a one line answer was shown 2,572 times and got no clicks3 Nov 2026
- Image search showed my poetry site almost three times more than web search, but brought 5 percent of its clicks2 Nov 2026
- Desktop had 68 percent of the impressions, but phones brought 75 percent of the clicks2 Nov 2026