As a business owner, you could be sitting on a digital goldmine.
Let me explain…
The internet of sameness
Over the last six months the internet has filled up with sameness.
Auto-blogging and auto-SEO AI tools all pull from the same generic sources, so they all produce the same generic content. Business owners have unleashed these tools on their own websites without realising what it costs them. Ten thousand websites, all saying the same thing, in the same order, in the same voice.
Google has responded by getting far more stringent about what it lets into the index.
There are a few reasons for that, but the main one is cost. Crawling and checking the whole internet every few days is enormously expensive. If your website brings nothing new to the internet, Google isn’t going to keep spending money processing it.
This is not an anti-AI rule, by the way. Google’s spam policies target pages built in bulk to chase rankings rather than help anyone — and the policy says plainly that it applies no matter how the content was made. Plenty of AI-assisted pages get indexed and rank perfectly well. What gets filtered out is content that adds nothing that wasn’t already on the web.
If you have ever looked in Search Console and seen a pile of pages sitting under Crawled – currently not indexed, that’s what you’re looking at. Google came, read it, and decided it wasn’t worth keeping.
Meanwhile, the bots got hungry
At the same time, a different set of crawlers arrived — the AI bots.
And they are everywhere. In June 2026 Cloudflare reported that automated traffic had passed humans for the first time, making up around 57.5% of all HTML traffic on the web.
Here’s the part most business owners haven’t seen. Cloudflare Radar tracks how many pages each bot takes for every visitor it sends back. The gap is enormous:
Source: Cloudflare Radar, 28-day window ending 21 July 2026. These ratios move around month to month.
These bots are reading enormous amounts of the web looking for something they don’t already have. Cloudflare’s May 2026 breakdown showed that under 10% of AI crawler requests were search-purpose. The rest was training and answering.
They are hunting for new information.
And that’s where you come in.
What counts as gold
If you have unique “boring” information sitting on your business drives — PDFs, documents, processes, even photos of your work sitting on your phone — then you may be sitting on Google and AI bot gold.
The bots want something that isn’t on the web yet. Information specific to the suburbs where you work. Numbers only you have. Information you’re already carrying around.
Here’s where it usually hides:
None of that feels like content. That’s exactly why it’s valuable. Nobody else has published it.
An example: quarterly data nobody else had
This month we built a website for a real estate agent.
Every quarter they release a PDF report for residents in each of their target suburbs. Real sales figures. Real rental data. Genuinely useful to their market, and not published anywhere else.
That report used to go out by email and then disappear.
So we added a resources function to the website to deploy those PDFs each quarter — with the key figures written out on the page in plain text as well, so nothing is locked inside the file. Interesting for visitors. Gold for bots. And it repeats every quarter, which means the site keeps producing something new on a schedule instead of once.
How to publish it so it actually gets used
Having the information isn’t enough. Most businesses that do have unique data bury it in ways bots can’t reach. A few rules we work to:
- Put the substance on the page, not only in the file. A PDF is fine as a download. But the headline numbers, the findings and the summary should exist as real text on a real page too.
- Don’t hide it behind a form. If a bot can’t get to it, it doesn’t exist. Gate the extras if you must, but leave the information itself open.
- Give it a page of its own with a proper URL. Not a tab, not a popup, not slide 4 of a slider.
- Date it and update it. Quarterly and annual data is the easiest information in the world to keep fresh, and freshness is one of the few honest signals you can control.
- Say where. Suburb-level specifics are the single most under-supplied thing on the web. “Sandy soil across the eastern suburbs means…” is worth more than another paragraph about the importance of quality workmanship.
- Show your working. How many jobs is it based on, over what period. That’s what makes it quotable.
Use real images. Even the imperfect ones
Custom images are a great example of the same idea.
Rather than use stock or AI generated images, use authentic images of your work. Even if they aren’t perfect. In fact, if they aren’t perfect. We have found that real images connect with the visitor. They know it’s real. It looks like where they live and it looks like what they have seen.
Once again, the code of the website can’t get in the way of them.
The biggest culprit we see is background images. Bots don’t read background images. To them it’s just a pattern, so they skip it, and all that opportunity goes with it.
| Background image | Foreground image | |
|---|---|---|
| Loaded by | CSS | The page itself |
| Can carry alt text | No | Yes |
| Read by AI crawlers | No | Yes |
| Eligible for image search | No | Yes |
| What the bot sees | Decoration | Information |
The Halo Authority system prioritises foreground images on mobile — the very place where the bots visit and process your data.
While you’re there: name the file for what’s in it, not IMG_4471.jpg. Write the alt text like you’re describing the photo to someone on the phone. And caption it if the photo has a story — captions get read more than almost anything else on a page.
Simple beats clever
The key to all of this is simplicity.
Simple code and simple design that doesn’t get in the way of the information you’re bringing to the internet.
Heavy sliders, text baked into graphics, content that only appears after a click, endless animation — all of it sits between your information and the machines trying to read it. Every layer you add is another chance for the thing you actually know to go unseen.
What to do this week
You don’t need a new website to start. Try this:
- Open Search Console. Indexing → Pages → “Crawled – currently not indexed”. That list tells you which of your pages the internet decided it didn’t need.
- List five things you know that aren’t on the web. Prices, timeframes, local conditions, a process, a comparison, a common mistake.
- Find your recurring data. Anything you already produce monthly, quarterly or annually is your easiest win.
- Scroll your camera roll. Pick twenty real photos of real work in real streets.
- Check one page for background images. If your best photo is a CSS background, it’s invisible.
So the question is, what are you sitting on?
Documents, processes, photos, data, something else.
Let us know. If you’re an SEO client of ours, tell our team and we’ll look at how we can put it to work.
Let’s ChatWe tackle this challenge with our Halo Authority Website system. It feeds your unique information to the bots while converting visitors into leads — built on a decade of analysing conversion rates and learning how bots process your data.
