Resources

How Atlas investigates a website

Written by
Outseen
Updated

Short answer

Atlas, Outseen’s own research engine for SEO and GEO, investigates a website in four steps: fetching public sources, testing them technically, recording the evidence and checking again after a change. Its technical core works without a language model.

Atlas, Outseen’s own research engine for SEO and GEO, investigates a website in four steps: fetching public sources, testing them against fixed technical checks, recording the evidence behind every finding and checking again after a change. Atlas reads the code and technical signals a website returns. The technical core of Atlas works without a language model.

What does Atlas do in each step?

Atlas works in the same order every time. That is what lets you compare two measurements of the same page.

The four steps of an Atlas investigation

  1. Collect sourcesAtlas fetches the public pages and technical instructions that belong to the investigation: the HTML, the server’s HTTP responses and the site’s robots rules.
  2. TestEach check asks the source one question, with a fixed criterion. May this page appear in search results? Which URL is given as the preferred version?
  3. Record the evidenceFor every outcome, Atlas records what it found, in which source, at which URL and when. If information is missing, that is stated too.
  4. Check againAfter a change, Atlas investigates the same page again, so you can see whether the technical issue has been resolved.
Every check has a fixed question and a fixed criterion.

The last step is called a recheck. It only makes sense because the earlier measurement was recorded: you compare the same check on the same URL before and after the change.

What does Atlas investigate?

AreaWhat Atlas investigatesWhat it tells you
Page structureTitles, descriptions, language, headings and link text in the HTMLYou see missing or duplicate titles and descriptions, and empty headings or link text
Access and indexingHTTP responses, robots rules and indexing instructions in code and headersYou know whether a technical setting restricts access or indexing
Preferred URLsCanonicals and what their target page actually returnsYou find canonicals that point to an error page, a redirect or a noindex
Internal structureLinks and language references between the fetched pagesYou find links to unreachable addresses and conflicting language references
Structured dataReadability and supported fields of JSON-LD, such as product and breadcrumbYou see technical errors or missing fields in that data
EvidenceSource and time of measurement behind every findingYou can trace what a piece of advice rests on and recheck in a targeted way after a change

A general list of technical points is in the technical SEO checklist.

What does a finding look like?

A technical finding in Atlas always has the same fields. This is a real Atlas check on Outseen’s own test site.

FieldValue
CheckMay this page appear in search results?
Check typeIndexing instructions
Pagehttps://atlas-fixture-staging.outseen.io/
SourceHTTP header X-Robots-Tag
Observednoindex
OutcomeNeeds attention
Measured11 November 2026, 10:14 (UTC)
Engineatlas-engine/0.3.12
Next stepThe specialist checks whether this page belongs in search results. If the block is unintended, we remove it and let Atlas measure again.

A noindex in the X-Robots-Tag header asks search engines not to include a page, just like the same instruction in a meta tag in the HTML. Google explains both forms in Block search indexing with noindex. You cannot see a header like this on the page itself, only in the server’s response. Simplified, it looks like this:

http-response.txt
HTTP/1.1 200 OK
Content-Type: text/html; charset=utf-8
X-Robots-Tag: noindex

So the page loads normally for a visitor, while search engines are asked not to include it. A header like this can be left behind after a test period, for example, or come from a setting at your hosting provider. Why a page can be missing for this and other reasons is covered in Why is my page not showing in Google?

Because the source is part of the finding, you can trace it yourself:

Tracing a finding yourself

  • Open the URL from the finding in your browser
  • Open the developer tools and choose the Network tab
  • Reload the page and click the first request
  • Look for X-Robots-Tag among the response headers
  • Also view the page source and search for name="robots"
  • Compare the result with URL Inspection in Google Search Console
This is how you check an indexing finding without extra software. Menu names differ between browsers.

This check says something about indexing. It says nothing about your position in Google or about mentions in AI answers, and it proves nothing about the quality of the rest of the website.

Is Atlas an AI model?

No. Atlas is a research engine with defined checks: its technical core fetches sources, runs checks and links every finding to its source. That needs no language model. Outseen uses AI as a work aid, for example when working up existing information. Text generated by AI never counts as evidence of a measurement. How that works in practice is described in how we use AI. Like other software, an engine can have limited coverage or errors; that is why Atlas records what each outcome rests on, so it can be checked.

What does the specialist do?

Atlas collects and tests. The Outseen specialist assesses the findings and decides what happens next. Not every finding is a mistake: a noindex on a thank-you page is often exactly what was intended. The specialist takes your offer, your customers and your priorities into account and is responsible for the advice and the work on your website.

What does Atlas not investigate?

Atlas works with what a website returns publicly. Anything beyond that falls outside the investigation.

Inside and outside an Atlas investigation

Atlas investigatesAtlas does not investigate
CodeWhat your server returnsPrivate server code
MarkupThe HTML a page deliversThe original templates of your theme or CMS
JavaScriptThe HTML as the server sends itContent that only appears after JavaScript
ScopeThe pages that belong to the agreed investigationThe entire website
OutcomeTechnical signals with source and time of measurementRankings in Google and mentions in AI answers

On JavaScript: Google recommends making important content available without JavaScript too, because not every bot can run JavaScript (JavaScript SEO basics). More on this in Can AI crawlers read your website? Outseen checks AI answers separately, by hand, with agreed questions, environment and time of measurement.

Website check or audit?

Atlas is used in both, at a different scale.

Website checkAudit
ScopeYour homepage and at most two other pages, plus a short AI result (six questions to ChatGPT and Gemini)Agreed pages and topics
Who assessesAtlas returns the available findingsAtlas investigates the technical side, and specialists also assess content and structure
What you getA first impression, with the results by emailAn assessment of the content and a plan with priorities
Neither measures rankings in Google. The website check’s AI result is a single moment, not a trend.

Run the website check for a first impression, or read what an audit covers.

A dedicated development team works on the engine around the clock; more on that in the team behind Atlas. The team follows official documentation from Google, Bing, OpenAI and Anthropic and tests new checks before they are put to use. Outseen has no partnership with those companies and no knowledge of secret algorithms. The team works with what the providers publish themselves.

What does this mean for your business?

You can check an Atlas finding yourself, because the source, the URL and the time of measurement are part of it. Ask of every piece of technical advice, from whoever it comes, what it rests on: which page, which source, which moment. Advice without those details cannot be traced, and cannot be measured again after a change.

Know too what a technical check does not tell you. A page without findings can still rank low in Google or appear in no AI answer at all. Atlas shows whether the technical side is holding a page back; whether the content persuades customers is something a specialist assesses separately.

Sources

Read next

FAQs

Can Atlas investigate my Shopify or WooCommerce store?

Yes, Atlas investigates the public code your store returns, including on Shopify and WooCommerce. That covers the HTML, indexing instructions, canonicals, internal links and supported JSON-LD such as product and breadcrumb data. Atlas does not investigate your theme’s original templates or the code on the server. We have a standard approach for online shops on Shopify and WooCommerce; we discuss other systems in advance.

Does Atlas show how my website ranks in Google or ChatGPT?

No. Atlas investigates the technical signals your website returns, not your rankings in Google or mentions in AI answers. A technical check can show that a page has a noindex, but says nothing about how high another page ranks. We currently check AI answers by hand, with questions, environment and time of measurement agreed in advance. You can read search rankings in Google Search Console.

How do I know whether a finding from Atlas is correct?

For every finding, Atlas records what it found, in which source, at which URL and when. That lets you trace the finding yourself, for example by looking at the same HTTP header in your browser. Like any software, Atlas can have limited coverage or an error in a check. That is why one of our specialists assesses the finding before anything on your website changes.

What happens if Atlas cannot establish something?

Then the outcome says so. Atlas does not quietly mark missing information as fine. If a page could not be fetched, or a source gives too little data for a conclusion, that is stated with the check. One of our specialists then decides whether further investigation is needed, for example with access to your CMS or with a different research method.