Understand how search engines find, index and serve your pages

A page cannot earn search visibility until it is discovered, understood and selected for a relevant query. Identify the blocked stage before spending time on a fix.

Find the blocked search stage

Send the exact page URL, what you observe and the result you need. We will reply in writing with the smallest useful next step.

Follow the page from discovery to a search result

A search engine is a system that discovers web pages, processes eligible content and serves selected results for a query. The three-stage model below is deliberately simplified; Google’s own overview explains that crawling, indexing and serving are separate processes and that none is guaranteed. Read how Google Search works.

1. Crawl

Automated crawlers discover accessible URLs through links, sitemaps and other signals.

2. Index

The engine processes a page and may store it in its index. Discovery does not guarantee indexing.

3. Serve results

For a search, the engine selects indexed pages it considers relevant and useful. Inclusion does not guarantee visibility.

Work on the stage that is actually failing

If the page is not discovered or crawled

  • Confirm that the URL loads for visitors and permits crawling.
  • Link to it from relevant pages so crawlers and people can find it.
  • Include the canonical URL in a maintained XML sitemap when that supports discovery.

If the page was crawled but not indexed

  • Check for a noindex instruction and whether the intended canonical URL is clear.
  • Make the page distinct and useful enough to justify keeping in the index.
  • Review duplicate or near-duplicate pages that may compete with the intended URL.

If the page is indexed but not served for the expected query

  • Name the specific query and the reader’s intent instead of checking a broad topic.
  • Make the page answer that need clearly, completely and in language the reader uses.
  • Compare the page with the results already serving that query before changing it.

A sitemap can support discovery, but submission is only a hint. Review Google’s sitemap guidance. Search systems use many page-level and site-wide signals; there is no universal four-item ranking checklist. Review Google’s ranking systems guide.

Diagnose before you optimise

Use evidence from the exact URL and query. A crawl problem, an indexing decision and a weak search result need different fixes.

1

Confirm the exact canonical page URL and whether it is publicly accessible.

2

Check whether the search engine has discovered and indexed that URL.

3

If it is indexed, record the specific query and the result you expected.

4

Choose one change that addresses that stage, then verify the outcome before expanding the work.

Related concepts: SEO, site content, duplicate content and XML sitemaps.

Practical search-engine questions

Does submitting a sitemap guarantee indexing?

No. A sitemap helps a search engine discover URLs, but it is a hint rather than a guarantee that a page will be crawled, indexed or shown.

What is the difference between crawling and indexing?

Crawling is discovery and retrieval. During indexing, the engine analyses the crawled page and may store information about it in the search index; not every crawled page is indexed.

Do search engines rank whole websites or individual pages?

Search results normally serve individual pages, while page-level and site-wide signals can both affect how a page is understood and selected.

Why can an indexed page still receive no search visits?

It may not match the searches you expect, may be less useful than competing results, or may appear too low to attract visits. Check the actual query and page before choosing a fix.

Find the blocked stage before changing the whole site

Send the exact page URL, what you see and what should improve. We will help separate discovery, indexing and query relevance so the next action stays focused.

Get the smallest useful next step