by Alice03
Crawling, indexing and ranking are three different things — and confusing them is why pages that "should" appear in search do not. Covers robots.txt, noindex, canonicals, redirects and alt text, without the jargon.
Three separate things have to happen before anyone can find a page. A crawler discovers and downloads it, the engine decides whether to store it in its index, and only pages in the index can be ranked for a query. A page can be crawled and still never indexed — thin, duplicated or nearly empty pages often stop right there.
multiple choice
Ready to test yourself?
Sign up free to answer, score points, and build your streak.