Indexing is the process search engines use to catalog web pages and make them appear in search results. A crawler first discovers a URL, fetches its content, and then the search engine stores key signals such as text, links, and metadata so the page can be retrieved later by search queries.
In cyber security, indexing matters because anything publicly reachable can become searchable, even if it was intended for a small audience. Shared documents, chat snapshots, file dumps, and exposed admin pages can be indexed if they are accessible to crawlers. Defenders use controls such as authentication, access restrictions, and noindex directives to reduce exposure, but those controls only help when the crawler can actually see them. Security teams also monitor for leaked links and search visibility, because an indexed page can turn a convenience feature into an unintended disclosure surface.