robots.txt
A robots.txt file tells search engine crawlers which parts of your site they may visit.
It sits at the root of your site. Crawlers read it before they visit.
Why it matters for a small business
A wrong rule can hide pages from search. Open yoursite.com/robots.txt and check it does not block pages you want found.
Source: Google Search Central
Related