Build a robots.txt file by defining crawl rules for search engine bots.
Rules
Preview
User-agent: * Allow: /