This article explains how to create a robots.txt file. A robots.txt file can be used to stop bots from crawling the website, or to set up instructions for crawling activity on a site. The steps below require cPanel access to create a robots.txt file using File Manager.
Related Articles
Find the Document Root of a Domain
Create File in File Manager
Create robots.txt File
- Log into the appropriate cPanel
- Locate the document root of the domain
- Click on the File Manager icon in the Files area of cPanel and navigate to the domains document root
- Locate the robots.txt file
- If a robots.txt file is not found one can be created
- Right-click and edit the robots.txt file
- Follow the guidelines from Google and the InMotion Hosting Support Center to determine the proper settings to add to the file
Comments
0 comments
Article is closed for comments.