What is Robots.txt
Robots.txt is a text file which tells robots which pages to crawl which pages to not in website.Example your website has a page www.example,com/abc and you want this page to be be crawl by any search Engine than you can use robots,txt command to tells robots to not to index this page of website.
How to Create Robots.txt file ?
- Visit the Website http://tools.seobook.com/robots-txt/generator/
- Your Robots.txt file will be Generate
- Give this code to developer , he will upload this file in Website
How to check whether your Website has Robots.txt file or not ?
Write websitename/robots.txt in url bar
If this type of File will be generated, it means your website has Robots.txt file/
No comments:
Post a Comment