Robots.txt Generator

Strategic SEO Tools

Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


About Robots.txt Generator

Robots.txt is a website file used to communicate with search engines.

Robots.txt describe which pages of your website has to be listed or not listed on search engines.


More SEO Tools from Us
Article Rewriter Plagiarism Checker Backlink Maker Meta Tag Generator Meta Tags Analyzer Keyword Position Checker Robots.txt Generator XML Sitemap Generator Backlink Checker Alexa Rank Checker Word Counter Online Ping Website Tool Link Analyzer My IP Address Keyword Density Checker Google Malware Checker Domain Age Checker Whois Checker Domain to IP Address Converter Dmoz Listing Checker
Loading...
URL Rewriting Tool www Redirect Checker Mozrank Checker URL Encoder / Decoder Server Status Checker Webpage Screen Resolution Simulator Page Size Checker Reverse IP Domain Checker Blacklist Lookup AVG Antivirus Checker Link Price Calculator Website Screenshot Generator Domain Hosting Checker Get Source Code of Webpage Google Index Checker Website Links Count Checker Class C Ip Checker Online Md5 Generator Page Speed Checker Code to Text Ratio Checker Find DNS records What is my Browser Email Privacy Google Cache Checker Broken Links Finder Search Engine Spider Simulator Keywords Suggestion Tool Domain Authority Checker Page Authority Checker Pagespeed Insights Checker Website Statistics