Robots.txt Generator

搜索引擎优化

Robots.txt Generator


:  
    
:
    
:  
     
: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
: "/"
 
 
 
 
 
 
   




Robots.txt Generator

Robots.txt Generator. Search Engines are usingrobots (or so called User-Agents) to crawl your pages. The robots.txt file is a text file that defines which parts of a domain can be crawled by a robot