robots.txt

This is the robots.txt setup page. Edit the content of the generated robots.txt file in Page Properties.

# # robots.txt # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google.By telling these robots where not to go on your site, # you save bandwidth and server resources. # # This file will be ignored unless it is at the root of your host: # # For more information about the robots.txt standard, see: # http://www.robotstxt.org/robotstxt.html # # IMPORTANT: # Create new rules using the names of the pages of your location/language # site. For example, in USA/English, "Allow: /Frequently-asked" or "Disallow: /content/qa/coca-cola/error". # Always create rules for pages that already exists in your location/language site. # Rules in other languages will not be applied to your location/language pages. # User-agents User-Agent: * Disallow: Sitemap: http://www.schweppes.com.br/sitemap.xml # Pages allow and disallow # Include new lines starting with "Allow:" or "Disallow:" to include new rules.