# robots.txt, www.googletruths.com # # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like # Google and Yahoo. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # # This file will be ignored unless it is at the root of your host: User-agent: Googlebot Allow: / Allow: /images/ Allow: /css/ Allow: /swf/ Allow: /scripts/ Allow: /aspnet_client/ Disallow: cv* Sitemap: http://www.googletruths.com/sitemap.xml User-agent: Googlebot-Mobile Allow: / Allow: /images/ Disallow: /css/ Disallow: /swf/ Disallow: /scripts/ Disallow: /aspnet_client/ Disallow: cv* Sitemap: http://www.googletruths.com/sitemap-mobile.xml User-agent: Googlebot-Image Allow: / Allow: /images/ Disallow: /css/ Disallow: /swf/ Disallow: /scripts/ Disallow: /aspnet_client/ Disallow: cv* Sitemap: http://www.googletruths.com/sitemap.xml User-agent: Adsbot-Google Allow: / Allow: /images/ Disallow: /css/ Disallow: /swf/ Disallow: /scripts/ Disallow: /aspnet_client/ Disallow: cv* Sitemap: http://www.googletruths.com/sitemap.xml