# robots.txt User-agent: * Sitemap: http://www.allwebleads.com/sitemap.xml Disallow: /codebase/ Disallow: /includes/ Disallow: /index.php/ Disallow: /shia/ Disallow: /site/ Disallow: /themes/