robots.txt
Search engine crawling configuration
robots.txt Content
# robots.txt for Political Campaign Platform User-agent: * Allow: / # Sitemap location Sitemap: https://electpolling.com/sitemap.xml # Crawl-delay for bots Crawl-delay: 1 # Allow all major search engines User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Slurp Allow: / # Disallow admin and private areas Disallow: /admin Disallow: /api/ Disallow: /private/ # Disallow duplicate content Disallow: /*?sort=* Disallow: /*?filter=*
Note: To implement this, your hosting provider needs to serve this content at /robots.txt. This page provides the content for reference.
