# Elvi Tarot - Robots.txt # https://elvitarot.com # Allow all crawlers User-agent: * Allow: / # Disallow admin and app areas Disallow: /app/ Disallow: /api/ # Disallow error pages Disallow: /404 Disallow: /500 Disallow: /401 Disallow: /403 # Sitemap location Sitemap: https://elvitarot.com/sitemap.xml # Crawl-delay for polite crawling (optional) # Crawl-delay: 1 # Specific rules for major search engines User-agent: Googlebot Allow: / Disallow: /app/ Disallow: /api/ User-agent: Bingbot Allow: / Disallow: /app/ Disallow: /api/ User-agent: Yandex Allow: / Disallow: /app/ Disallow: /api/