# Robots.txt for Haystack

User-agent: *
Allow: /
Disallow: /api/
Disallow: /auth/

Sitemap: https://haystack.sh/sitemap.xml

# LLM-friendly content (Generative Engine Optimization)
# Site index for AI agents: https://haystack.sh/llms.txt
# Full content in one fetch: https://haystack.sh/llms-full.txt
# Agent setup skill: https://haystack.sh/skill.md
# Any page is available as markdown via a .md suffix or "Accept: text/markdown".