/llms.txt — lightweight index with page titles and .md URLs/llms-full.txt — full content of every page concatenated into one file/docs.zip for bulk download, and every page with its title and .md URL. Agents read this to discover the site structure and then fetch individual pages.1curl https://your-docs-site.com/llms.txt
1234567891011121314151617181920212223# My Docs > Documentation and usage guide for My Docs. ## Best way to inspect these docs Download all docs as markdown files and grep them locally: ```bash curl -L https://example.com/docs.zip -o docs.zip unzip docs.zip -d docs grep -R "search term" docs/ ``` Use this when you need to search across the whole documentation set. The zip contains every page as a .md file. ## Page index You can also fetch individual markdown pages directly: - [Getting Started](https://example.com/getting-started.md) - [Authentication](https://example.com/guides/auth.md) - [Deployment](https://example.com/deploy.md)
docs.json navigation and are separated by frontmatter blocks containing the page title, URL, and description.1curl https://your-docs-site.com/llms-full.txt
123456789101112131415161718192021222324# My Docs > Documentation and usage guide for My Docs. This file contains the full content of all documentation pages. For a compact index, see llms.txt. To download all pages as a zip, use docs.zip. --- title: Getting Started url: https://example.com/getting-started.md description: Learn how to set up My Docs. --- # Getting Started Follow these steps to get started... --- title: Authentication url: https://example.com/guides/auth.md --- # Authentication Configure authentication for your API...
/llms.txt, /llms-full.txt) and under your base path if configured (e.g. /docs/llms.txt, /docs/llms-full.txt).