Insights ยท Checklist

llms.txt specification checklist

llms.txt is cheap to publish and easy to get wrong: stale links, pages that no longer exist, descriptions that disagree with the pages. This checklist produces both files from the build, validates them and keeps them current.

01Observe02Fortify03Verify04Evidence05Sustain

How to use it

Before the first step.

  • The files live at the site root: /llms.txt and /llms-full.txt.
  • Generate them from the content source rather than writing them by hand.

Steps

Each one owned and evidenced.

#StepOwnerEvidence
01Write the one-paragraph organization description that opens llms.txt, consistent with the Organization schema.Marketing leadApproved description text
02Select the pages llms.txt should feature: hubs, key services, plans, glossary, research and editorial standards.Marketing leadFeatured page list
03Generate llms.txt from the build with Markdown headings and absolute links.Technical ownerGenerated file in the build output
04Generate llms-full.txt listing every indexable page with its title and one-line description.Technical ownerGenerated file, line count equal to indexable pages
05Exclude drafts, noindex pages and redirects from both files automatically.Technical ownerBuild rule and test
06Validate that every link in both files returns 200 and matches the sitemap set.Technical ownerLink check report
07Serve both files as text/plain with the correct cache headers.Technical ownerResponse header capture
08Reference the full index from llms.txt and confirm neither file is blocked by robots or bot protection.Technical ownerFetch transcript as each crawler
09Add the files to the release checklist so they regenerate on every publish.Technical ownerRelease checklist entry
10Review quarterly for description accuracy against the live pages.Marketing leadQuarterly review note

By David Selakovic · Published 2026-10-16 · Revised 2026-10-16 · Reviewed every 180 days

Tell us what must grow.

Discuss a Requirement โ†’