🤖 AI Summary
A new Node.js CLI and library, ai-dot-txt, makes it easy to publish machine-readable site policies by generating ai.txt, .well-known/llms.txt (JSON), robots.txt and humans.txt files. The tool offers an interactive CLI (or programmatic API) with sensible defaults and flexible flags (--out, --dry-run, --ai-only, --llms-only, etc.), emits ai.txt in a robots-like format and llms.txt as JSON, and includes fields for models, capabilities, allow/disallow paths, training/retention/commercial-use permissions and per-second rate limits. It’s built as modern ESM for Node 20+, distributed via pnpm/npm, fully tested with Mocha+Chai (23 passing tests), and MIT-licensed.
For the AI/ML community this is significant because it helps standardize how sites communicate usage and training policies to crawlers and LLMs, improving discoverability, compliance and responsible data use. By providing both human- and machine-readable outputs and a programmatic API (buildAiTxt/buildLlmsJson), the package streamlines publishing policy metadata, enforcing rate limits and signaling commercial or retention restrictions—useful for dataset curators, model builders, and site operators protecting infrastructure. The repo is small and test-driven, encouraging contributions and easier adoption of emerging ai.txt/llms.txt conventions.
Loading comments...
login to comment
loading comments...
no comments yet