Show HN: Agentize lets AI agents query your website instead of crawling it (github.com)

Agentize, a new tool for website owners, enables AI agents to query content directly from their sites without the need for traditional web crawling. By creating a semantic index accessible from a specified endpoint (e.g., /agents/*), Agentize allows AI agents to request information using natural language queries. In response, agents receive structured information, including canonical URLs and relevant Markdown passages, streamlining the search process. This design eliminates the cumbersome steps of HTML parsing and reduces reliance on search engines, improving efficiency and accuracy. For the AI/ML community, Agentize represents a significant shift towards first-party interfaces for content retrieval, enhancing the way AI agents interact with published data. By relying on a self-contained indexing mechanism that is not dependent on third-party AI providers, website owners maintain control over their content and how it is indexed. This approach not only improves the reliability of the information retrieved but also allows for semantic understanding, ensuring that agents return the most relevant results without the noise typically generated by web crawlers. Agentize requires Node.js and offers a simple installation process, making it accessible for developers looking to enhance their site's engagement with AI technologies.