Google is discontinuing its free web search index for developers (www.heise.de)

Google has announced it will discontinue free access to its full search index for developers, limiting new Programmable Search Engines to a maximum of 50 domains. This shift means existing search engines that index more than 50 domains must transition to a paid alternative, such as the new Vertex AI Search, by January 1, 2027. Google claims this change is part of an "evolution towards focused, more powerful solutions" that aim to improve user experience. The Custom Search JSON API will also be retired, putting pressure on developers, especially those from niche markets and educational institutions, to adapt their implementations. The implications for the AI/ML community are significant. As developers shift to paid solutions, the viability of independent and specialized search engines may be threatened, forcing many to rely on alternatives like Meilisearch or Common Crawl, which may not match Google's index in currency or completeness. Additionally, this move could raise antitrust concerns in the EU, where Google’s control over search infrastructure is under scrutiny. While Google argues that the change simplifies its product offerings, critics worry it may stifle competition and innovation in the search engine landscape.