Microsoft to Publishers: Don't Block the AI Bots (www.adexchanger.com)

Microsoft is urging publishers and retailers to embrace AI by allowing their websites to be indexed by bots, rather than blocking them. Nikhil Kolar, VP of publisher product at Microsoft, emphasized at the AdExchanger Programmatic AI event that blocking AI crawlers hampers site visibility and discovery, ultimately harming business. With about 80% of websites currently restricting bot access, Kolar warned that this approach leads to missed opportunities for discovery and demand for their content. Microsoft has introduced a Publisher Content Marketplace to facilitate licensing agreements between publishers and AI developers, allowing for fair compensation when their data informs AI models. The conversation around bot access and licensing presents a tension within the community, as Jonathan Roberts from People Inc. suggests a cautious approach to blocking bots. He advocates starting with comprehensive restrictions to identify essential crawlers, particularly for negotiation leverage in licensing deals. While Kolar's advice targets brands and retailers wanting visibility in AI recommendations, Roberts highlights a more strategic method for traditional publishers. This dialogue underscores a significant shift in how the publishing industry can adapt to AI advancements, with both Kolar and Roberts agreeing on the crucial need for publishers to take control of their online presence during this transformative era.