EY says its 'invisible' AI router has helped cut token consumption by up to 60% (www.businessinsider.com)

EY has unveiled an innovative "invisible" AI router that directs employee queries to the most appropriate AI models, significantly reducing token consumption by up to 60%. Introduced globally in April, this technology serves as an intermediary, allowing users to access AI tools seamlessly while optimizing resource allocation. Dan Diasio, EY's global consulting AI leader, noted that using the router often results in faster responses than relying solely on the most advanced models, which can be slower and more expensive. This development addresses growing concerns about the rising costs associated with AI token usage, particularly as major providers shift to token-based pricing. The significance of this router extends beyond cost savings; it exemplifies a shift in the corporate approach to AI utilization, moving from unrestricted use to strategic management. EY's AI Pulse survey revealed that 82% of senior leaders are worried about token usage, as misalignment between task complexity and model capability can lead to unexpected expenses. By implementing token budgets tailored to roles and departments, coupled with governance strategies, EY aims to enhance efficiency while ensuring that high-capacity AI models are reserved for critical tasks. This focus on value and outcomes signals a broader trend in the AI/ML community toward optimizing AI investments in a more controlled and impactful manner.