🤖 AI Summary
Vercel’s AI Gateway is reportedly blocking all requests when account credits reach zero, even for users with Bring Your Own Key (BYOK) configurations. This flaw means that requests intended to bypass the credit system—integrated either through the Vercel dashboard or directly in code—fail, with users receiving an "Insufficient funds" error. The expected behavior, according to documentation, is that valid BYOK credentials should enable users to authenticate directly with external AI providers without needing AI Gateway credits, thus nullifying the intended financial aspect of dependency on Vercel’s credits.
This situation has significant implications for the AI/ML community, particularly for developers and companies relying on Vercel’s services to manage costs. Users who have set up BYOK to navigate around credit costs are effectively unable to access AI services if their credits deplete, even if they have valid provider API keys. The issue highlights a critical need for Vercel to adjust its credit-check policy, allowing users with valid BYOK setups to access services irrespective of their credit status, thus preserving the intended functionality of the BYOK feature.
Loading comments...
login to comment
loading comments...
no comments yet