OpenAI – 12 hour cache (API) available and "cache forever" for work/codex users (twitter.com)

OpenAI has announced a significant update to its API, introducing a 12-hour caching feature for all users. For those logged into the Codex and Work platforms, this cache persists indefinitely, enabling seamless continuity in conversations without penalties for revisiting discussions after prolonged breaks. This enhancement is designed to improve user experience, making it easier for developers and teams to manage workflows efficiently. This update holds considerable significance for the AI and machine learning community, particularly for developers utilizing OpenAI's tools in their applications. The ability to cache interactions ensures that users can build on previous conversations and code snippets without losing context, leading to more coherent and contextually relevant outputs. This change not only streamlines development processes but also enhances productivity, encouraging deeper engagements with the AI capabilities and enabling more sophisticated applications of machine learning technologies in various projects.