OpenAI researchers might be spending >$4M/day on tokens (at API prices) (www.abtin.com)

OpenAI researchers may be incurring over $4 million daily in token usage at API pricing, according to new estimates. This calculation is based on an assumption that roughly 25% of OpenAI's 4,500 employees are researchers, with median daily token usage around $600 and those at the 90th percentile reaching above $7,000. This expenditure highlights the significant demand for AI resources within the organization, emphasizing the expansive role of tokens in research operations, though the actual costs may vary as they do not account for OpenAI’s internal expenses. The implications of this substantial token usage are profound for the AI/ML community. It underscores the escalating costs associated with AI research and development, and could fuel discussions on the sustainability of massive compute expenditures in the field. Additionally, as researchers leverage increasingly sophisticated models and algorithms, the financial burdens could potentially influence project choices and accessibility of resources. The estimated figures also draw attention to the necessity for more transparent reporting on token usage, which is crucial for budget planning and resource allocation in future AI endeavors.