
OpenAI Halves Inference Costs by 50% With Software Tweaks
OpenAI appears to have lowered its inference costs by more than 50 percent through software improvements, though the exact method is still secret. Reports suggest the savings are real and come from better GPU use, but details are not public, and outside experts can only guess the techniques used. This cost drop may let more companies use large language models in production and has led to lower prices across the AI industry. Vendors are reacting by cutting prices, adding new pricing tiers, and offering discounts for certain workloads. It remains uncertain if other companies will be able to match OpenAI's efficiency gains without more information.













