Articles tagged “inference cost reduction”
3 articles · ← all articles
News
Nvidia Nemotron 3 Ultra: 10x Cheaper Than Closed
Nvidia's open Nemotron 3 Ultra model hit business-task parity with top closed AI on LangChain's Deep Agents benchmark while cutting inference costs by 10x, sending NVDA up 4%.
News
OpenAI Cuts Inference Costs in Half on Key Models
OpenAI engineers quietly developed an optimization cutting inference costs by more than half. Logged-out ChatGPT traffic now runs on just a few hundred GPUs.
News
Cheaper AI Models Gain Ground as Costs Rise
Legal AI startup Harvey cut inference costs by 3x in a live test with Fireworks AI. Coinbase's Brian Armstrong predicts 80% of workloads will run on 99% cheaper models within 12–18 months.