EarlyNarratives
Pricing
Start free trialSign in
Start free trialSign in
Signal

OpenAI cuts ChatGPT inference costs by more than half with new optimizations

Evidence first: scan the strongest sources, then decide whether to go deeper.

Published 2026-06-29 18:05 UTCUpdated 2026-06-30 17:43 UTC
rsstelegram
modelsai_infrastructurechips_and_datacenters
Trend in the last 24h
Source links open
Source links and full evidence are open here. Archive history, compare-over-time, alerts, exports, API, integrations, and workflow are paid.
BackEvidence (3)Get the free brief by emailStart free trial
No card needed for the free brief.
Evidence trail (top sources)
top sources (2 domains)domains are deduped. counts indicate coverage, not truth.
2 top sources shown
OpenAI reportedly cut response costs for guest ChatGPT users by more than half
The Decoder AI in practice · News · the-decoder.com · 2026-06-30 17:43 UTC
limited source diversity in top sources
View all evidence
Overview

OpenAI has implemented new inference optimizations that have reduced the cost of running ChatGPT by over 50%, enabling the service to operate on just a few hundred Nvidia GPUs at times.

Entities
OpenAINVIDIAAnthropicChatGPT
Score total
1.51
Momentum 24h
3
Posts
3
Origins
3
Source types
2
Duplicate ratio
0%
Why now
  • OpenAI aims to boost gross margins from 39% to 52% by year-end, driving urgent cost optimizations.
  • Rising demand for AI services makes inference cost reductions critical for competitiveness.
  • NVIDIA’s evolving inference stack supports the industry shift from peak chip specs to cost per token.
Why it matters
  • Lower inference costs enable more affordable and scalable AI services like ChatGPT.
  • Improved margins give OpenAI flexibility to enhance user experience or reduce API prices.
  • NVIDIA’s software-hardware integration is key to efficient AI deployment at scale.
LLM analysis
Topic mix: lowPromo risk: lowSource quality: medium
Recurring claims
  • OpenAI has cut inference costs for ChatGPT by more than half using new optimization techniques.
  • NVIDIA’s inference software stack enables low token cost by optimizing hardware and software integration.
How sources frame it
  • Opendatascience: neutral
  • Matthias Bastian: neutral
  • Amr Elmeleegy: neutral
All evidence
All evidence
Show filters & breakdown
Posts loaded: 0Publishers: 3Origin domains: 3Duplicates: -
Showing 3 / 0
Top publishers (this list)
  • The Decoder AI in practice (1)
  • opendatascience (1)
  • NVIDIA Press Room (1)
Top origin domains (this list)
  • the-decoder.com (1)
  • theinformation.com (1)
  • blogs.nvidia.com (1)