In making an attempt to maintain up with (or forward of) the competitors, mannequin releases proceed at a gradual clip: GPT-5.2 represents OpenAI’s third main mannequin launch since August. GPT-5 launched that month with a brand new routing system that toggles between instant-response and simulated reasoning modes, although customers complained about responses that felt chilly and scientific. November’s GPT-5.1 replace added eight preset “persona” choices and centered on making the system extra conversational.
Numbers go up
Oddly, though the GPT-5.2 mannequin launch is ostensibly a response to Gemini 3’s efficiency, OpenAI selected to not record any benchmarks on its promotional web site evaluating the 2 fashions. As an alternative, the official blog post focuses on GPT-5.2’s enhancements over its predecessors and its efficiency on OpenAI’s new GDPval benchmark, which makes an attempt to measure skilled data work duties throughout 44 occupations.
Throughout the press briefing, OpenAI did share some competitors comparability benchmarks that included Gemini 3 Professional and Claude Opus 4.5 however pushed again on the narrative that GPT-5.2 was rushed to market in response to Google. “It is very important be aware this has been within the works for a lot of, many months,” Simo told reporters, though selecting when to launch it, we’ll be aware, is a strategic resolution.
Based on the shared numbers, GPT-5.2 Pondering scored 55.6 p.c on SWE-Bench Pro, a software program engineering benchmark, in comparison with 43.3 p.c for Gemini 3 Professional and 52.0 p.c for Claude Opus 4.5. On GPQA Diamond, a graduate-level science benchmark, GPT-5.2 scored 92.4 p.c versus Gemini 3 Professional’s 91.9 p.c.
OpenAI says GPT-5.2 Pondering beats or ties “human professionals” on 70.9 p.c of duties within the GDPval benchmark (in comparison with 53.3 p.c for Gemini 3 Professional). The corporate additionally claims the mannequin completes these duties at greater than 11 instances the velocity and fewer than 1 p.c of the price of human consultants.
GPT-5.2 Pondering additionally reportedly generates responses with 38 p.c fewer confabulations than GPT-5.1, in line with Max Schwarzer, OpenAI’s post-training lead, who told VentureBeat that the mannequin “hallucinates considerably much less” than its predecessor.
Nonetheless, we at all times take benchmarks with a grain of salt as a result of it’s simple to current them in a means that’s optimistic to an organization, particularly when the science of measuring AI efficiency objectively hasn’t fairly caught up with company gross sales pitches for humanlike AI capabilities.
Unbiased benchmark outcomes from researchers outdoors OpenAI will take time to reach. Within the meantime, should you use ChatGPT for work duties, count on competent fashions with incremental enhancements and a few higher coding efficiency thrown in for good measure.
