Get all your news in one place.
100's of premium titles.
One app.
Start reading
Windows Central
Windows Central
Technology
Kevin Okemwa

"We made a mistake in not being more transparent": OpenAI secretly accessed benchmark data, raising questions about the AI model's supposedly "high scores" — after Sam Altman touted it as "very good"

OpenAI Sam Altman Epoch AI Math
OpenAI and ChatGPT.

In the next couple of weeks, OpenAI is slated to unveil o3 mini, the smaller version of its o3 series with advanced reasoning capabilities across math, science, and coding. CEO Sam Altman claims the model is "very good," potentially beating the performance of the ChatGPT maker's o1 series. The company also announced that it would launch the application programming interface (API) and ChatGPT for the model simultaneously.

While details about the AI model remain slim, reports suggest OpenAI secretly funded and accessed the FrontierMath benchmarking data, raising concerns about whether the company used the data to train o3 (via Search Engine Journal). The AI model received high scores across a wide range of benchmarks, but if the rising concerns are anything to go by, the shared results might be a fabrication of the model's reality.

Sign up to read this article
Read news from 100's of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
Alice Zaslavsky’s shortcut beetroot baked risotto – recipe
An unconventional technique makes this vibrant rice – finished with dill fronds – a lower-touch dinner for weeknights
The Guardian - AU
The Guardian - AU
Does your sleep tracker get it right? A Pittsburgh neuroscientist weighs in
On a typical night, I go to bed wearing a tracking watch on one wrist and another type of tracker on the other wrist. Then I compare their sleep findings while I drink my morning coffee.
The Conversation
The Conversation
There's A Reason Taxi Cabs Are Almost Always Yellow
Yellow taxis are easy to spot in traffic, but the color's history goes far beyond simple visibility.
Motor1
Motor1
How ‘technoference’ can disrupt parent-child connections
Have you ever been telling someone a story when their phone lights up, and their eyes flicker toward their device?
The Conversation
The Conversation
Holding Lightning by Emily Lordi review – an intimate portrait of Whitney Houston
An empathetic biography of the the singer recasts her tumultuous later career as a triumph of self-expression
The Guardian - UK
The Guardian - UK
Brian May says Queen are retiring from live tours: ‘Maybe 50 years is enough’
Rock guitarist suggested creating an interactive experience for fans similar to the ‘Abba Voyage’ show
The Independent UK
The Independent UK
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.
Download on the AppStore Get it on Google Play