Get all your news in one place.
100's of premium titles.
One app.
Start reading
Fortune
Fortune
Paolo Confino

A startup tested if ChatGPT and other AI chatbots could understand SEC filings. They failed about 70% of the time and only succeeded if told exactly where to look

OpenAI CEO Sam Altman (Credit: Dustin Chambers—Bloomberg/ Getty Images)

Wall Street financial types who hoped that AI would soon take over the tedious job of sifting through page after page of earnings reports might have to wait a little longer. It turns out AI models from some of the most prominent tech companies, including OpenAI, Meta, and Anthropic, are exceptionally bad at analyzing SEC filings and other financial documents. 

The poor results mean that many tasks in the financial services industry that require lots of math and research will still have to be done by humans. Although financial companies have started to explore AI tools in recent months, research from startup Patronus AI published in November demonstrates they may still be unable to perform more complex tasks without human oversight. 

Sign up to read this article
Read news from 100's of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.