Get all your news in one place.
100’s of premium titles.
One app.
Start reading
The Guardian - AU
The Guardian - AU
Technology
Donna Lu

Misinformation, mistakes and the Pope in a puffer: what rapidly evolving AI can – and can’t – do

Donald Trump Eliot Higgins Ethan Mollick Artificial Intelligence OpenAI
Photorealistic AI-generated images of (L-R) the Pope in a puffer, Donald Trump getting arrested and Joe Biden with a mullet.
Fake images generated by AI are becoming increasingly realistic, including (L-R) the Pope in a puffer, Donald Trump getting arrested and Joe Biden with a mullet. Composite: AI images via Twitter users Pop Base/Eliot Higgins/Cam Harless

Generative AI – including large language models such as GPT-4, and image generators such as DALL-E, Midjourney, and Stable Diffusion – is advancing in a “storm of hype and fright”, as some commentators have observed.

Recent advances in artificial intelligence have yielded warnings that the rapidly developing technology may result in “ever more powerful digital minds that no one – not even their creators – can understand, predict, or reliably control”.

That’s according to an open letter signed by more than 1,000 AI experts, researchers and backers, which calls for an immediate pause on the creation of “giant” AIs for six months so that safety protocols can be developed to mitigate their dangers.

But what is the technology currently capable of doing?

It can generate photorealistic images

Midjourney creates images from text descriptions. It has improved significantly in recent iterations, with version five capable of producing photorealistic images.

These include the faked images of Trump being arrested, which were created by Eliot Higgins, founder of the Bellingcat investigative journalism network.

Midjourney was also used to generate the viral image of Pope Francis in a Balenciaga puffer jacket, which has been described by web culture writer Ryan Broderick as “the first real mass-level AI misinformation case”. (The creator of the image has said he came up with the idea after taking magic mushrooms.)

Image generators have raised serious ethical concerns around artistic ownership and copyright, with evidence that some AI programs have being trained on millions of online images without permission or payment, leading to class action lawsuits.

Tools have been developed to protect artistic works from being used by AI, such as Glaze, which uses a cloaking technique that prevents an image generator from accurately being able to replicate the style in an artwork.

It can convincingly replicate people’s voices

AI-generated voices can be trained to sound like specific people, with enough accuracy that it fooled a voice identification system used by the Australian government, a Guardian Australia investigation revealed.

In Latin America, voice actors have reported losing work because they have been replaced by AI dubbing software. “An increasingly popular option for voice actors is to take up poorly paid recording gigs at AI voiceover companies, training the very technology that aims to supplant them,” a Rest of World report found.

It can write

GPT-4, the most powerful model released by OpenAI, can code in every computer programming language and write essays and books. Large language models have led to a boom in AI-written ebooks for sale on Amazon. Some media outlets, such as CNET, have reportedly used AI to write articles.

Video AI is getting a lot better

There are now text-to-video generators available, which, as their name suggests, can turn a text description into a moving image.

It can turn 2D images into 3D

AI is also getting better at turning 2D still images into 3D visualisations.

It makes factual errors and hallucinates

AI, particularly large language models that are used for chatbots such as ChatGPT, is notorious for making factual mistakes that are easily missed because they seem reasonably convincing.

For every example of a functional use for AI chatbots, there is seemingly a counter-example of its failure.

Prof Ethan Mollick at the Wharton School of the University of Pennsylvania, for example, tested GPT-4 and was able to provide a fair peer review of a research paper as if it were an economic sociologist.

However, Robin Bauwens, an assistant professor at Tilburg University in the Netherlands, had an academic paper rejected by a reviewer, who had likely used AI as the reviewer suggested he familiarise himself with academic papers that had been made up.

The question of why AI generates fake academic papers relates to how large language models work: they are probabilistic, in that they map the probability over sequences of words. As Dr David Smerdon of the University of Queensland puts it: “Given the start of a sentence, it will try to guess the most likely words to come next.”

In February, Bing launched a pre-recorded demo of its AI. As the software engineer Dmitri Brereton has pointed out, the AI was asked to generate a five-day itinerary for Mexico City. Of five descriptions of suggested nightlife options, four were inaccurate, Brereton found. In summarising the figures from a financial report, Brereton found, it also managed to fudge the numbers badly.

It can create (cursed) instructions and recipes

ChatGPT has been used to write crochet patterns, resulting in hilariously cursed results.

GPT-4, the latest iteration of the AI behind the chatbot, can also provide recipe suggestions based on a photograph of the contents of your fridge. I tried this with several images from the Fridge Detective subreddit, but not once did it return any recipe suggestions containing ingredients that were actually in the fridge pictures.

It can act as an assistant to do administrative tasks

“Advances in AI will enable the creation of a personal agent,” Bill Gates wrote this week. “Think of it as a digital personal assistant: It will see your latest emails, know about the meetings you attend, read what you read, and read the things you don’t want to bother with.”

“This will both improve your work on the tasks you want to do and free you from the ones you don’t want to do.”

For years, Google Assistant’s AI has been able to make reservations at restaurants via phone calls.

OpenAI has now enabled plugins for GPT-4, enabling it to look up data on the web and to order groceries.

Sign up to read this article
Read news from 100’s of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
Taylor Swift shares ‘extremely important’ reminder with fans
Pop star endorsed Kamala Harris after watching her presidential debate against Donald Trump in September
The Independent UK
The Independent UK
The 27 Club isn’t true, but it is real − a sociologist explains why myths endure and how they shape reality
There’s a certain allure to the notion that some of the world’s brightest stars burn out at the age of 27. The so-called 27 Club has captivated the public imagination for half a century. Its members include legendary musicians Jimi Hendrix, Janis Joplin, Jim Morrison, Kurt Cobain and Amy Winehouse.…
The Conversation
The Conversation
Quincy Jones’s music was the soundtrack to so many Black lives – and something we could be proud of
There will be countless tributes to the revered producer, but for me he evokes happy days growing up and the chaos of family parties, says music industry employee Michelle Kambasha
The Guardian - UK
The Guardian - UK
Dick Van Dyke makes rare social media appearance to endorse US Presidential candidate
'Mary Poppins' star Dick Van Dyke, 98, has made a rare social media appearance to pledge his support to Kamala Harris in the US Presidential race, and he did so by reciting a speech he delivered alongside Martin Luther King Jr. at a 1964 civil rights event.
BANG Premier
BANG Premier
Rihanna Showed Off Her Glossy Waves With The Blunt Bob of My Dreams
Fall hair inspiration at its finest.
Marie Claire
Marie Claire
Keanu Reeves confesses to throwing up during John Wick stunts
Keanu Reeves has revealed that he relished the challenge of filming the 'John Wick' movies.
BANG Premier
BANG Premier
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.
Download on the AppStore Get it on Google Play