Get all your news in one place.

100's of premium titles.
One app.

Get all your news in one place.

100's of premium titles. One news app.

Euronews

Indrabati Lahiri

Why news publishers are blocking AI from accessing internet archives

Archive Internet Archive Internet OpenAI Perplexity Mark Graham United States

Around 245 global news organisations across nine countries are attempting to block the Internet Archive’s crawlers. These are automated software bots that capture, display and archive content from web pages in the Internet Archive’s public-facing interface, the Wayback Machine.

The Archive holds over one trillion web pages dating all the way back to 1996, making it one of the biggest collective public information resources in the world. This includes past articles from major news organisations such as CNN, The New York Times, The Guardian, and USA Today.

Sign up to read this article

Read news from 100's of titles, curated specifically for you.

Already a member? Sign in here

Top stories on inkl right now

Airlines Face Israel Crew Rules: After flydubai incident, Air France bans Pakistani, Muslim-majority pilots

Airlines Face Israel Crew Rules: After flydubai incident, Air France bans Pakistani, Muslim-majority pilots

Air France has confirmed it is complying with new Israeli restrictions that bar flight crew members from certain nationalities from operating flights to Israel, a policy that reportedly affects citizens of 31 countries, most of them Muslim-majority nations, including Pakistan, Iran, Saudi Arabia, Algeria and Tunisia.

The Times of India

First Thing: Pope Leo recovering from surgery after lung cancer diagnosis

First Thing: Pope Leo recovering from surgery after lung cancer diagnosis

Vatican says operation on US-born head of Roman Catholic church was ‘successful’

The Guardian - UK

Trump heads to rallies in Arizona and Montana after campaign stop-off in Alaska – US politics live

Trump heads to rallies in Arizona and Montana after campaign stop-off in Alaska – US politics live

Trump has taken to campaigning in conservative-leaning parts of competitive states, rather than in more politically diverse areas

The Guardian - UK

The GOP billionaire behind the biggest political gift in U.S. history could be sued for allegedly fueling a Chicago rat infestation

The GOP billionaire behind the biggest political gift in U.S. history could be sued for allegedly fueling a Chicago rat infestation

A city document says Barre Seid has paid workers for three years to scatter nuts in Lincoln Park, but officials say the practice draws rats.

One subscription that gives you access to news from hundreds of sites

Already a member? Sign in here

DNA ties a former Chicago detective to unsolved murder of 8-year-old girl

DNA ties a former Chicago detective to unsolved murder of 8-year-old girl

More than 1,300 people were interviewed and over a dozen individuals were questioned under polygraph throughout the investigation, police said

The Independent UK

Minnesota professor linked to series of bizarre incidents involving urine at university

Minnesota professor linked to series of bizarre incidents involving urine at university

Investigators determined professor responsible for urine found on a backpack, in trash cans and in water bottles

The Guardian - US

Related Stories

Top stories on inkl right now

Airlines Face Israel Crew Rules: After flydubai incident, Air France bans Pakistani, Muslim-majority pilots

Airlines Face Israel Crew Rules: After flydubai incident, Air France bans Pakistani, Muslim-majority pilots

Air France has confirmed it is complying with new Israeli restrictions that bar flight crew members from certain nationalities from operating flights to Israel, a policy that reportedly affects citizens of 31 countries, most of them Muslim-majority nations, including Pakistan, Iran, Saudi Arabia, Algeria and Tunisia.

The Times of India

First Thing: Pope Leo recovering from surgery after lung cancer diagnosis

First Thing: Pope Leo recovering from surgery after lung cancer diagnosis

Vatican says operation on US-born head of Roman Catholic church was ‘successful’

The Guardian - UK

Trump heads to rallies in Arizona and Montana after campaign stop-off in Alaska – US politics live

Trump heads to rallies in Arizona and Montana after campaign stop-off in Alaska – US politics live

Trump has taken to campaigning in conservative-leaning parts of competitive states, rather than in more politically diverse areas

The Guardian - UK

The GOP billionaire behind the biggest political gift in U.S. history could be sued for allegedly fueling a Chicago rat infestation

The GOP billionaire behind the biggest political gift in U.S. history could be sued for allegedly fueling a Chicago rat infestation

A city document says Barre Seid has paid workers for three years to scatter nuts in Lincoln Park, but officials say the practice draws rats.

One subscription that gives you access to news from hundreds of sites

Already a member? Sign in here

DNA ties a former Chicago detective to unsolved murder of 8-year-old girl

DNA ties a former Chicago detective to unsolved murder of 8-year-old girl

More than 1,300 people were interviewed and over a dozen individuals were questioned under polygraph throughout the investigation, police said

The Independent UK

Minnesota professor linked to series of bizarre incidents involving urine at university

Minnesota professor linked to series of bizarre incidents involving urine at university

Investigators determined professor responsible for urine found on a backpack, in trash cans and in water bottles

The Guardian - US

Our Picks

NYC woman orders birthday cake for husband. Then she opens box and realizes bakery followed her decorating instructions a little too literally

It took a while for her husband to realize the mistakes on his cake.

We Got This Covered

Palantir’s CTO claims AI researchers are smoking to prove they believe AI will cure cancer, and he says it’s a sign of tech-fueled ‘mass psychosis’

Sankar attacked AI doomers in a recent interview.

Spider-Man’s 1,000th issue: the enduring appeal of the tortured Hamlet of superheroes

This autumn marks a special occasion in the Marvel universe: Spider-Man, perhaps the most popular superhero of all time, has reached issue #1,000 in the comics series.

The Conversation

The Chicks review – exquisite harmonies and hard-won vindication in anniversary show

Two decades after country music blacklisted the band for their Iraq war protest, the trio celebrate their unapologetic album Taking the Long Way

The Guardian - US

Bonnie Blue Accuses Lee Andrews of Passing Off Paid 'Sexy' Cameo as Genuine Proposition: 'I Did Charity Work Too'

Bonnie Blue accuses Katie Price's estranged husband, Lee Andrews, of paying for a personalised Cameo video and presenting her provocative remarks as a genuine proposition.

International Business Times UK

What Is the October Canon Event? TikTok's Viral Theory About Life-Changing Experiences

From texting an ex to losing a friend or making a spectacularly bad decision, TikTok has a name for October's unexpected disasters.

International Business Times UK

Fourteen days free

Download the app

One app. One membership.
100+ trusted global sources.

Download on the AppStore

Get it on Google Play