Get all your news in one place.

100's of premium titles.
One app.

Get all your news in one place.

100's of premium titles. One news app.

TechRadar

Craig Hale

Perplexity accused of breaking a major online AI scraping rule - but it says it has done nothing wrong

Perplexity Cloudflare Robots

Perplexity Voice Assistant.

Perplexity seen to be ignoring signals like robot.txt to scrape online sites
It even found protected and hidden test sites from Cloudflare
OpenAI adheres to responsible crawling, but Perplexity quiet for now

Cloudflare has accused AI giant Perplexity of scraping websites which explicitly disallowed crawling via robots.txt and other network-level rules by hiding its identity and conducting obfuscated crawling activity.

Sign up to read this article

Read news from 100's of titles, curated specifically for you.

Already a member? Sign in here

Top stories on inkl right now

FBI Foils Plot To Attack Mall of America With FBI-Provided AK-47

FBI Foils Plot To Attack Mall of America With FBI-Provided AK-47

Remember, it's (almost) always the feds.

Bus Driver Removal Dispute: Kitten rescue costs Maryland driver route; parents press for return

Bus Driver Removal Dispute: Kitten rescue costs Maryland driver route; parents press for return

Cynthia Morgan, a dedicated school bus driver in Maryland, was dismissed after she permitted a student to save a kitten. This decision has ignited discussions on student welfare and the appropriateness of the response. Parents and locals are rallying for her return as support grows. The school district insists on…

The Times of India

Dozens of Tennessee Walmart employees sick, hospitalized for ‘possible food-related illness’

Dozens of Tennessee Walmart employees sick, hospitalized for ‘possible food-related illness’

Emergency crews evaluated up to 30 workers experiencing sudden nausea and vomiting during an overnight shift

The Independent UK

Are Warrantless Phone Searches at the Border Constitutional? The Supreme Court May Soon Decide.

Are Warrantless Phone Searches at the Border Constitutional? The Supreme Court May Soon Decide.

The case of George Anibowei, a U.S. citizen who has had his phone searched at least five times at the border, shows just how invasive border agents have become.

One subscription that gives you access to news from hundreds of sites

Already a member? Sign in here

Mamdani orders review of NYPD's use-of-force policies as progressives call for greater change

Mamdani orders review of NYPD's use-of-force policies as progressives call for greater change

Mayor Zohran Mamdani has ordered the New York Police Department to conduct a sweeping review of how officers use force against civilians

The Independent UK

Republican facing child sex charges set to become Louisiana police chief after his only opponent drops out

Republican facing child sex charges set to become Louisiana police chief after his only opponent drops out

Confirms he plans to "stay in the race."

We Got This Covered

Related Stories

Top stories on inkl right now

FBI Foils Plot To Attack Mall of America With FBI-Provided AK-47

FBI Foils Plot To Attack Mall of America With FBI-Provided AK-47

Remember, it's (almost) always the feds.

Bus Driver Removal Dispute: Kitten rescue costs Maryland driver route; parents press for return

Bus Driver Removal Dispute: Kitten rescue costs Maryland driver route; parents press for return

Cynthia Morgan, a dedicated school bus driver in Maryland, was dismissed after she permitted a student to save a kitten. This decision has ignited discussions on student welfare and the appropriateness of the response. Parents and locals are rallying for her return as support grows. The school district insists on…

The Times of India

Dozens of Tennessee Walmart employees sick, hospitalized for ‘possible food-related illness’

Dozens of Tennessee Walmart employees sick, hospitalized for ‘possible food-related illness’

Emergency crews evaluated up to 30 workers experiencing sudden nausea and vomiting during an overnight shift

The Independent UK

Are Warrantless Phone Searches at the Border Constitutional? The Supreme Court May Soon Decide.

Are Warrantless Phone Searches at the Border Constitutional? The Supreme Court May Soon Decide.

The case of George Anibowei, a U.S. citizen who has had his phone searched at least five times at the border, shows just how invasive border agents have become.

One subscription that gives you access to news from hundreds of sites

Already a member? Sign in here

Mamdani orders review of NYPD's use-of-force policies as progressives call for greater change

Mamdani orders review of NYPD's use-of-force policies as progressives call for greater change

Mayor Zohran Mamdani has ordered the New York Police Department to conduct a sweeping review of how officers use force against civilians

The Independent UK

Republican facing child sex charges set to become Louisiana police chief after his only opponent drops out

Republican facing child sex charges set to become Louisiana police chief after his only opponent drops out

Confirms he plans to "stay in the race."

We Got This Covered

Our Picks

Hayley Williams Urges Fans to Vote in November After Calling MAGA Supporters 'Pieces of Sh*t' on Stage

Hayley Williams urged fans to vote in November during a New Orleans concert before directing profane criticism at MAGA and referencing the Ku Klux Klan.

International Business Times UK

Reading alone, together is all the rage at book doofs and reading parties. What makes it social?

It’s called a doof, but it’s actually all about quiet reading. There are beanbags, some chairs and a few shared tables, where readers sit (or lie) down and read their separate books. Maybe some music playing in the background. Book Doof’s founder calls it a social experience. But can people…

The Conversation

‘This is not my camera’: Woman trusts camera repair shop in LA with family heirloom but the camera they return sets alarm bells ringing

She just wants her grandmother's camera back.

We Got This Covered

“Not The Lip Filler”: Christina Aguilera’s Makes Bold Fashion Move In Latest Public Appearance

Christina Aguilera’s latest public appearance has fans dissecting everything from her lips to her facial features after she stepped out in a daring, lingerie-inspired look.

Why Does Ice Cream Sometimes Get Gritty After It’s Been in the Freezer?

Few things are more disappointing than opening a container of ice cream expecting a creamy scoop and finding a gritty, crunchy, or sandy texture instead. It may seem as though the dessert has gone bad, especially if it was smooth when you first brought it home. However, several different changes…

Grocery Coupon Guide

Bruno Mars Fan Has Never Been Happier To Sell a Ticket After Horrible Gridlock Hits Santa Clara

A Bruno Mars fan said they were relieved to have sold their ticket after crowds and traffic delays followed the singer's concert at Levi's Stadium in Santa Clara

International Business Times UK

Fourteen days free

Download the app

One app. One membership.
100+ trusted global sources.

Download on the AppStore

Get it on Google Play