Scraping publicly accessible websites is legal

[Graybeard]

Good news for archivists, academics, researchers and journalists: Scraping publicly accessible data is legal, according to a U.S. appeals court ruling.

The landmark ruling by the U.S. Ninth Circuit of Appeals is the latest in a long-running legal battle brought by LinkedIn aimed at stopping a rival company from web scraping personal information from users’ public profiles. The case reached the U.S. Supreme Court last year but was sent back to the Ninth Circuit for the original appeals court to re-review the case.

Web scraping is legal, US appeals court reaffirms | TechCrunch

The landmark web scraping case was bounced back to the Ninth Circuit by the U.S. Supreme Court.

techcrunch.com

What proactive measures are you using to prevent the scraping of your content?
Or is the internet just a free-for-all

 

[T J Tutor]

Or is the internet just a free-for-all

Well, that is the way it started, and is still in many ways. Though all kinds of regs have been implemented, many of these battles will still be fought over the coming many years.

 

[Graybeard]

Ad scraping is more or less the same thing --but the ad-spy tools benefit you

I am scraping content, using paraphrasing and plagiarism rewrite AI api's to create then embellish and edit 'my own *copyright* content'.

 

[pinkface]

It's hard to block it.

 

[Graybeard]

It's hard to block it.

I minimize the damage by blocking most datacenters commony used for scraping and scrapers like curl, wget, MJ12, SemRush and Arefs others but that does causes inconveniences --I need to allow some server access for authorized server IPs.