And if people, like I'm doing, start to block AI access to their blogs? Some stu... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		otaviojr on Aug 28, 2024 \| parent \| context \| favorite \| on: Ask HN: Why Is Stack Overflow Fading Away? And if people, like I'm doing, start to block AI access to their blogs? Some studies show that the number of sites with AI blockers at their robots.txt has dramatically increased! Right now, some companies are trying to ignore robots.txt, but after regulations...

seanthemon on Aug 29, 2024 [–]

Do you also block all google bots? Who's to say your data isn't scraped by the company but buys it from brokers who can? Robots.txt is theater.

Consider applying for YC's Summer 2026 batch! Applications are open till May 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact