Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I tried to make a custom Subscriptions view for YouTube but they kept blocking me for trying to scrape hundreds of RSS feeds.


Maybe because their robots.txt disallows that?

https://www.youtube.com/robots.txt

    User-agent: *
    ...
    Disallow: /feeds/videos.xml
    ...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: