Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
alpb
on June 11, 2020
|
parent
|
context
|
favorite
| on:
A Facebook crawler was making 7M requests per day ...
Hate to say but this is probably a FB engineer running a test/experiment and not a production crawler taking robots.txt etc into account.
mcguire
on June 11, 2020
[–]
Or malware infecting some FB-internal machine?
x0
on June 12, 2020
|
parent
[–]
Doubt it. If you're a bad enough dude to get control over Facebook's internal infrastructure, I doubt you'd blow that access by using it to spam random sites.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
