Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
pavel_lishin
59 days ago
|
parent
|
context
|
favorite
| on:
Stop crawling my HTML – use the API
If you are designing a car, it behooves you to understand the driveway of your car's purchaser.
dotancohen
59 days ago
[–]
Web scrapers are typically custom written to fit the site they are scraping. Very few motor vehicles are commissioned for a specific purchaser - fewer still to the design of that purchaser.
pavel_lishin
59 days ago
|
parent
[–]
I have a hard time believing that the scrapers that are feeding data into the big AI companies are custom-written on a per-page basis.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
