Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Selenium just couldn't parse the over-engineered Javascript framework we had, and I had to pile on hacks on hacks.

Excuse me, but isn't selenium actually a browser robot and not a javascript parser? I assume this is just that DOM is mutating so much that they could or could not find that element or always have to wait for it and comes with unreliability and such.

I haven't used alternatives, but using selenium feels like solid "Engine" to make abstractions on.



That's odd - Selenium has been my go-to when I need to scrape and Scrapy won't suffice (I'm not doing anything too huge in scale) and it handles web apps well. I do have a lot of waiting for elements to be visible, admittedly.


Testing, scraping, and automating are not really the same tasks.


I'm a heavy user of playwright and I find it by far the best tool for all of three.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: