Confession : I am guilty of using regex superpowers to extract data from urls. W... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		steinsgate on Jan 20, 2016 \| parent \| context \| favorite \| on: Scrapy Tips from the Pros Confession : I am guilty of using regex superpowers to extract data from urls. Will check out w3lib soon!

hackerboos on Jan 20, 2016 | [–]

I've had to write some gnarly XPath expressions to extract data with Scrapy.

> //b[contains(.,'City')]/following-sibling::a[not(preceding-sibling::b[contains(.,'Country')])]/text()

stummjr on Jan 20, 2016 | [–]

You're not alone on that! :)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact