The N4 was the first phone I sat on for longer than a few months; it was such an amazing phone. The N5 was the next phone I bought and I kept that until my Xperia Z5 because I was not a fan of the N6. I was completely sold on the Nexus line until then.

I completely agree with you on newer devices being worse in some aspects, especially when it comes to rooting.