QC since Democritus is a weird mix of textbook and popularization; I think you could absolutely read it without understanding the details and still enjoy it. You won't get as much, but you'll still get something.

I didn't understand much of algorithms or quantum computing when I first read the lecture notes the book is sourced from [1]. Was still worth it.

1: http://www.scottaaronson.com/democritus/