That assumes that you've optimized your clothes so that everything goes with everything else or that you don't care if things match or not. And if you're either one of those types of people you're probably not agonizing over what to wear in the morning in the first place
I own 3 pairs of dark blue jeans (of the same style), half a dozen tshirts (dark blue, dark grey), 4 shirts (all vertically striped).
I just wear whatever is clean, I don't think I've spent more than an hour on clothing choices in the last year (and most of that hour would have been picking a suit out).
I do make sure everything is clean and ironed though, I like to look neat if not smart.