Except that the manipulations that banks were accused of resulted in lower libor fixing, i.e. you paying less on your loan than you should have. Investors are the one who can complain that they were underpaid.