> If we were trying to adjust the time to track the solar time,

No, but

> wouldn't we need to adjust the clocks every day as days get shorter/longer

This is how hours used to work at least in Roman times, but I think also into the Medieval Ages.