It's can certainly be useful if you use anything with password auth or just want to avoid logs full of bots, but otherwise just change default SSH port.