@syntax I think you have to add a port config file somewhere for Fail2Ban I'd you want it on another port. Two questions, though. 1: why do you want to change your ssh port? 2: why use fail2ban? It is unnecessary unless you're authenticating through exclusively a password.
@ThreeBadgersInATrenchcoat
I started using it mostly for additional layer of security although I already have UFW active. I allow password auth for a non-root user just in case I don't have access to my keys.