You need to either a) turn off password authentication on the host in sshd_config (recommended), or b) man ssh to find the option (I think it's -o ...

Disabling the ssh-rsa type of key will be a big issue though for those using smartcards to authenticate. A big usecase of OpenPGP cards is authenticating over SSH, and not being able to do this ...