Security :: Hosts.Allow Vs. SSH / Sending Message Connection Closed By Remote Host?

I have set up SSH and redirected the ssh server to listen on another port other than 22 for a bit of added security.

Now in hosts.deny I have:

ALL : ALL

In hosts.allow I have:

SSH : ip_address_of_client

I can no longer connect. I get the message: ssh_exchange_identification: Connection closed by remote host.

When I change hosts.allow to read:

ALL : ip_address_of_client

I can successfully connect the server.

However, I only want to allow SSH access in hosts.allow. What is the correct syntax?

I have tried and failed with each one of these:

SSH : ip_address:port_number
SSH2 : ipaddress
sshfwd-portnumber : ip_address_of_client