This is strange. As long as I know, there is no difference in the client side. Especially you say you can ping but cannot ssh.
Does the ovpn has some push options? What does the content of ovpn look like?