what vpn protocol? which vpn service?
Do you have normal Internet when you connect to the router?
Regardless of the above, you can always try to set up custom dns server on the router to 8.8.8.8 and 8.8.4.4, or use encrypted dns settings.