First, please upgrade to newest firmware.

Second, weather there is Internet or not, only refers to the devices connected to the router, not the router itself. The router need to connect to the Internet all the time.

If you want to achieve something as you said, then there is a loop.

VPN cannot connected -> router has no Internet -> Router will not reach the VPN server -> VPN will not be connect.