Yes. It should work.

All the devices don’t need vpn should connect to the old router directly