Did you enable the VPN Cascading? I had that same issue before when the router is running VPN client and server at the same time, this trick solved it. (See this post for details: VPN Cascading on GL.iNet routers)
Also, you might want to test if port 51820 is accessible from WAN, some ISPs might block the access of certain ports.