Cannot connect WG server if WG client vpn is on in the router

I have te following setup in my GL-AXT1800;

  • vpn server (wireguard port 51821) used for remote connect lan/internet
  • vpn client (wireguard port 51820) used for vpn internet connection

When vpn client is on I cannot connect to WG server (no handshake).
If I switch of vpn client, connecting to WG server works fine.

Any suggestions how to set this up correctly so it will work.

kind regards, hrbrt