I have a network configured with wireguard client. There is access from VPN to the local network. But no access from VPN to the upstream router.
Did you mean traffic to upstream router should go out via VPN?
Is your goal to be able to access the WAN network/internet?