In the wireguard connection, there should be an option “allow local access”. When you select you should be able to access the router using the wireguard IP.