Do you not have the internet for the router itself or for the clients connected to the router?
I have a similar problem here