At least for my ISP there is an authentication piece which you can proxy, but you still have to have the router. Unless you’re running into issues with filling up the NAT table (generally small on most ISP routers) just using IP passthrough is usually the way to go. (Again, at least with AT&T here in the US)