This is indeed a firewall issue
I did ip6tables -I INPUT -j ACCEPT
and IPv6 on the router started working right away,
after ip6tables -I FORWARD -j ACCEPT
, IPv6 on LAN started working
default zone_wan_forward
chain is not matching anything
This is clearly broken IPv6 firewall rules by default