The issue was caused by aggressive CGNAT policy and short NAT timeouts from my mobile network operator. Thankfully I managed to solve it (solution here: link).
However I noticed that when I lock phone for longer than 10-15min session is not able to recover.