Frequent freezes with a Beryl

tlater · August 31, 2021, 11:26pm

Hi,

I’ve been using my beryl for about a week now, but over the last few days I’ve been having complete connection freezes every couple of hours.

The router will be showing its usual white glow, but for all intents and purposes seems to be unresponsive. Here’s some of the stuff I was trying to debug with during the last one:

tlater ~ $ route
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
^C
tlater ~ $ ping 192.168.8.1
PING 192.168.8.1 (192.168.8.1) 56(84) bytes of data.
From 192.168.8.193 icmp_seq=1 Destination Host Unreachable
From 192.168.8.193 icmp_seq=2 Destination Host Unreachable
From 192.168.8.193 icmp_seq=3 Destination Host Unreachable
^C
--- 192.168.8.1 ping statistics ---
4 packets transmitted, 0 received, +3 errors, 100% packet loss, time 3055ms
pipe 3
tlater ~ $ ip addr show
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
    link/ether 18:c0:4d:39:64:87 brd ff:ff:ff:ff:ff:ff
    altname enp5s0
    inet 192.168.8.193/24 brd 192.168.8.255 scope global dynamic noprefixroute eno1
       valid_lft 26006sec preferred_lft 20606sec
    inet6 fe80::1ac0:4dff:fe39:6487/64 scope link
       valid_lft forever preferred_lft forever
3: wlp6s0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default qlen 1000
    link/ether 34:cf:f6:b8:3a:76 brd ff:ff:ff:ff:ff:ff
tlater ~ $ ping 192.168.8.193
PING 192.168.8.193 (192.168.8.193) 56(84) bytes of data.
64 bytes from 192.168.8.193: icmp_seq=1 ttl=64 time=0.027 ms
^C
--- 192.168.8.193 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.027/0.027/0.027/0.000 ms
tlater ~ $ ping 192.168.8.1
PING 192.168.8.1 (192.168.8.1) 56(84) bytes of data.
^C
--- 192.168.8.1 ping statistics ---
4 packets transmitted, 0 received, 100% packet loss, time 3107ms

This is from an ethernet connection, however the connection on my phone also drops in these instances.

Since I cannot access the router configuration page when this happens, the only recourse should be the reset button, but this hasn’t actually worked yet. After using it the router will just continuously flash blue, until I get tired of waiting and pull and reinsert the power cable - that will restart the router properly and give me access back within a minute or so.

Since I was suspecting this may have been caused by adguard I factory reset the router - I’m currently on firmware version 3.203, and the only configuration changes from the default are:

Admin Password set
WLAN
- All SSIDs changed
- 2.4G disabled
- 5G password changed
- 5G set to hidden
- 5G set to channel 48
IGMP snooping enabled
Time Zone
DNS over TLS enabled

Before the factory reset I’d enabled the openwrt interface and had ssh access to the router, but of course logread is useless since it doesn’t log the previous boot - and I cannot access the router when it fails, so there doesn’t seem to be a way to figure out what’s causing it to freeze.

Any ideas on how I can debug?

elorimer · September 1, 2021, 7:13am

There is a firmware version in MT1300/testing called 0826-oops-track that I suggest you try. I’m up almost 6 days without a hiccup. It has a new network driver addressing an ethernet problem–there is a thread about it here. That firmware version has a few broken dependencies (sqm for one) but I haven’t had any performance issues.

Happi · September 1, 2021, 8:10am

I have a very similar set-up to you, only difference is IGMP Snooping. I would suggest disabling that and see if that’s the problem.

Happi

beniamin · September 1, 2021, 2:19pm

What power supply are you using? My MT1300 has been up for over 3 weeks on stock FW, running over 20+ devices at home. Never a problem, and I have a very custom config too, lots of extra plugins, no issues whatsoever.

tlater · September 1, 2021, 3:40pm

Hm, thanks for the suggestions so far. I’ll flip off IGMP snooping for now, and look at the testing firmware.

I’m just running with the power supply provided with the router. I’ve had no freezes since that last one 24 hours or so ago, so who knows. Not using the micro SD slot yet, so I don’t have enough space for “lots of plugins”

I’d be happier with a way to get at least the final few hundred log lines from the previous boot, though, since that way I could probably figure out what’s actually going wrong.

alzhao · September 7, 2021, 7:16am

If you are willing to get, we have a special firmware, which record log when the router crashes. You can get these log after the router reboot.

It is here https://dl.gl-inet.com/firmware/mt1300/testing/
Use this file
openwrt-mt1300-3.203-0826-oops-track.bin

When the router crash and reboot, then get the log using

dd if=/dev/mtd7 of=/last.log

tlater · September 7, 2021, 9:02pm

Thanks! The router has been stable for about a week now, I’ll wait just a bit longer and try adding some add-ons then. If I still encounter issues I’ll try out that firmware.

tlater · September 12, 2021, 7:36pm

Issues are back after enabling (and subsequently disabling/removing) a VPN. I’ll try out the firmware and try to see what’s causing it.

tlater · September 12, 2021, 8:13pm

Well, that was anti-climatic.

Router is now stuck with a permanent blue light. Using the reset button for a factory reset doesn’t solve this, though the blue light flashes for a very short while, the router turns off and then gets back to permanent blue lights. The other reset mode (3 seconds for a restart I presume) doesn’t do anything, and pulling the cable and reinserting results in the permanent blue light as well.

No wifi is set up, nor do I get an IP address via ethernet (though I do get a carrier, so something is alive):

Sep 12 21:02:32 yui dhcpcd[2347]: eno1: carrier acquired
Sep 12 21:02:32 yui dhcpcd[2347]: eno1: IAID 4d:39:64:87
Sep 12 21:02:32 yui dhcpcd[2347]: eno1: adding address fe80::1ac0:4dff:fe39:6487
Sep 12 21:02:33 yui dhcpcd[2347]: eno1: soliciting a DHCP lease
Sep 12 21:02:33 yui dhcpcd[2347]: eno1: soliciting an IPv6 router
Sep 12 21:02:38 yui dhcpcd[2347]: eno1: probing for an IPv4LL address
Sep 12 21:02:42 yui dhcpcd[2347]: eno1: using IPv4LL address 169.254.52.167
Sep 12 21:02:42 yui dhcpcd[2347]: eno1: adding route to 169.254.0.0/16
Sep 12 21:02:42 yui dhcpcd[2347]: eno1: adding default route
Sep 12 21:02:46 yui dhcpcd[2347]: eno1: no IPv6 Routers available

It seems to now be officially dead - or at least I don’t know how to revive it without getting a connection or a functioning reset button. Is there anything I can try before using my warranty on it?

elorimer · September 12, 2021, 8:51pm

Hold the reset in for at least 10 seconds to reset.

tlater · September 12, 2021, 9:21pm

That doesn’t seem to work

tlater · September 13, 2021, 2:27am

Ah, I ended up finding this page: Debrick via Uboot - GL.iNet Docs

This worked flawlessly, the router is back alive and I now have a /dev/mtd7 - currently it doesn’t contain anything useful of course, I’ll wait and see if I can reproduce the issue with this firmware. Thanks for the help so far!

alzhao · September 13, 2021, 9:39am

Thanks and hope you can help to find more info

tlater · September 22, 2021, 12:04pm

I just had another freeze, looks like a memory leak:

\0\0\0\0]\0]<4>[ 3175.210139] 145 total pagecache pages
<4>[ 3175.213783] 0 pages in swap cache
<4>[ 3175.217092] Swap cache stats: add 0, delete 0, find 0/0
<4>[ 3175.222289] Free swap  = 0kB
<4>[ 3175.225150] Total swap = 0kB
<4>[ 3175.228030] 65536 pages RAM
<4>[ 3175.230807] 0 pages HighMem/MovableOnly
<4>[ 3175.234618] 2253 pages reserved
<6>[ 3175.237753] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
<6>[ 3175.246283] [  689]     0   689      258        8       3       0        0             0 urngd
<6>[ 3175.254858] [ 2300]     0  2300      271        7       3       0        0             0 dropbear
<6>[ 3175.263706] [ 4998]     0  4998      944        0       4       0        0             0 gltertf
<6>[ 3175.272483] [17380]     0 17380      406        0       3       0        0             0 netifd
<6>[ 3175.281163] [17463]     0 17463      667        0       4       0        0             0 dnsmasq
<3>[ 3175.289931] Out of memory: Kill process 689 (urngd) score 0 or sacrifice child
<3>[ 3175.297164] Killed process 689 (urngd) total-vm:1032kB, anon-rss:32kB, file-rss:0kB, shmem-rss:0kB
<4>[ 3175.345927] procd invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null),  order=1, oom_score_adj=0
<4>[ 3175.357748] CPU: 1 PID: 1 Comm: procd Not tainted 4.14.221 #0
<4>[ 3175.363465] Stack : 00000000 0000000a 00000040 8007345c 80600000 8059f784 00000000 00000000
<4>[ 3175.371799]         8056912c 8fc2dc24 8fc3837c 805dc9c7 80563ec0 00000001 8fc2dbc8 ac07f5c4
<4>[ 3175.380137]         00000000 00000000 80740000 00010b20 00000000 000010f3 00000007 00000000
<4>[ 3175.388472]         00000000 805e0000 00057574 00000000 80000000 80600000 00000000 8056e910
<4>[ 3175.396810]         00000000 00200000 ffffffff 0000000a 00000000 802c34c0 00000004 80740004
<4>[ 3175.405146]         ...
<4>[ 3175.407589] Call Trace:
<4>[ 3175.410053] [<8000c7b0>] show_stack+0x58/0x100
<4>[ 3175.414493] [<8049ced4>] dump_stack+0xa4/0xe0
<4>[ 3175.418844] [<800d8690>] dump_header.isra.25+0x90/0x1e0
<4>[ 3175.424046] [<800d78a4>] oom_kill_process+0x10c/0x4c4
<4>[ 3175.429078] [<800d8528>] out_of_memory+0x3c0/0x430
<4>[ 3175.433856] [<800dd100>] __alloc_pages_nodemask+0x994/0xd0c
<4>[ 3175.439415] [<8002d2f8>] copy_process.part.87+0xe8/0x160c
<4>[ 3175.444790] [<8002e9d0>] _do_fork+0x100/0x380
<4>[ 3175.449131] [<8002ecb0>] sys_fork+0x24/0x30
<4>[ 3175.453312] [<80016578>] syscall_common+0x34/0x58
<4>[ 3175.458068] Mem-Info:
<4>[ 3175.460347] active_anon:164 inactive_anon:23 isolated_anon:0
<4>[ 3175.460347]  active_file:14 inactive_file:3 isolated_file:0
<4>[ 3175.460347]  unevictable:0 dirty:0 writeback:0 unstable:0
<4>[ 3175.460347]  slab_reclaimable:2340 slab_unreclaimable:18670
<4>[ 3175.460347]  mapped:1 shmem:125 pagetables:21 bounce:0
<4>[ 3175.460347]  free:5060 free_pcp:290 free_cma:0
<4>[ 3175.491958] Node 0 active_anon:656kB inactive_anon:92kB active_file:56kB inactive_file:12kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:4kB dirty:0kB writeback:0kB shmem:500kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
<4>[ 3175.513707] Normal free:20240kB min:16384kB low:20480kB high:24576kB active_anon:656kB inactive_anon:92kB active_file:56kB inactive_file:12kB unevictable:0kB writepending:0kB present:262144kB managed:253132kB mlocked:0kB kernel_stack:103600kB pagetables:84kB bounce:0kB free_pcp:1160kB local_pcp:336kB free_cma:0kB
<4>[ 3175.541307] lowmem_reserve[]: 0 0 0
<4>[ 3175.544791] Normal: 438*4kB (UMEH) 116*8kB (MH) 82*16kB (MH) 55*32kB (UMEH) 62*64kB (UMEH) 24*128kB (UMEH) 21*256kB (UMEH) 4*512kB (MEH) 0*1024kB 0*2048kB 0*4096kB = 20216kB
<4>[ 3175.560268] 145 total pagecache pages
<4>[ 3175.563911] 0 pages in swap cache
<4>[ 3175.567225] Swap cache stats: add 0, delete 0, find 0/0
<4>[ 3175.572422] Free swap  = 0kB
<4>[ 3175.575283] Total swap = 0kB
<4>[ 3175.578159] 65536 pages RAM
<4>[ 3175.580936] 0 pages HighMem/MovableOnly
<4>[ 3175.584747] 2253 pages reserved
<6>[ 3175.587886] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
<6>[ 3175.596408] [ 2300]     0  2300      271        7       3       0        0             0 dropbear
<6>[ 3175.605246] [ 4998]     0  4998      944        0       4       0        0             0 gltertf
<6>[ 3175.614023] [17380]     0 17380      406        0       3       0        0             0 netifd
<6>[ 3175.622705] [17463]     0 17463      667        0       4       0        0             0 dnsmasq
<3>[ 3175.631472] Out of memory: Kill process 2300 (dropbear) score 0 or sacrifice child
<3>[ 3175.639060] Killed process 2300 (dropbear) total-vm:1084kB, anon-rss:28kB, file-rss:0kB, shmem-rss:0kB
<4>[ 3175.685915] procd invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null),  order=1, oom_score_adj=0
<4>[ 3175.697734] CPU: 1 PID: 1 Comm: procd Not tainted 4.14.221 #0
<4>[ 3175.703451] Stack : 00000000 80604668 00000040 8007345c 80600000 8059f784 00000000 00000000
<4>[ 3175.711787]         8056912c 8fc2dc74 8fc3837c 805dc9c7 80563ec0 00000001 8fc2dc18 ac07f5c4
<4>[ 3175.720126]         00000000 00000000 80740000 000118d8 00000000 0000111b 00000007 00000000
<4>[ 3175.728463]         00000000 805e0000 000aa586 00000000 80000000 80600000 00000000 805dcac0
<4>[ 3175.736801]         00000001 00200000 ffffffff 80604668 00000000 802c34c0 00000004 80740004
<4>[ 3175.745134]         ...
<4>[ 3175.747572] Call Trace:
<4>[ 3175.750035] [<8000c7b0>] show_stack+0x58/0x100
<4>[ 3175.754474] [<8049ced4>] dump_stack+0xa4/0xe0
<4>[ 3175.758825] [<800d8690>] dump_header.isra.25+0x90/0x1e0
<4>[ 3175.764027] [<800d84e8>] out_of_memory+0x380/0x430
<4>[ 3175.768808] [<800dd100>] __alloc_pages_nodemask+0x994/0xd0c
<4>[ 3175.774364] [<8002d2f8>] copy_process.part.87+0xe8/0x160c
<4>[ 3175.779742] [<8002e9d0>] _do_fork+0x100/0x380
<4>[ 3175.784079] [<8002ecb0>] sys_fork+0x24/0x30
<4>[ 3175.788263] [<80016578>] syscall_common+0x34/0x58
<4>[ 3175.793016] Mem-Info:
<4>[ 3175.795294] active_anon:164 inactive_anon:23 isolated_anon:0
<4>[ 3175.795294]  active_file:0 inactive_file:19 isolated_file:0
<4>[ 3175.795294]  unevictable:0 dirty:0 writeback:0 unstable:0
<4>[ 3175.795294]  slab_reclaimable:2340 slab_unreclaimable:18670
<4>[ 3175.795294]  mapped:1 shmem:125 pagetables:21 bounce:0
<4>[ 3175.795294]  free:5060 free_pcp:302 free_cma:0
<4>[ 3175.826911] Node 0 active_anon:656kB inactive_anon:92kB active_file:0kB inactive_file:76kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:4kB dirty:0kB writeback:0kB shmem:500kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
<4>[ 3175.848570] Normal free:20240kB min:16384kB low:20480kB high:24576kB active_anon:656kB inactive_anon:92kB active_file:0kB inactive_file:76kB unevictable:0kB writepending:0kB present:262144kB managed:253132kB mlocked:0kB kernel_stack:103600kB pagetables:84kB bounce:0kB free_pcp:1208kB local_pcp:336kB free_cma:0kB
<4>[ 3175.876084] lowmem_reserve[]: 0 0 0
<4>[ 3175.879570] Normal: 438*4kB (UMEH) 116*8kB (MH) 82*16kB (MH) 56*32kB (UMEH) 62*64kB (UMEH) 24*128kB (UMEH) 21*256kB (UMEH) 4*512kB (MEH) 0*1024kB 0*2048kB 0*4096kB = 20248kB
<4>[ 3175.895046] 145 total pagecache pages
<4>[ 3175.898703] 0 pages in swap cache
<4>[ 3175.902000] Swap cache stats: add 0, delete 0, find 0/0
<4>[ 3175.907213] Free swap  = 0kB
<4>[ 3175.910076] Total swap = 0kB
<4>[ 3175.912943] 65536 pages RAM
<4>[ 3175.915734] 0 pages HighMem/MovableOnly
<4>[ 3175.919548] 2253 pages reserved
<6>[ 3175.922669] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
<6>[ 3175.931197] [ 4998]     0  4998      944        0       4       0        0             0 gltertf
<6>[ 3175.939969] [17380]     0 17380      406        0       3       0        0             0 netifd
<6>[ 3175.948653] [17463]     0 17463      667        0       4       0        0             0 dnsmasq
<0>[ 3175.957421] Kernel panic - not syncing: Out of memory and no killable processes...

There’s also some garbage following that.

tlater · October 13, 2021, 7:10pm

And I’ve reproduced it again:

I’m suspicious of gltertf, should I try to switch to vanilla openwrt?

\0\0\0\0]\0]<4>[ 3175.210139] 145 total pagecache pages
<4>[ 3175.213783] 0 pages in swap cache
<4>[ 3175.217092] Swap cache stats: add 0, delete 0, find 0/0
<4>[ 3175.222289] Free swap  = 0kB
<4>[ 3175.225150] Total swap = 0kB
<4>[ 3175.228030] 65536 pages RAM
<4>[ 3175.230807] 0 pages HighMem/MovableOnly
<4>[ 3175.234618] 2253 pages reserved
<6>[ 3175.237753] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
<6>[ 3175.246283] [  689]     0   689      258        8       3       0        0             0 urngd
<6>[ 3175.254858] [ 2300]     0  2300      271        7       3       0        0             0 dropbear
<6>[ 3175.263706] [ 4998]     0  4998      944        0       4       0        0             0 gltertf
<6>[ 3175.272483] [17380]     0 17380      406        0       3       0        0             0 netifd
<6>[ 3175.281163] [17463]     0 17463      667        0       4       0        0             0 dnsmasq
<3>[ 3175.289931] Out of memory: Kill process 689 (urngd) score 0 or sacrifice child
<3>[ 3175.297164] Killed process 689 (urngd) total-vm:1032kB, anon-rss:32kB, file-rss:0kB, shmem-rss:0kB
<4>[ 3175.345927] procd invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null),  order=1, oom_score_adj=0
<4>[ 3175.357748] CPU: 1 PID: 1 Comm: procd Not tainted 4.14.221 #0
<4>[ 3175.363465] Stack : 00000000 0000000a 00000040 8007345c 80600000 8059f784 00000000 00000000
<4>[ 3175.371799]         8056912c 8fc2dc24 8fc3837c 805dc9c7 80563ec0 00000001 8fc2dbc8 ac07f5c4
<4>[ 3175.380137]         00000000 00000000 80740000 00010b20 00000000 000010f3 00000007 00000000
<4>[ 3175.388472]         00000000 805e0000 00057574 00000000 80000000 80600000 00000000 8056e910
<4>[ 3175.396810]         00000000 00200000 ffffffff 0000000a 00000000 802c34c0 00000004 80740004
<4>[ 3175.405146]         ...
<4>[ 3175.407589] Call Trace:
<4>[ 3175.410053] [<8000c7b0>] show_stack+0x58/0x100
<4>[ 3175.414493] [<8049ced4>] dump_stack+0xa4/0xe0
<4>[ 3175.418844] [<800d8690>] dump_header.isra.25+0x90/0x1e0
<4>[ 3175.424046] [<800d78a4>] oom_kill_process+0x10c/0x4c4
<4>[ 3175.429078] [<800d8528>] out_of_memory+0x3c0/0x430
<4>[ 3175.433856] [<800dd100>] __alloc_pages_nodemask+0x994/0xd0c
<4>[ 3175.439415] [<8002d2f8>] copy_process.part.87+0xe8/0x160c
<4>[ 3175.444790] [<8002e9d0>] _do_fork+0x100/0x380
<4>[ 3175.449131] [<8002ecb0>] sys_fork+0x24/0x30
<4>[ 3175.453312] [<80016578>] syscall_common+0x34/0x58
<4>[ 3175.458068] Mem-Info:
<4>[ 3175.460347] active_anon:164 inactive_anon:23 isolated_anon:0
<4>[ 3175.460347]  active_file:14 inactive_file:3 isolated_file:0
<4>[ 3175.460347]  unevictable:0 dirty:0 writeback:0 unstable:0
<4>[ 3175.460347]  slab_reclaimable:2340 slab_unreclaimable:18670
<4>[ 3175.460347]  mapped:1 shmem:125 pagetables:21 bounce:0
<4>[ 3175.460347]  free:5060 free_pcp:290 free_cma:0
<4>[ 3175.491958] Node 0 active_anon:656kB inactive_anon:92kB active_file:56kB inactive_file:12kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:4kB dirty:0kB writeback:0kB shmem:500kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
<4>[ 3175.513707] Normal free:20240kB min:16384kB low:20480kB high:24576kB active_anon:656kB inactive_anon:92kB active_file:56kB inactive_file:12kB unevictable:0kB writepending:0kB present:262144kB managed:253132kB mlocked:0kB kernel_stack:103600kB pagetables:84kB bounce:0kB free_pcp:1160kB local_pcp:336kB free_cma:0kB
<4>[ 3175.541307] lowmem_reserve[]: 0 0 0
<4>[ 3175.544791] Normal: 438*4kB (UMEH) 116*8kB (MH) 82*16kB (MH) 55*32kB (UMEH) 62*64kB (UMEH) 24*128kB (UMEH) 21*256kB (UMEH) 4*512kB (MEH) 0*1024kB 0*2048kB 0*4096kB = 20216kB
<4>[ 3175.560268] 145 total pagecache pages
<4>[ 3175.563911] 0 pages in swap cache
<4>[ 3175.567225] Swap cache stats: add 0, delete 0, find 0/0
<4>[ 3175.572422] Free swap  = 0kB
<4>[ 3175.575283] Total swap = 0kB
<4>[ 3175.578159] 65536 pages RAM
<4>[ 3175.580936] 0 pages HighMem/MovableOnly
<4>[ 3175.584747] 2253 pages reserved
<6>[ 3175.587886] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
<6>[ 3175.596408] [ 2300]     0  2300      271        7       3       0        0             0 dropbear
<6>[ 3175.605246] [ 4998]     0  4998      944        0       4       0        0             0 gltertf
<6>[ 3175.614023] [17380]     0 17380      406        0       3       0        0             0 netifd
<6>[ 3175.622705] [17463]     0 17463      667        0       4       0        0             0 dnsmasq
<3>[ 3175.631472] Out of memory: Kill process 2300 (dropbear) score 0 or sacrifice child
<3>[ 3175.639060] Killed process 2300 (dropbear) total-vm:1084kB, anon-rss:28kB, file-rss:0kB, shmem-rss:0kB
<4>[ 3175.685915] procd invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null),  order=1, oom_score_adj=0
<4>[ 3175.697734] CPU: 1 PID: 1 Comm: procd Not tainted 4.14.221 #0
<4>[ 3175.703451] Stack : 00000000 80604668 00000040 8007345c 80600000 8059f784 00000000 00000000
<4>[ 3175.711787]         8056912c 8fc2dc74 8fc3837c 805dc9c7 80563ec0 00000001 8fc2dc18 ac07f5c4
<4>[ 3175.720126]         00000000 00000000 80740000 000118d8 00000000 0000111b 00000007 00000000
<4>[ 3175.728463]         00000000 805e0000 000aa586 00000000 80000000 80600000 00000000 805dcac0
<4>[ 3175.736801]         00000001 00200000 ffffffff 80604668 00000000 802c34c0 00000004 80740004
<4>[ 3175.745134]         ...
<4>[ 3175.747572] Call Trace:
<4>[ 3175.750035] [<8000c7b0>] show_stack+0x58/0x100
<4>[ 3175.754474] [<8049ced4>] dump_stack+0xa4/0xe0
<4>[ 3175.758825] [<800d8690>] dump_header.isra.25+0x90/0x1e0
<4>[ 3175.764027] [<800d84e8>] out_of_memory+0x380/0x430
<4>[ 3175.768808] [<800dd100>] __alloc_pages_nodemask+0x994/0xd0c
<4>[ 3175.774364] [<8002d2f8>] copy_process.part.87+0xe8/0x160c
<4>[ 3175.779742] [<8002e9d0>] _do_fork+0x100/0x380
<4>[ 3175.784079] [<8002ecb0>] sys_fork+0x24/0x30
<4>[ 3175.788263] [<80016578>] syscall_common+0x34/0x58
<4>[ 3175.793016] Mem-Info:
<4>[ 3175.795294] active_anon:164 inactive_anon:23 isolated_anon:0
<4>[ 3175.795294]  active_file:0 inactive_file:19 isolated_file:0
<4>[ 3175.795294]  unevictable:0 dirty:0 writeback:0 unstable:0
<4>[ 3175.795294]  slab_reclaimable:2340 slab_unreclaimable:18670
<4>[ 3175.795294]  mapped:1 shmem:125 pagetables:21 bounce:0
<4>[ 3175.795294]  free:5060 free_pcp:302 free_cma:0
<4>[ 3175.826911] Node 0 active_anon:656kB inactive_anon:92kB active_file:0kB inactive_file:76kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:4kB dirty:0kB writeback:0kB shmem:500kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
<4>[ 3175.848570] Normal free:20240kB min:16384kB low:20480kB high:24576kB active_anon:656kB inactive_anon:92kB active_file:0kB inactive_file:76kB unevictable:0kB writepending:0kB present:262144kB managed:253132kB mlocked:0kB kernel_stack:103600kB pagetables:84kB bounce:0kB free_pcp:1208kB local_pcp:336kB free_cma:0kB
<4>[ 3175.876084] lowmem_reserve[]: 0 0 0
<4>[ 3175.879570] Normal: 438*4kB (UMEH) 116*8kB (MH) 82*16kB (MH) 56*32kB (UMEH) 62*64kB (UMEH) 24*128kB (UMEH) 21*256kB (UMEH) 4*512kB (MEH) 0*1024kB 0*2048kB 0*4096kB = 20248kB
<4>[ 3175.895046] 145 total pagecache pages
<4>[ 3175.898703] 0 pages in swap cache
<4>[ 3175.902000] Swap cache stats: add 0, delete 0, find 0/0
<4>[ 3175.907213] Free swap  = 0kB
<4>[ 3175.910076] Total swap = 0kB
<4>[ 3175.912943] 65536 pages RAM
<4>[ 3175.915734] 0 pages HighMem/MovableOnly
<4>[ 3175.919548] 2253 pages reserved
<6>[ 3175.922669] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
<6>[ 3175.931197] [ 4998]     0  4998      944        0       4       0        0             0 gltertf
<6>[ 3175.939969] [17380]     0 17380      406        0       3       0        0             0 netifd
<6>[ 3175.948653] [17463]     0 17463      667        0       4       0        0             0 dnsmasq
<0>[ 3175.957421] Kernel panic - not syncing: Out of memory and no killable processes...
<0>[ 3175.957421] 
\0\0\0\0]\0]<4>[572039.541883] AP SETKEYS DONE - AKMMap=WPA2PSK, PairwiseCipher=AES, GroupCipher=AES, wcid=2 from 98:41:5C:1C:90:31
<4>[572039.541883] 
<4>[572051.265576] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[572052.365915] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[572052.488326] 192, flush one!
<4>[572057.865282] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[572060.064987] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[572062.265212] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[572065.564741] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[572078.764195] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[572083.163961] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[572084.263964] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[572086.463909] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[572091.963508] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[572094.163353] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[573163.312615] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[573164.412548] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[573926.785273] ASSOC - 1 receive DIS-ASSOC request
<4>[573926.794105] WextMboSendStaDisassocToDaemonEvent [98:41:5c:1c:90:31] sizeof 6 					report_buf_len 6 buflen 180 msg_type MBO_MSG_REMOVE_STA
<4>[576751.344101] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[576752.444011] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[580351.475459] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[580352.575181] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[580454.260074] c3c, flush one!
<4>[580551.665971] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[580552.765932] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[580557.165558] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[580558.265491] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[581175.336431] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[581177.536357] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<1>[583503.920577] BUG: Bad rss-counter state mm:8ac470e0 idx:0 val:-1
<1>[583503.926816] BUG: Bad rss-counter state mm:8ac470e0 idx:1 val:1
<1>[583503.967217] BUG: Bad rss-counter state mm:8bee52c0 idx:0 val:-2
<1>[583503.973241] BUG: Bad rss-counter state mm:8bee52c0 idx:1 val:2
<1>[583504.655328] CPU 3 Unable to handle kernel paging request at virtual address 00000104, epc == 800dbc54, ra == 800dc88c
<4>[583504.666032] Oops[#1]:
<4>[583504.668408] CPU: 3 PID: 30398 Comm: sh Not tainted 4.14.221 #0
<4>[583504.674306] task: 8d196c60 task.stack: 8d3ba000
<4>[583504.678909] $ 0   : 00000000 00000001 81138d80 00000200
<4>[583504.684224] $ 4   : 00000100 00000000 00001400 00000000
<4>[583504.689523] $ 8   : 00100077 1000001e 801240e0 8ae97638
<4>[583504.694820] $12   : 7fe3aff8 00000000 00000000 77ffb2a0
<4>[583504.700122] $16   : 812431e0 812431f4 812431f0 00000000
<4>[583504.705423] $20   : 80604660 8d3bbd08 00000000 00000001
<4>[583504.710722] $24   : 0045dbfc 77f589b0                  
<4>[583504.716020] $28   : 8d3ba000 8d3bbc30 80603fa0 800dc88c
<4>[583504.721319] Hi    : 00000001
<4>[583504.724269] Lo    : 00000043
<4>[583504.727257] epc   : 800dbc54 get_page_from_freelist+0x348/0x8e4
<4>[583504.733236] ra    : 800dc88c __alloc_pages_nodemask+0x120/0xd0c
<4>[583504.739212] Status: 11007c02	KERNEL EXL 
<4>[583504.743209] Cause : 4080000c (ExcCode 03)
<4>[583504.747281] BadVA : 00000104
<4>[583504.750235] PrId  : 0001992f (MIPS 1004Kc)
<4>[583504.754394] Modules linked in: rt2800usb rt2800lib pppoe ppp_async option usb_wwan sierra_net sierra rt2x00usb rt2x00lib rndis_host qmi_wwan pppox ppp_mppe ppp_generic nf_nat_pptp nf_flow_table_ipv6 nf_flow_table_ipv4 nf_flow_table_inet nf_conntrack_pptp mac80211 iptable_nat ipt_REJECT ipt_MASQUERADE huawei_cdc_ncm ebtable_nat ebtable_filter ebtable_broute cp210x cfg80211 cdc_ncm cdc_ether xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_recent xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_helper xt_hashlimit xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_TCPMSS xt_REDIRECT xt_LOG xt_IPMARK xt_HL xt_FLOWOFFLOAD xt_DSCP xt_CT xt_CLASSIFY wireguard usbserial usbnet ts_fsm ts_bm slhc nft_set_rbtree nft_set_hash nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet
<4>[583504.825941]  nft_reject nft_redir_ipv4 nft_redir nft_quota nft_numgen nft_nat nft_meta nft_masq_ipv4 nft_masq nft_log nft_limit nft_flow_offload nft_exthdr nft_ct nft_counter nft_chain_route_ipv6 nft_chain_route_ipv4 nft_chain_nat_ipv4 nf_tables_ipv6 nf_tables_ipv4 nf_tables_inet nf_tables nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_redirect nf_nat_proto_gre nf_nat_masquerade_ipv4 nf_nat_irc nf_conntrack_ipv4 nf_nat_ipv4 nf_nat_h323 nf_nat_ftp nf_nat_amanda nf_log_ipv4 nf_flow_table_hw nf_flow_table nf_defrag_ipv4 nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_rtcache nf_conntrack_proto_gre nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp nf_conntrack_broadcast ts_kmp nf_conntrack_amanda iptable_raw iptable_mangle iptable_filter ipt_ECN
<4>[583504.896490]  ipheth ip_tables ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables compat cdc_wdm cdc_acm xt_u32 mt_wifi fuse sch_teql sch_sfq sch_red sch_prio sch_pie sch_multiq sch_gred sch_fq sch_dsmark sch_codel sch_cbq em_text em_nbyte em_meta em_cmp act_simple act_police act_pedit act_ipt act_gact act_csum libcrc32c act_connmark sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred i2c_gpio i2c_algo_bit i2c_dev ledtrig_usbport xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark
<4>[583504.967257]  ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6t_NPT ip6t_MASQUERADE nf_nat_masquerade_ipv6 nf_nat nf_conntrack nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 ip6_udp_tunnel udp_tunnel tun vfat fat ntfs nls_utf8 nls_iso8859_1 nls_cp437 sha1_generic ecb mtdoops mmc_block usb_storage sdhci_pltfm sdhci mtk_sd mmc_core leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd uhci_hcd ohci_platform ohci_hcd ahci libahci libata ehci_platform sd_mod scsi_mod ehci_hcd gpio_button_hotplug ext4 mbcache jbd2 exfat usbcore nls_base usb_common mii crc32c_generic
<4>[583505.030419] Process sh (pid: 30398, threadinfo=8d3ba000, task=8d196c60, tls=77ffcefc)
<4>[583505.038301] Stack : 00000000 00000000 00000000 00000000 00000000 00000000 00000001 00000000
<4>[583505.046725]         00000000 00000001 00000002 00000001 805da1f4 00000000 00000000 00000000
<4>[583505.055143]         00000000 00000000 805e0000 8056eb04 8d3bbe08 014200ca 00000000 00000000
<4>[583505.063561]         8fe33c20 8fe33c20 00000001 8fe33c5c 00000002 800dc88c 014200ca 00000000
<4>[583505.071985]         00000001 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[583505.080406]         ...
<4>[583505.082938] Call Trace:
<4>[583505.085486] [<800dbc54>] get_page_from_freelist+0x348/0x8e4
<4>[583505.091132] [<800dc88c>] __alloc_pages_nodemask+0x120/0xd0c
<4>[583505.096793] [<80100ce8>] wp_page_copy+0x114/0x858
<4>[583505.101567] [<80104634>] do_wp_page+0x77c/0x7a8
<4>[583505.106174] [<80105a4c>] handle_mm_fault+0xa30/0xb0c
<4>[583505.111234] [<800199d0>] __do_page_fault+0x120/0x478
<4>[583505.116277] [<8001f748>] tlb_do_page_fault_1+0x118/0x120
<4>[583505.121660] Code: 2442ffec  8c430018  8c440014 <ac830004> ac640000  24030100  ac430014  24030200  ac430018 
<4>[583505.131476] 
<4>[583505.133446] ---[ end trace 7f047baa14b43250 ]---
<0>[583505.151622] Kernel panic - not syncing: Fatal exception
46] ---[ end trace 7f047baa14b43250 ]---
\0\0\0\0]\0]<4>[816418.342506] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[816489.839395] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[816490.939111] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[816882.519833] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[816883.619751] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[816899.019608] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[816900.118818] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[817137.363456] WextMboSendStaDisassocToDaemonEvent [d0:ab:d5:97:1c:d8] sizeof 6 					report_buf_len 6 buflen 180 msg_type MBO_MSG_REMOVE_STA
<4>[817758.076790] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[817759.176891] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[820126.260552] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[820127.360498] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[822945.422541] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[822947.622067] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[823085.115364] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[823088.415239] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[823120.313794] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[823121.413528] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[823726.385424] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[823727.484155] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[825752.485598] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[825753.585572] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[826733.637781] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[826739.137495] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[827112.019345] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[827119.718911] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[827214.314457] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[827215.415279] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[827394.705571] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[827395.805511] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[827445.303184] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[827446.403084] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[827447.503024] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[827456.302610] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<4>[830354.661622] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(1)
<4>[830361.261504] :MtCmdPktBudgetCtrl: bssid(255),wcid(65535),type(0)
<1>[831735.133275] CPU 2 Unable to handle kernel paging request at virtual address 04f4c6d8, epc == 8d1e08d4, ra == 8d1e0c34
<4>[831735.144058] Oops[#1]:
<4>[831735.146432] CPU: 2 PID: 6898 Comm: kworker/2:1 Tainted: G        W       4.14.221 #0
<4>[831735.154313] Workqueue: events_power_efficient flow_offload_lookup [nf_flow_table]
<4>[831735.161859] task: 8ff54c80 task.stack: 8bf5c000
<4>[831735.166452] $ 0   : 00000000 00000001 fffffff5 00000000
<4>[831735.171751] $ 4   : 8bf5de10 0000000f 00000000 ffff00fe
<4>[831735.177048] $ 8   : 8bf5dfe0 00007c00 0002f475 00000040
<4>[831735.182346] $12   : 00000001 00000000 fffffffe 00000114
<4>[831735.187644] $16   : 8d16cc00 04f4c6aa 81231a20 81234c00
<4>[831735.192944] $20   : 8d16cb98 00000000 805e0000 805fd200
<4>[831735.198251] $24   : 00000000 ffff0000                  
<4>[831735.203550] $28   : 8bf5c000 8bf5ddf8 8d1e0000 8d1e0c34
<4>[831735.208848] Hi    : 0000001e
<4>[831735.211795] Lo    : 00000038
<4>[831735.214769] epc   : 8d1e08d4 flow_offload_lookup+0x1a4/0x5b8 [nf_flow_table]
<4>[831735.221878] ra    : 8d1e0c34 flow_offload_lookup+0x504/0x5b8 [nf_flow_table]
<4>[831735.228975] Status: 11007c03	KERNEL EXL IE 
<4>[831735.233237] Cause : 40800008 (ExcCode 02)
<4>[831735.237310] BadVA : 04f4c6d8
<4>[831735.240259] PrId  : 0001992f (MIPS 1004Kc)
<4>[831735.244419] Modules linked in: rt2800usb rt2800lib pppoe ppp_async option usb_wwan sierra_net sierra rt2x00usb rt2x00lib rndis_host qmi_wwan pppox ppp_mppe ppp_generic nf_nat_pptp nf_flow_table_ipv6 nf_flow_table_ipv4 nf_flow_table_inet nf_conntrack_pptp mac80211 iptable_nat ipt_REJECT ipt_MASQUERADE huawei_cdc_ncm ebtable_nat ebtable_filter ebtable_broute cp210x cfg80211 cdc_ncm cdc_ether xt_time xt_tcpudp xt_tcpmss xt_statistic xt_state xt_recent xt_nat xt_multiport xt_mark xt_mac xt_limit xt_length xt_hl xt_helper xt_hashlimit xt_ecn xt_dscp xt_conntrack xt_connmark xt_connlimit xt_connbytes xt_comment xt_TCPMSS xt_REDIRECT xt_LOG xt_IPMARK xt_HL xt_FLOWOFFLOAD xt_DSCP xt_CT xt_CLASSIFY wireguard usbserial usbnet ts_fsm ts_bm slhc nft_set_rbtree nft_set_hash nft_reject_ipv6 nft_reject_ipv4 nft_reject_inet
<4>[831735.315960]  nft_reject nft_redir_ipv4 nft_redir nft_quota nft_numgen nft_nat nft_meta nft_masq_ipv4 nft_masq nft_log nft_limit nft_flow_offload nft_exthdr nft_ct nft_counter nft_chain_route_ipv6 nft_chain_route_ipv4 nft_chain_nat_ipv4 nf_tables_ipv6 nf_tables_ipv4 nf_tables_inet nf_tables nf_reject_ipv4 nf_nat_tftp nf_nat_snmp_basic nf_nat_sip nf_nat_redirect nf_nat_proto_gre nf_nat_masquerade_ipv4 nf_nat_irc nf_conntrack_ipv4 nf_nat_ipv4 nf_nat_h323 nf_nat_ftp nf_nat_amanda nf_log_ipv4 nf_flow_table_hw nf_flow_table nf_defrag_ipv4 nf_conntrack_tftp nf_conntrack_snmp nf_conntrack_sip nf_conntrack_rtcache nf_conntrack_proto_gre nf_conntrack_netlink nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp nf_conntrack_broadcast ts_kmp nf_conntrack_amanda iptable_raw iptable_mangle iptable_filter ipt_ECN
<4>[831735.386492]  ipheth ip_tables ebtables ebt_vlan ebt_stp ebt_redirect ebt_pkttype ebt_mark_m ebt_mark ebt_limit ebt_among ebt_802_3 crc_ccitt compat_xtables compat cdc_wdm cdc_acm xt_u32 mt_wifi fuse sch_teql sch_sfq sch_red sch_prio sch_pie sch_multiq sch_gred sch_fq sch_dsmark sch_codel sch_cbq em_text em_nbyte em_meta em_cmp act_simple act_police act_pedit act_ipt act_gact act_csum libcrc32c act_connmark sch_tbf sch_ingress sch_htb sch_hfsc em_u32 cls_u32 cls_tcindex cls_route cls_matchall cls_fw cls_flow cls_basic act_skbedit act_mirred i2c_gpio i2c_algo_bit i2c_dev ledtrig_usbport xt_set ip_set_list_set ip_set_hash_netportnet ip_set_hash_netport ip_set_hash_netnet ip_set_hash_netiface ip_set_hash_net ip_set_hash_mac ip_set_hash_ipportnet ip_set_hash_ipportip ip_set_hash_ipport ip_set_hash_ipmark
<4>[831735.457256]  ip_set_hash_ip ip_set_bitmap_port ip_set_bitmap_ipmac ip_set_bitmap_ip ip_set nfnetlink ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6t_NPT ip6t_MASQUERADE nf_nat_masquerade_ipv6 nf_nat nf_conntrack nf_log_ipv6 nf_log_common ip6table_mangle ip6table_filter ip6_tables ip6t_REJECT x_tables nf_reject_ipv6 ip6_udp_tunnel udp_tunnel tun vfat fat ntfs nls_utf8 nls_iso8859_1 nls_cp437 sha1_generic ecb mtdoops mmc_block usb_storage sdhci_pltfm sdhci mtk_sd mmc_core leds_gpio xhci_plat_hcd xhci_pci xhci_mtk xhci_hcd uhci_hcd ohci_platform ohci_hcd ahci libahci libata ehci_platform sd_mod scsi_mod ehci_hcd gpio_button_hotplug ext4 mbcache jbd2 exfat usbcore nls_base usb_common mii crc32c_generic
<4>[831735.520401] Process kworker/2:1 (pid: 6898, threadinfo=8bf5c000, task=8ff54c80, tls=00000000)
<4>[831735.528969] Stack : 8063bda0 805da1f4 81231da0 00000000 81231da0 805e0000 8d16cba0 04f4c6aa
<4>[831735.537394]         0000001d 00000100 00000200 8c203500 0000000f 00000001 8d16cc00 8e17b380
<4>[831735.545818]         81231a20 81234c00 00000000 00000000 00000080 fffffffe 805e0000 8d1e0cc4
<4>[831735.554241]         8e17b380 81231a20 81234c00 8d16cb60 8d16cc00 80047460 81231bc0 81231a38
<4>[831735.562663]         805e0000 81231bc0 805e0000 fffffffe 8e17b380 81231a20 8e17b398 81231a38
<4>[831735.571082]         ...
<4>[831735.573638] Call Trace:
<4>[831735.576175] [<8d1e08d4>] flow_offload_lookup+0x1a4/0x5b8 [nf_flow_table]
<4>[831735.582952] Code: 00000000  100000d7  00000000 <9222002e> 144000d4  00000000  8e220078  3043000c  146000dd 
<4>[831735.592767] 
<4>[831735.594532] ---[ end trace f72196644c8fef20 ]---
<0>[831735.612829] Kernel panic - not syncing: Fatal exception
20 ]---

alzhao · October 14, 2021, 3:03am

Can you try the 1012 firmware which has newer version of wifi driver
https://dl.gl-inet.com/firmware/mt1300/testing/

tlater · October 14, 2021, 6:19pm

Thanks! Let’s see how it goes - evidently it can take quite a while to reproduce, fingers crossed

elorimer · October 16, 2021, 12:05pm

Having a go with this as well. One thing I thought was a stability problem–“random” reboots–turns out to be something unrelated to the router. I just want to drop a note here about it.

A great thing about the Beryl as a travel router is the move to a USB-C power input. Most of our devices (phones, laptops, tablets) are now USB-C, and most of them are now 18-35 watt capable. When we travel, we set up a charging station with one or more USB-C multiport power bricks with devices being plugged in as necessary.

The new GaN power bricks are great and we are seeing small GaN II bricks with 100w total power and circuits that manage the output on each port within the overall limits. Perfect for travel and the idea of a charging station. But it turns out that when you plug in a device and the brick adjusts to manage the output, it interrupts the power on the ports. If one of the ports is powering the router, it will reboot.

It is still convenient to carry one brick smaller than a Mango in my travel kit to power all our devices, but I would not have realized why the Beryl was rebooting if I had not had the white light directly in front of me when I plugged in the Macbook.

tlater · November 11, 2021, 11:47am

This is looking good so far

To ease my own mind, I’ve decided to keep an eye on gltertf. Currently its memory usage is pretty high - much higher than in the crash logs:

Mem: 161432K used, 91700K free, 840K shrd, 10264K buff, 31728K cached
CPU:   0% usr   2% sys   0% nic  97% idle   0% io   0% irq   0% sirq
Load average: 0.78 0.72 0.52 1/90 20089
  PID  PPID USER     STAT   VSZ %VSZ %CPU COMMAND
20089 16276 root     R     1240   0%   2% top -n 1
 5316     1 root     S    64004  25%   0% /usr/bin/gltertf
 5370     1 root     S     5696   2%   0% /usr/sbin/lighttpd -f /etc/lighttpd/li
28564     1 stubby   S     4940   2%   0% /usr/sbin/stubby
 4293     1 root     S     4020   2%   0% /usr/sbin/usbmuxd --systemd
 5372  5370 root     S     3284   1%   0% /www/api
28723     1 dnsmasq  S     2756   1%   0% /usr/sbin/dnsmasq -C /var/etc/dnsmasq.
 4513     1 root     S     2732   1%   0% /usr/bin/gl_ble_ubus
 3192     1 root     S     2664   1%   0% /usr/bin/gl_crond
 1875     1 root     S     1752   1%   0% /sbin/netifd
 5060     1 root     S     1656   1%   0% /bin/sh /usr/bin/gl_monitor
    1     0 root     S     1580   1%   0% /sbin/procd
 3157     1 root     S     1460   1%   0% /usr/sbin/odhcpd
 2646     1 root     S     1424   1%   0% /bin/sh /usr/sbin/mwan3rtmon
12366     1 root     S     1340   1%   0% /bin/sh /usr/sbin/mwan3track wan eth0.
 1744     1 root     S     1252   0%   0% /sbin/logd -S 64
 4651     1 root     S     1240   0%   0% /bin/sh /usr/bin/gl_mt1300_led_daemon
16276 16040 root     S     1240   0%   0% -ash
 4788     1 root     S<    1236   0%   0% /usr/sbin/ntpd -n -N -S /usr/sbin/ntpd
18149  1875 root     S     1232   0%   0% udhcpc -p /var/run/udhcpc-eth0.2.pid -

But I suppose that may ultimately turn out to be inconsequential to this issue. As far as I can read, high memory usage is expected for that utility.

alzhao · November 11, 2021, 12:00pm

gltertf will be optimized. This program is not well writen.