alzhao
September 7, 2021, 7:24am
1
Hello Good People,
As there are many users report MT1300 has stability issues, or crashes and reboot itself, we compiled a firmware that can store log when the router crashes.
The firmware is here GL.iNet download center
Download the openwrt-mt1300-3.203-0826-oops-track.bin and flash to your router.
When the route crash and reboot, you can use the following command to get the log.
dd if=/dev/mtd7 of=/last.log
You can get the log using winscp, scp etc and post in this thread.
Until now, we are not so sure about the root reason of router reboot and need more people help us.
3 Likes
This firmware was stable for me for 10 days with WAN in repeater mode (I haven’t tried with cable). I had to unplug it when we returned home.
2 Likes
tlater
September 25, 2021, 12:26am
4
Oh, neat, I hadn’t noticed this thread. I have a separate one here where I’ve also already posted my logs. It looks like a memory leak of some kind - the symptoms are consistent with that too, since the crashes happen in regular intervals (~1 week), and become more frequent with additional plugins.
I use it in cable mode, having about 5 devices connected via ethernet as well as via wifi most of the time, but am otherwise using it as it came out of the box (see the other thread, I wanted to reproduce this).
Adding this here for ease of access
\0\0\0\0]\0]<4>[ 3175.210139] 145 total pagecache pages
<4>[ 3175.213783] 0 pages in swap cache
<4>[ 3175.217092] Swap cache stats: add 0, delete 0, find 0/0
<4>[ 3175.222289] Free swap = 0kB
<4>[ 3175.225150] Total swap = 0kB
<4>[ 3175.228030] 65536 pages RAM
<4>[ 3175.230807] 0 pages HighMem/MovableOnly
<4>[ 3175.234618] 2253 pages reserved
<6>[ 3175.237753] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
<6>[ 3175.246283] [ 689] 0 689 258 8 3 0 0 0 urngd
<6>[ 3175.254858] [ 2300] 0 2300 271 7 3 0 0 0 dropbear
<6>[ 3175.263706] [ 4998] 0 4998 944 0 4 0 0 0 gltertf
<6>[ 3175.272483] [17380] 0 17380 406 0 3 0 0 0 netifd
<6>[ 3175.281163] [17463] 0 17463 667 0 4 0 0 0 dnsmasq
<3>[ 3175.289931] Out of memory: Kill process 689 (urngd) score 0 or sacrifice child
<3>[ 3175.297164] Killed process 689 (urngd) total-vm:1032kB, anon-rss:32kB, file-rss:0kB, shmem-rss:0kB
<4>[ 3175.345927] procd invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null), order=1, oom_score_adj=0
<4>[ 3175.357748] CPU: 1 PID: 1 Comm: procd Not tainted 4.14.221 #0
<4>[ 3175.363465] Stack : 00000000 0000000a 00000040 8007345c 80600000 8059f784 00000000 00000000
<4>[ 3175.371799] 8056912c 8fc2dc24 8fc3837c 805dc9c7 80563ec0 00000001 8fc2dbc8 ac07f5c4
<4>[ 3175.380137] 00000000 00000000 80740000 00010b20 00000000 000010f3 00000007 00000000
<4>[ 3175.388472] 00000000 805e0000 00057574 00000000 80000000 80600000 00000000 8056e910
<4>[ 3175.396810] 00000000 00200000 ffffffff 0000000a 00000000 802c34c0 00000004 80740004
<4>[ 3175.405146] ...
<4>[ 3175.407589] Call Trace:
<4>[ 3175.410053] [<8000c7b0>] show_stack+0x58/0x100
<4>[ 3175.414493] [<8049ced4>] dump_stack+0xa4/0xe0
<4>[ 3175.418844] [<800d8690>] dump_header.isra.25+0x90/0x1e0
<4>[ 3175.424046] [<800d78a4>] oom_kill_process+0x10c/0x4c4
<4>[ 3175.429078] [<800d8528>] out_of_memory+0x3c0/0x430
<4>[ 3175.433856] [<800dd100>] __alloc_pages_nodemask+0x994/0xd0c
<4>[ 3175.439415] [<8002d2f8>] copy_process.part.87+0xe8/0x160c
<4>[ 3175.444790] [<8002e9d0>] _do_fork+0x100/0x380
<4>[ 3175.449131] [<8002ecb0>] sys_fork+0x24/0x30
<4>[ 3175.453312] [<80016578>] syscall_common+0x34/0x58
<4>[ 3175.458068] Mem-Info:
<4>[ 3175.460347] active_anon:164 inactive_anon:23 isolated_anon:0
<4>[ 3175.460347] active_file:14 inactive_file:3 isolated_file:0
<4>[ 3175.460347] unevictable:0 dirty:0 writeback:0 unstable:0
<4>[ 3175.460347] slab_reclaimable:2340 slab_unreclaimable:18670
<4>[ 3175.460347] mapped:1 shmem:125 pagetables:21 bounce:0
<4>[ 3175.460347] free:5060 free_pcp:290 free_cma:0
<4>[ 3175.491958] Node 0 active_anon:656kB inactive_anon:92kB active_file:56kB inactive_file:12kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:4kB dirty:0kB writeback:0kB shmem:500kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
<4>[ 3175.513707] Normal free:20240kB min:16384kB low:20480kB high:24576kB active_anon:656kB inactive_anon:92kB active_file:56kB inactive_file:12kB unevictable:0kB writepending:0kB present:262144kB managed:253132kB mlocked:0kB kernel_stack:103600kB pagetables:84kB bounce:0kB free_pcp:1160kB local_pcp:336kB free_cma:0kB
<4>[ 3175.541307] lowmem_reserve[]: 0 0 0
<4>[ 3175.544791] Normal: 438*4kB (UMEH) 116*8kB (MH) 82*16kB (MH) 55*32kB (UMEH) 62*64kB (UMEH) 24*128kB (UMEH) 21*256kB (UMEH) 4*512kB (MEH) 0*1024kB 0*2048kB 0*4096kB = 20216kB
<4>[ 3175.560268] 145 total pagecache pages
<4>[ 3175.563911] 0 pages in swap cache
<4>[ 3175.567225] Swap cache stats: add 0, delete 0, find 0/0
<4>[ 3175.572422] Free swap = 0kB
<4>[ 3175.575283] Total swap = 0kB
<4>[ 3175.578159] 65536 pages RAM
<4>[ 3175.580936] 0 pages HighMem/MovableOnly
<4>[ 3175.584747] 2253 pages reserved
<6>[ 3175.587886] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
<6>[ 3175.596408] [ 2300] 0 2300 271 7 3 0 0 0 dropbear
<6>[ 3175.605246] [ 4998] 0 4998 944 0 4 0 0 0 gltertf
<6>[ 3175.614023] [17380] 0 17380 406 0 3 0 0 0 netifd
<6>[ 3175.622705] [17463] 0 17463 667 0 4 0 0 0 dnsmasq
<3>[ 3175.631472] Out of memory: Kill process 2300 (dropbear) score 0 or sacrifice child
<3>[ 3175.639060] Killed process 2300 (dropbear) total-vm:1084kB, anon-rss:28kB, file-rss:0kB, shmem-rss:0kB
<4>[ 3175.685915] procd invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null), order=1, oom_score_adj=0
<4>[ 3175.697734] CPU: 1 PID: 1 Comm: procd Not tainted 4.14.221 #0
<4>[ 3175.703451] Stack : 00000000 80604668 00000040 8007345c 80600000 8059f784 00000000 00000000
<4>[ 3175.711787] 8056912c 8fc2dc74 8fc3837c 805dc9c7 80563ec0 00000001 8fc2dc18 ac07f5c4
<4>[ 3175.720126] 00000000 00000000 80740000 000118d8 00000000 0000111b 00000007 00000000
<4>[ 3175.728463] 00000000 805e0000 000aa586 00000000 80000000 80600000 00000000 805dcac0
<4>[ 3175.736801] 00000001 00200000 ffffffff 80604668 00000000 802c34c0 00000004 80740004
<4>[ 3175.745134] ...
<4>[ 3175.747572] Call Trace:
<4>[ 3175.750035] [<8000c7b0>] show_stack+0x58/0x100
<4>[ 3175.754474] [<8049ced4>] dump_stack+0xa4/0xe0
<4>[ 3175.758825] [<800d8690>] dump_header.isra.25+0x90/0x1e0
<4>[ 3175.764027] [<800d84e8>] out_of_memory+0x380/0x430
<4>[ 3175.768808] [<800dd100>] __alloc_pages_nodemask+0x994/0xd0c
<4>[ 3175.774364] [<8002d2f8>] copy_process.part.87+0xe8/0x160c
<4>[ 3175.779742] [<8002e9d0>] _do_fork+0x100/0x380
<4>[ 3175.784079] [<8002ecb0>] sys_fork+0x24/0x30
<4>[ 3175.788263] [<80016578>] syscall_common+0x34/0x58
<4>[ 3175.793016] Mem-Info:
<4>[ 3175.795294] active_anon:164 inactive_anon:23 isolated_anon:0
<4>[ 3175.795294] active_file:0 inactive_file:19 isolated_file:0
<4>[ 3175.795294] unevictable:0 dirty:0 writeback:0 unstable:0
<4>[ 3175.795294] slab_reclaimable:2340 slab_unreclaimable:18670
<4>[ 3175.795294] mapped:1 shmem:125 pagetables:21 bounce:0
<4>[ 3175.795294] free:5060 free_pcp:302 free_cma:0
<4>[ 3175.826911] Node 0 active_anon:656kB inactive_anon:92kB active_file:0kB inactive_file:76kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:4kB dirty:0kB writeback:0kB shmem:500kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
<4>[ 3175.848570] Normal free:20240kB min:16384kB low:20480kB high:24576kB active_anon:656kB inactive_anon:92kB active_file:0kB inactive_file:76kB unevictable:0kB writepending:0kB present:262144kB managed:253132kB mlocked:0kB kernel_stack:103600kB pagetables:84kB bounce:0kB free_pcp:1208kB local_pcp:336kB free_cma:0kB
<4>[ 3175.876084] lowmem_reserve[]: 0 0 0
<4>[ 3175.879570] Normal: 438*4kB (UMEH) 116*8kB (MH) 82*16kB (MH) 56*32kB (UMEH) 62*64kB (UMEH) 24*128kB (UMEH) 21*256kB (UMEH) 4*512kB (MEH) 0*1024kB 0*2048kB 0*4096kB = 20248kB
<4>[ 3175.895046] 145 total pagecache pages
<4>[ 3175.898703] 0 pages in swap cache
<4>[ 3175.902000] Swap cache stats: add 0, delete 0, find 0/0
<4>[ 3175.907213] Free swap = 0kB
<4>[ 3175.910076] Total swap = 0kB
<4>[ 3175.912943] 65536 pages RAM
<4>[ 3175.915734] 0 pages HighMem/MovableOnly
<4>[ 3175.919548] 2253 pages reserved
<6>[ 3175.922669] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
<6>[ 3175.931197] [ 4998] 0 4998 944 0 4 0 0 0 gltertf
<6>[ 3175.939969] [17380] 0 17380 406 0 3 0 0 0 netifd
<6>[ 3175.948653] [17463] 0 17463 667 0 4 0 0 0 dnsmasq
<0>[ 3175.957421] Kernel panic - not syncing: Out of memory and no killable processes...
exia
October 18, 2021, 9:11am
5
I tried to flash the vanilla openwrt stable version 21.02.0:
http://downloads.openwrt.org/releases/21.02.0/targets/ramips/mt7621/openwrt-21.02.0-ramips-mt7621-glinet_gl-mt1300-squashfs-sysupgrade.bin
Flash the vanilla firmware via u-boot.
Initial boot after firmware update works fine.
Click “Enable” N/AC radio in Luci. - The web UI shows radio turned on.
Reboot.
The device bricks. No LAN nor WiFi.
I found that as long as WiFi is disabled it can normally boot, but with WiFi enabled on vanilla openwrt, it bricks as soon as device is rebooted.
I managed to flash back to gl-inet firmware, but given the issue with vanilla openwrt, I suspect there might be a bug in the WiFi driver?
alzhao
October 18, 2021, 9:51am
6
Most likely is is kernel crashing.
exia
October 18, 2021, 8:17pm
7
Yeah, but since this is crashing during boot, unless I get serial console directly hooked to the board, there is no way to debug it.
alzhao
October 19, 2021, 12:35am
8
You can only flash the original firmware using uboot.
Or you can compile a firmware that can record log when kernel panic.
BTW, the recent firmware 1012 GL.iNet download center is coming with new wifi driver and should be fine.
1 Like
@alzhao Tried 1012 FW “openwrt-mt1300-3.203-1012.bin” and after factory reset 5GHz wifi band would not have security turned on even if it was turned on with “WPA/WPA2-PSK” which is the default. 5GHz would broadcast without security. Had to select “WPA2/WPA3-PSK/SAE” to have security on.
Hello, I had a test, but not found the problem you mentioned.
