GL-MT3000 : Extremely slow download after upgrading to firmware 4.6.2

Technical Support for Routers
1

Upgraded my GL-MT3000 (operating in normal router mode) to firmware 4.6.2 and immediately started experiencing severe performance issues.

Even navigating the web console (from computer connected via 2.4GHz WiFi) became extremely slow.

While trying to navigate the web console/interface to try to configure the router, encountered many instances of the error:

Operation timed out. Please check the network environment or reboot the device.

Rebooted many times to no avail.

Checked the system log and found many occurrences of kernel error messages such as:

Sat Jul 27 14:32:44 2024 kern.err kernel: [ 3849.574883] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sat Jul 27 14:32:44 2024 kern.err kernel: [ 3849.584289] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 3, free_token_cnt = 2246
Sat Jul 27 14:32:50 2024 kern.err kernel: [ 3855.806932] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sat Jul 27 14:32:50 2024 kern.err kernel: [ 3855.816330] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 1, free_token_cnt = 2303
Sat Jul 27 14:32:54 2024 kern.err kernel: [ 3859.304225] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sat Jul 27 14:32:54 2024 kern.err kernel: [ 3859.313629] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 1, free_token_cnt = 2183
Sat Jul 27 14:32:54 2024 kern.err kernel: [ 3859.367055] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sat Jul 27 14:32:54 2024 kern.err kernel: [ 3859.376446] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 123, free_token_cnt = 2182
Sat Jul 27 14:33:02 2024 kern.err kernel: [ 3867.251867] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sat Jul 27 14:33:02 2024 kern.err kernel: [ 3867.261262] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 120, free_token_cnt = 2185
Sat Jul 27 14:33:15 2024 kern.err kernel: [ 3880.583761] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sat Jul 27 14:33:15 2024 kern.err kernel: [ 3880.593165] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 1, free_token_cnt = 2303
Sat Jul 27 14:33:23 2024 kern.err kernel: [ 3888.331407] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sat Jul 27 14:33:23 2024 kern.err kernel: [ 3888.340803] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 586, free_token_cnt = 1719

Running checks using Speedtest-dot-net would give a maximum download performance of 0.26 Mbps. One time was only 0.05 Mbps. Yet upload was typically over 100x as fast: usually around 25 Mbps.

Made many reboots and configuration changes - no success.

Downloaded the older 4.5.16 from GL.iNet download center. Couldn't upload the tar file from the normal GL-MT3000 web interface - kept giving "failed to upload" error message. Was however able to go to the "Advanced Settings" and upload and apply the tar file from there.

Even after downgrading to 4.5.16, download performance max'd out at 0.17 Mbps.

Then used the Reset Firmware option and download performance was restored: ~75 Mbps (from laptop using WiFi).

Repeated the entire process (re-upgrading to firmware 4.6.2) and problem re-occurs. Extremely slow download speed and kernel errors in system log.

Solution again:

  1. Apply the 4.5.16 firmware
  2. Choose the Reset Firmware option
  3. Re-configure personal settings
2

Hi,

I have tried to reproduce this situation in my side, but no gain:
Downgrade 4.5.16 (without 'keep settings', aka refresh installs) -> upgrade 4.6.2 (keep settings) -> 4.5.16 (keep settings) ->...

All above processes in the 'speedtest.net' work well, test with 2 methods in each process: cable wired and Wi-Fi 2.4GHz.

Wired:

Clip_2024-07-29_11-07-34
Clip_2024-07-29_11-07-341366Ɨ537 46.3 KB

Wi-Fi:

Clip_2024-07-29_11-07-56
Clip_2024-07-29_11-07-561254Ɨ531 44.5 KB

Please let me know what features (with detail configurations) does the router enable?

3

In 4.6.2 did you reset and start from a clean setup?

Do you use repeater?

What is the client device?

4

Hi @bruce , @alzhao , I haven't been using many advanced features and configurations of this router except for:

  • OpenVPN client profiles (I have four client profiles and tunnels that I might occasionally establish) through the GL-MT3000
  • I had AdGuard Home enabled in the GL-MT3000.

Not much customization beyond that. No issues until the 4.6.2 upgrade (done automatically through the Web UI upon login). Then the download speed was < 0.5 Mbps while upload remained ~75 Mbps.

A couple of other points that could be relevant:

  1. I do test-it / set it up at home prior to travelling - this is where I encountered this problem. So during this testing it was downstream from another router. Not connected to my ISP directly. But it was connected as a normal DHCP client in a home network - no captive portal, no WiFi repeater - both the MT3000 and the upstream router operating in router mode (hence double-NAT)
  2. I found that I was using a cat-5 cable to connect it to the upstream router. Which is why I was topping out at ~75 Mbps down (download speed remained fine at all times) and at ~75 Mbps up while on the old firmware. I have a 1.5G ISP service and I'm not sure why I didn't have it connected by a cat-5e cable - accidentally grabbed an old cable I guess.

That all being said, I think the biggest clue is the system log error messages. What are the details behind, and possible causes of the kern.err kernel ... messages I posted originally?

Thanks all!

5

Device: GL-MT3000
Firmware: 4.6.3 (beta I think?)
OpenWrt Version:
OpenWrt 21.02-SNAPSHOT r15812+899-46b6ee7ffc
Kernel Version: 5.4.211

Hi there, hope I'm not crashing a thread with too much off-topicness, but couldn't help but sign up just to add to this cause I feel it's gotta be meaningful in some way and too much to be coincidence.

However, about an hour ago I started getting dropped from my video call I was on for work (Google meet and I was presenting my screen as well if that matters), now that's not too uncommon, I usually have to relogin to the captive portal as I'm at a hotel temporarily.

What was uncommon though was after reconnecting, I dropped again about 5 minutes later and couldn't reconnect no matter what i tried. Used cell phone Hotspot to connect the laptop back into the meeting, officially ended that, then jumped back to getting wifi reconnected.

Once reconnected finally went through the logs and saw something I never saw and that was multiple lines with

Mon Jul 29 18:12:18 2024 kern.err kernel: [192583.955021] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Mon Jul 29 18:12:18 2024 kern.err kernel: [192583.964506] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 1, free_token_cnt = 2303
Mon Jul 29 18:15:26 2024 kern.err kernel: [192771.916637] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1

I decided to Google for "tx_free_v3_notify_handler()" as I thought that was unique enough to warrant the best results, and this is why I had to reply to this...

Googling that term which seems to be a method of a class of some sort, provided me with 3 results total. Now I've been googling in a support capacity for 20 years and when the top result is a forum thread from 2 days ago, that tells me this is extremely narrow in scope.

The 3rd result, coincidentally, is a forum post from here and it outlines an issue a user was having specifically when on video calls and being dropped. Coincidence? Not sure I can be convinced not.

I'd really really love to know what this tx_free_v3_notify_handler() is and what it's purpose is, as it seems to be exclusive to gl.inet firmware/software.

Screenshot_20240729-184904
Screenshot_20240729-1849041080Ɨ4206 262 KB

7

Could you try this firmware?

8

Sorry for the extended delay on getting going on this. I have applied the firmware file from the Google Drive link now. And I'm at a hotel, using WiFi connection (as it hasn't recognized the WAN port connection in the last two hotels in a row now) and I'm getting ~16Mbps down now.

And the log file is showing:

Sun Aug 25 17:15:46 2024 kern.notice kernel: [  189.443864] 7981@C15L3,PeerGroupMsg1Action() 7066: ===>Receive group msg 1
Sun Aug 25 17:15:46 2024 kern.err kernel: [  189.595073] 7981@C11L1,header_packet_process() 7098: header_packet_process(): CheckRxError!
Sun Aug 25 17:15:46 2024 kern.err kernel: [  189.603433] 7981@C11L1,header_packet_process() 7098: header_packet_process(): CheckRxError!
Sun Aug 25 17:15:46 2024 kern.err kernel: [  189.788490] 7981@C11L1,header_packet_process() 7098: header_packet_process(): CheckRxError!
Sun Aug 25 17:15:46 2024 kern.err kernel: [  189.796851] 7981@C11L1,header_packet_process() 7098: header_packet_process(): CheckRxError!
Sun Aug 25 17:15:46 2024 kern.err kernel: [  189.805203] 7981@C11L1,header_packet_process() 7098: header_packet_process(): CheckRxError!
Sun Aug 25 17:15:46 2024 kern.err kernel: [  190.003614] 7981@C11L1,header_packet_process() 7098: header_packet_process(): CheckRxError!
Sun Aug 25 17:15:47 2024 kern.err kernel: [  190.207686] 7981@C11L1,header_packet_process() 7098: header_packet_process(): CheckRxError!
Sun Aug 25 17:15:47 2024 kern.err kernel: [  190.216040] 7981@C11L1,header_packet_process() 7098: header_packet_process(): CheckRxError!
Sun Aug 25 17:15:47 2024 kern.err kernel: [  190.414449] 7981@C11L1,header_packet_process() 7098: header_packet_process(): CheckRxError!

Is there something you'd like me to grep for in the logs? In the meantime I am going to revert the firmware version back to the 4.5.16 which for me, seems to be the most stable.

9 
CheckRxError!

Are these logs in 4.5.16 firmware?

10

This firmware use the same wifi driver with 4.5.

11

No, didn't notice those since downgrading. If you can tell (or dm me) where the log file is on the OS, I can grep for those.

12

I can try the firmware from the Google Drive again then. Perhaps those header_packet_process(): CheckRxError! errors were due to the one hotel's WiFi or is there another recommendation?

And separately, I've just been to two different hotels and at both (independent chains, in different cities, with different ethernet cables) the Beryl wouldn't connect via the ethernet provided. Perhaps both were not active via the cat-5e provided cables - seems like a strange coincidence, but is possible. It does connect via cat-5e when at home though. :man_shrugging:

13

Applied this f/w again and ran some speed tests:

  • About 70 Mbps on the 2.4 GHz channel
  • About 530 Mbps on the 5.0 GHz channel

Before, on the same internet connection, I was struggling to get 0.25 Mbps so this seems significantly better.

So what is the difference between the v4.6.2 firmware shared via Google Drive and the version is automatically upgraded to from the WebUI? Something seems to be fixed in the Google Drive version (or appears to be better from preliminary testing).

14

Could you try this firmware which using latest wifi driver v7.6.7.2?

@Online-in-Canada

1 Like
15

Iā€™m using the GL-X3000 Spitz model and experiencing the same error logs as the original poster.

While it works well most of the time, Iā€™m facing occasional sudden drops in download/upload speed and significantly increased latency. Could these issues be related?

Sun Oct 13 15:18:41 2024 kern.err kernel: [ 3958.917275] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sun Oct 13 15:18:41 2024 kern.err kernel: [ 3958.926673] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 2, free_token_cnt = 2302
Sun Oct 13 15:18:45 2024 kern.err kernel: [ 3962.916072] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sun Oct 13 15:18:45 2024 kern.err kernel: [ 3962.925469] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 2, free_token_cnt = 2302
Sun Oct 13 15:18:53 2024 kern.err kernel: [ 3970.787858] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sun Oct 13 15:18:53 2024 kern.err kernel: [ 3970.797258] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 7, free_token_cnt = 2297
Sun Oct 13 15:29:25 2024 kern.err kernel: [ 4602.795397] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sun Oct 13 15:29:25 2024 kern.err kernel: [ 4602.804804] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 2, free_token_cnt = 2303
Sun Oct 13 15:29:26 2024 kern.err kernel: [ 4603.438190] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sun Oct 13 15:29:26 2024 kern.err kernel: [ 4603.447581] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 3, free_token_cnt = 2302
Sun Oct 13 15:29:26 2024 kern.err kernel: [ 4604.078550] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 3, ContTxFailCnt300ms = 2
Sun Oct 13 15:29:26 2024 kern.err kernel: [ 4604.087947] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 2, free_token_cnt = 2303
Sun Oct 13 15:29:27 2024 kern.err kernel: [ 4604.557278] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 4, ContTxFailCnt300ms = 1
Sun Oct 13 15:29:27 2024 kern.err kernel: [ 4604.566668] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 2, free_token_cnt = 2303
Sun Oct 13 15:29:28 2024 kern.err kernel: [ 4605.355093] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 5, ContTxFailCnt300ms = 1
Sun Oct 13 15:29:28 2024 kern.err kernel: [ 4605.364514] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 2, free_token_cnt = 2303


Sun Oct 13 15:33:55 2024 kern.err kernel: [ 4872.810728] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 2, ContTxFailCnt300ms = 2
Sun Oct 13 15:33:55 2024 kern.err kernel: [ 4872.820121] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 2, free_token_cnt = 2303
Sun Oct 13 15:33:56 2024 kern.err kernel: [ 4873.289813] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 3, ContTxFailCnt300ms = 1
Sun Oct 13 15:33:56 2024 kern.err kernel: [ 4873.299209] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 2, free_token_cnt = 2303


Sun Oct 13 15:38:03 2024 kern.err kernel: [ 5120.265736] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 2, ContTxFailCnt300ms = 2
Sun Oct 13 15:38:03 2024 kern.err kernel: [ 5120.275134] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 2, free_token_cnt = 2303


Sun Oct 13 16:17:48 2024 kern.err kernel: [ 7505.298058] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sun Oct 13 16:17:48 2024 kern.err kernel: [ 7505.307456] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 1, free_token_cnt = 2303
Sun Oct 13 16:21:11 2024 kern.err kernel: [ 7707.949894] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sun Oct 13 16:21:11 2024 kern.err kernel: [ 7707.959292] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 27, free_token_cnt = 2301
Sun Oct 13 16:21:20 2024 kern.err kernel: [ 7716.729427] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sun Oct 13 16:21:20 2024 kern.err kernel: [ 7716.738841] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 27, free_token_cnt = 2298
Sun Oct 13 16:22:59 2024 kern.err kernel: [ 7815.902072] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 5, ContTxFailCnt300ms = 5
Sun Oct 13 16:22:59 2024 kern.err kernel: [ 7815.911466] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 28, free_token_cnt = 2302
Sun Oct 13 16:47:26 2024 kern.err kernel: [ 9282.899925] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sun Oct 13 16:47:26 2024 kern.err kernel: [ 9282.909339] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 27, free_token_cnt = 2303
Sun Oct 13 16:47:27 2024 kern.err kernel: [ 9283.264800] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 4, ContTxFailCnt300ms = 3
Sun Oct 13 16:47:27 2024 kern.err kernel: [ 9283.274193] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 28, free_token_cnt = 2302
Sun Oct 13 17:12:47 2024 kern.err kernel: [10803.722899] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
Sun Oct 13 17:12:47 2024 kern.err kernel: [10803.732296] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 1, free_token_cnt = 2302

For your reference, I'm running up-to-date firmware both for router and modem.

  • Router: Version 4.0 0412release3
  • Modem: Version RM520NGLAAR03A04M4G
16

I wonder if you have any feedback in this issue?

17

unfortunately I have the same issue and log, DL 0,5 Mbit on an otherwise 400 Mbit DL after reboot. very weird

Model GL.iNet GL-X3000
Firmware Type0701beta1
Modem NameRM520NGLAAR03A03M4G

but I have a feeling that log does not correlate to this issue.

> Tue Dec 17 09:18:21 2024 kern.err kernel: [136516.279128] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
> Tue Dec 17 09:18:21 2024 kern.err kernel: [136516.288611] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 1, free_token_cnt = 2303
> Tue Dec 17 09:28:56 2024 kern.err kernel: [137151.326832] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
> Tue Dec 17 09:28:56 2024 kern.err kernel: [137151.336317] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 189, free_token_cnt = 2303
> Tue Dec 17 09:53:11 2024 kern.err kernel: [138605.170058] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
> Tue Dec 17 09:53:11 2024 kern.err kernel: [138605.179560] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 343, free_token_cnt = 2150
> Tue Dec 17 09:54:26 2024 kern.err kernel: [138680.244024] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
> Tue Dec 17 09:54:26 2024 kern.err kernel: [138680.253517] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 190, free_token_cnt = 2302
> Tue Dec 17 09:54:35 2024 kern.err kernel: [138689.175388] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
> Tue Dec 17 09:54:35 2024 kern.err kernel: [138689.184867] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 190, free_token_cnt = 2301
> Tue Dec 17 09:56:10 2024 kern.err kernel: [138784.794700] 7981@C13L1,tx_free_v3_notify_handler() 3530: ContTxFailCntTotal = 1, ContTxFailCnt300ms = 1
> Tue Dec 17 09:56:10 2024 kern.err kernel: [138784.804182] 7981@C13L1,tx_free_v3_notify_handler() 3533: token used by current wcid = 295, free_token_cnt = 2198