Perhaps it is the load on the router itself. Here are some averages from Luci’s realtime monitoring graph: