Maybe try QOS and set to 80-90% of your average speed. Could be buffer bloat and QOS should help that.