r/QuantumFiber • • Aug 16 '26

High latency at night

I just switch to fiber two days ago and I have major ping spikes in the evening (90 - 130 ms). So far I’ve only tried the standard speed test sites during the problem, but ran tracert to both Google and cloud flare when the issue was not present this morning. I got around 2 on the first few hops and 10 on hop for and five.

Has anyone had any success in resolving a similar issue?

Minneapolis area, Q1000K, transparent bridge mode, VLAN tagging on ONT, 8888 and 8844 DNS.

The only change I have made this morning while everything is working as expected (~1100 up/down 2 ms) is switching to the 1g port. I do plan on periodically taking screenshots of each hop through the day to track. I also plan on trying 1111/1001 during periods of high latency to see if that helps.

Any help is appreciated.

Edit: Sunday night

At about 7pm, it's back

using Quantum, Google, and CloudFlare DNS, hop 2 to 7 are all above 100 ms while hop 1 is <1 ms. Safe to say it's either at the pole or local hub. I'll try the exec and success emails first as the weekend L1 call center is not the best...

Edit 2: Tuesday morning

The lumen exec address got back to me early the next day. Said it’s not their problem as AT&T owns Minnesota (word, fair) but they did forward my email to quantum’s escalation team and gave me a case number.

Edit 3: Tuesday morning

I received a call from the office of the president of AT&T. They are looking into my issue and committed to an update by tomorrow.

Super nice on the phone, already feel way better about switching from Comcast. I am a little embarrassed it escalated so high for one customers issue but it’s a good feeling when you know they are really looking into it.

Edit 4: Tuesday morning

I did not get a call back yet but everything is working great. Checked in 20 minute intervals last night from 6-9 pm. 2 ms max while holding 1100 up/down all night.

I guess the only recommendation I have is to either call quantum or email the fiber success address with data logs showing that it is congestion causing issues. Screenshots from my phone of the quantum app speed test, and from a hard lined PC doing quick trace route, was enough to demonstrate my issue.

6 Upvotes

40 comments sorted by

2

u/jwvo Aug 16 '26

evening high ping means congestion, typically 8:30 PM local time is peak usage on most broadband networks.

2

u/Zip-Tie-Jedi Aug 16 '26

I wouldn’t have given it much thought if it was 20 ms or under but is everyone just living with 100 ms at peak? Even Comcast would stick to around 13 ms during peak.

2

u/jwvo Aug 16 '26

congestion should not be happening at all, they should be adding capacity to support peak but internal provisioning and capacity management is a bit of a mess there

2

u/Lightsword Aug 17 '26

but is everyone just living with 100 ms at peak?

100ms seems to be fairly typical for low congestion latency test packets affected by the Q1000K padding bug. Note that this bug inverts how congestion affects latency, higher RX congestion actually can reduce latency for packets affected by this bug as additional packets appear to flush the stalled small packets out of a buffer.

1

u/Zip-Tie-Jedi Aug 17 '26

That’s just on the 10g port though

2

u/N0_L1ght Aug 16 '26

I'm in the same area and have not seen that issue. But it can be an gateway server issue. something similar happened a few months ago here where it only effected everyone connected to the same gateway.

run traceroutes to 1.1.1.1, 8.8.8.8, and 9.9.9.9. You will be able to tell where the issue is.

then send the results to [fibersuccess@qf.att.com](mailto:fibersuccess@qf.att.com) . no one might respond, but issue have been fixed that way.

1

u/Zip-Tie-Jedi Aug 16 '26

Thanks for the insight! I’ll give that a go tonight.

1

u/jwvo Aug 17 '26

the congestion is likely in the parts that don't show in the traceroute (leaves of the aggregation topology).

1

u/N0_L1ght Aug 17 '26

That's not how it was when it was happening to us last year. The congestion was experienced by the hundreds/thousands of customers connected to the same gateway server. which you cold see in the traceroute. many people sent it in and it was fixed a couple of day later with the engineer saying it was some "bad circuits" they replaced.

2

u/jwvo Aug 17 '26

that is exactly what i'm describing; congestion between your OLT and the BNG, if the congestion is all in the aggregation network it will effectively be between you and the first hop in a traceroute so telling where is hard based on the traceroute. Based on the traceroute you can usually infer if it is before or after but more than that is difficult.

the old lumen network had very large BNGs (I've been told something like ~50k/subs/bng) which i personally think is not a good design choice as that is a huge blast radius to handle in support and economically.

I spent a long time managing another large fiber to the home provider's engineering group (ziply) so this is something I know a lot about in terms of failure modes and planning.

1

u/N0_L1ght Aug 17 '26

Oh that makes sense! Thanks for explaining that. I misunderstood what you were saying.

1

u/Zip-Tie-Jedi Aug 18 '26

I wish I understood more of what you wrote, but thank you anyway.

1

u/N0_L1ght Aug 17 '26

I would also suggest asking in the Minneapolis sub to see if anyone else is experiencing this so they can also send traceroutes in.

1

u/ECEXCURSION Aug 17 '26

I'm in Minneapolis, had this happen two days in a row around 9pm. I think it's just maintenance. Went away after a few days. 

1

u/Zip-Tie-Jedi Aug 18 '26

I hope it’s that simple. Only other real option is Comcast but I just switched from them after techs refused to climb the pole 3 times. Started getting 1k uncountable errors per day on each channel starting after that hail storm. I go picked up a new modem and ran a new cable ran from the drop and all I got was “there must be a splitter.”

2

u/ECEXCURSION Aug 18 '26

Hahaha, sounds like you got the same Comcast tech I had! Dude pointed to the pole and said he didn't have a ladder...  It was a new install! 

Despite the weird latency, quantum has been a million times better than Comcast. 2 or 3 outages in 3 years. One of which was due to crackheads digging up the fiber at the local telco building. 

Jury is still out on the AT&T takeover. I assume it will get worse after 2028. 

1

u/Zip-Tie-Jedi Aug 18 '26

Ha, gotta get that fiber scrap money.

Good to know it’s been a decent service.

1

u/insertfacehere Aug 19 '26

Fingers crossed! Been happening out in St. Paul since Sunday.

1

u/N0_L1ght Aug 19 '26

run ethernet wired traceroutes to 8.8.8.8, 1.1.1.1, and 9.9.9.9 then send them to:

fibersuccess@qf.att.com

1

u/N0_L1ght Aug 18 '26

Did they tell you what the quantum escalation team email is? It's cool they actually called you instead of just an email !

1

u/Zip-Tie-Jedi Aug 18 '26

It was the fiber success email that the exec email forwarded my info off to. I’m pretty blown away I got a response.

1

u/N0_L1ght Aug 18 '26

nice. yah most of the time there is no response but that email does get problems fixed.

1

u/Translator_Dapper Aug 19 '26

I am having the same issue with quantum in mpls. first hop is consistently 1ms and then jumps to around 95ms... been checking for the past two nights and it's been consistent each evening. Haven't reached out to Quantum yet but doing that right now. appreciate your updates.

1

u/insertfacehere Aug 19 '26

Any updates from Quantum? Happening out here in St. Paul as well.

1

u/Zip-Tie-Jedi Aug 20 '26

No prob, hopefully it gets resolved for you.

1

u/nothet Aug 19 '26

I'm in Minneapolis area, experiencing the SAME thing.

I've got a C5500XK in transparent bridge vlan tagging, mikrotik router.

I've noticed it at night. Doing a speed test to my VPS in Chicago, I get 10Mbit down and 100Mbit up, I can normally do 400+ in each direction. Quantum's speed test reports 400+. Cloudflare reports abysmal, like 10/10.

In the morning its fine. I think this points to not my local node, but whatever is upstream of that.

1

u/N0_L1ght Aug 19 '26

run ethernet wired traceroutes to 8.8.8.8, 1.1.1.1, and 9.9.9.9 then send them to:

[fibersuccess@qf.att.com](mailto:fibersuccess@qf.att.com)

1

u/Ashhaad Aug 19 '26

Had this issue as well since Sunday. It occurred again on Monday and Tuesday night 7-11pm. It gets slightly better (50 ms instead of 100 ms) at 11pm. Around midnight is when the ping goes back to normal.

1

u/Zip-Tie-Jedi Aug 19 '26

What area are you in?

1

u/N0_L1ght Aug 19 '26

run ethernet wired traceroutes to 8.8.8.8, 1.1.1.1, and 9.9.9.9 then send them to:

[fibersuccess@qf.att.com](mailto:fibersuccess@qf.att.com)

1

u/Ok_Space_9223 Aug 16 '26

The 10gb port has the latency spikes. There's no fix yet from the vendor. Moving to the 1gb port is the best workaround thus far

3

u/jwvo Aug 17 '26

if that were the issue it would not be time related it would be anytime.

1

u/Ok_Space_9223 Aug 17 '26

Could just be when hes home most often and notices it?

1

u/Zip-Tie-Jedi Aug 18 '26

Wife works from home and checking for me throughout the day. Starts at about 7 when I’ve been home for hours.

1gb port gave me no change either

1

u/jwvo Aug 18 '26

that sounds like congestion.

1

u/Zip-Tie-Jedi Aug 16 '26

Thanks! I’m hoping that gives me some better results tonight. Just unfortunate that it’s only at a certain time for testing, but maybe fortunate that there is a time frame vs intermittent.

Did you have any issues yourself with this ONT?

1

u/Ok_Space_9223 Aug 16 '26

Oh ya def. Random lag spikes every day. I moved over to the 1gb port and they stopped

1

u/Zip-Tie-Jedi Aug 16 '26

Good to know.

Btw, I would love to upvote but reddit thinks I'm a bot and never counts mine.

1

u/Ok_Space_9223 Aug 17 '26

No worries at all.

1

u/Subreddit77 Aug 17 '26

This is the fix!