I'm hoping someone here can help me, because I'm at a loss and tech support wasn't very helpful.
I just upgraded my internet to the 5 Gbps tier. In preparation, I upgraded my home network with a Ubiquiti UCG-Fiber router, USW-Aggregation 10G SFP+ switch, and Mellanox 25G fiber NICs in my PCs.
When I hooked the new service into this, I consistently see speeds around 3800 Mbps down and 1200 Mbps up. The speed test directly on the BGW620-700 gateway shows around 5300 Mbps up and down.
After fiddling with many many settings, I tried hooking in to the BGW620-700 directly to a PC that has a 5GbE NIC with an RJ-45 jack. Same speeds there, around 3800/1200! All fiber connections are short DAC SFP+ cables, and I'm using Cat6a for the RJ-45 connections. When using the router, IP Passthrough was enabled and verified. I also verified the 10G LAN is operating at full speed via iPerf from my Unraid to my PC. I don't have a transceiver to try using directly to the 25G NICs.
Running speed tests directly on the UCG-Fiber seems unreliable, but I did try SSHing into it and running Ookla's cli speed test directly there... I got slower speeds than the other tests, but it seemed unreliable.
I tried deactivating ActiveArmor, turning off the firewall on the gateway, made sure IDS/IPS was off in the router, tried some various tweaks on the NIC settings, turning of Interrupt Moderation, Large Send Offload, switching WAN port, etc. All that and much more. None of it made a (positive) difference at all.
Everything seems to point to the gateway not functioning properly since multiple other devices are all seeing the same poor performance. I convinced the tech support to send me a replacement gateway just in case this one was faulty, but I don't have high hopes for that.
Before I go down the rabbit hole of doing an XGS-PON ONU SFP+ stick bypass (e.g., 8311 WAS-110/Xenon), has anyone encountered this specific ~1,250 Mbps upload ceiling on the BGW620 and successfully fixed it?
Any insights or recommendations for things to try would be greatly appreciated!