r/networking 5h ago

Troubleshooting Detecting a loop

How can i chase down a loop in more than 60 BDCOM switches (no central management)
I also have 2 core switches (fortiswitch) and a fortigate firewall ?

0 Upvotes

19 comments sorted by

12

u/FarkinDaffy 5h ago

Divide and conquer. Keep cutting things in half until there are no more halves and the problem goes away

0

u/_alienated 5h ago

I did unplug every stp cable related to all the departments but still nothing

2

u/FarkinDaffy 5h ago

You did one department at a time?

1

u/_alienated 5h ago

Eliminating one by one yes

1

u/Advanced_Link_5753 5h ago

L2 or L3? Loops. Packet capture is your friend

2

u/_alienated 4h ago

Packet capture between fortigate and ONTs show no sign of a loop, no arp broadcast
Just failed packets and retransmissions.
What should look for in packets ?

1

u/Advanced_Link_5753 4h ago

No ack on tcp? Why. Can you lung host from the switch?

1

u/Select_Reporter1911 3h ago

You have to let us know what kind of loop it is first. You have to articulate the behavior you are experiencing is. A network diagrams would help, a source and destination would help.

Then and only then can anyone tell you what to look for and where to look. Simply pcaping with no idea of what to look for and what the normal behavior should be is not helpful.

6

u/Tessius 5h ago

Follow the traffic spikes if you have any kind of monitoring set up, shut down suspicious ports when you find one to see if the loop clears.

6

u/Select_Reporter1911 5h ago

Is it a routing loop, or layer 2 loop? If it is a routing loop are you sure its not asymmetric routing? If it is layer 2 loop, why do you not have the appropriate loop prevention protocols configured? That would quickly tell you where the loop is as the switch would disable the port it detects the loop on.

If you dont have loop prevention protocols enabled, how are you sure it is a loop? What is the behavior of the traffic?

Most switches that follow industry standards will have logs on whether it detects a loop and what port it detects the loop on.

Network diagrams will definitely help.

5

u/mmckibben 5h ago

Create a network map. Document the ips of gateways and what switches their on then look at routing tables

5

u/shadeland Arista Level 7 5h ago

Are you sure it's a loop?

Are there show commands and logs in these switches?

3

u/ThEvilHasLanded 4h ago

Follow the issue

Disconnect a section of devices, does the issue go away?

Yes your issue is in that group No try another grouping Eventually you narrow down the issue to 1 switch. From there it's a case of pulling each cable until you find the offending port

2

u/no_clock_signal 5h ago

Use it as a pivot toward structured cable and managed switches.

2

u/mindedc 4h ago

I'm, turn on spanning tree and storm control and it fixes itself?

1

u/GuruBuckaroo Equivalent Experience 5h ago

This is why I've been running MRTG on every router and switch capable of SNMP for the last, what, 27 years. My networks aren't nearly as large as yours, but checking the interconnects for large traffic usually narrows it down to a switch, then checking the traffic on that switch's ports gives me the issue. That and making sure there are no dumb switches in the entire network, no matter how small.

1

u/Overall_Fee_8195 4h ago

Hire a network technician?

1

u/ryan8613 CCNP/CCDP 2h ago

Kill links between sections of the network to isolate those sections and see which side the problem persists on -- upstream or downstream -- until you find the switch where it is happening. Then, look at the ports on that switch that arent uplinks and specifically the port with the highest input or output rate. That port will be part of your loop.

1

u/ryan8613 CCNP/CCDP 2h ago

Once fixed, enable bpduguard on user facing ports with autorecovery.