Hw-module Slot 1 Oversubscription
The catalyst 6880-X has been here for a while now and has already been announced for End-of-Life in October 2019. Last day of support will be Oct 2025. Before that time customers are urged to replace the platform. Replacement for this platform will be the Catalyst 9500 series with all of its flavors.
Hw-module session 1/0 The Part 1/0 of above command depend from the Output of sh hw-module all attribute Command. Slot 1 Bay 0 Board 0 ModuleSM-X-ES3D-48-P. 1/0 is for Slot 1 Bay 0, than you connect to the EtherSwitch command and can configure this one.
- Hw Module Slot X Oversubscription, slots macro, les stentors casino barriere toulouse, founder of poker online. Visit Casino-Free Spins.
- Note:: The Nexus 7000 supports dual supervisor modules to provide 1+1 redundancy for the control and management plane. Only one of the supervisor modules is active at any given time, while the other acts as a standby backup.
- The cards are C6800-32P10G. The issue only happens with performance mode, the issue is not present with oversubscription mode. 'no hw-module slot 1 oversubscription' - The issue is not seen in 15.2(1)SY1 and 15.2(1)SY1a but it happens in 15.2(1)SY2 and 15.2(1)SY3.
I’m writing this, because I found it very difficult to find a suitable answer for my question based on oversubscription mode and performance mode. Does switching between these mode in production cause an outage, does the switch need to reboot, does the ASIC’s need to be re-programmed?
I have the following hardware at my disposal:
To talk about oversubscription and performance mode we need to take a brief look at what they actually mean.
:: Oversubscription
Most of the catalyst platforms deliver line rate speed at 100Mb, 1Gb, 10Gb, 40 or 100Gb. Line rate is a Layer-1 terminology which essentially means the how fast hardware can put bits in the wire. But is doesn’t mean that this speed will be reached over the box from Layer-1 to Layer-3. It depends strongly on how hardware interfaces are connected in a switch, how many of these interfaces are connected and how fast the bus can transfer cascaded bits, frames and packets.
With more complex switches vendors like to refer to a switch fabric or back plane. A back plane can be translated as the big hardware bus interface where all end ports connect to. The backplane can have various throughput speeds to transfer all the data in and out.
When the backplane delivers 1:1 throughput (48x 1Gb/s ports = backplane of 960Gb/s(full duplex)) we talk about non-blocking. We have to calculate full-duplex, otherwise it won’t be non-blocking.
When the backplane delivers 2:1 throughput (48x 1Gb/s ports = backplane of 480Gb/s) we talk about oversubscription or oversubscribed.
In Utopia when all ports ask the maximum line rate at the same time, they would get 500Mb/s throughput each. With an oversubscripted interface throughput can shift over the backplane, still delivering line rate as long as not all interfaces require the same amount of throughput at the same time.
For heavy duty switches or DC switches I would not suggest using oversubscribed switches, linecards or fabric cards. Non-blocking is very recommended in DC environments.
Now back to the CAT6880-X…
:: Performance mode
Actually I’ve already given the answer for Performance mode. It’s the same as non-blocking thus allowing line rate speeds and throughput full duplex to pass in and out of the switch.
:: Why switch between these modes?
The supervisors and linecards in my example have each 16 SFP+ Multi-rate ports onboard. You would have 64 10Gb port to use. Since we use VSS it’s is required to have performance mode enabled on the switch were the VSL link are connected to. Cisco documents tell you that this is recommended. When they say that it actually means the following:
We recommend the feature to be turned off MEANS We order you to turn off this feature otherwise you won’t receive support until you revert back to the recommended settings.
Please be aware of this.
Now with performance mode we can only use 8 ports of the 16 ports available. Why? We have to dive into the architectuur of the hardware.
Quote from the whitepapers:
“Cisco is extending the scale, performance, and capabilities of the venerable Cisco Catalyst 6000 Series with the introduction of the new Catalyst 6800 Series. The new Catalyst 6880-X chassis provides extremely high levels of scalability and performance, with the size and economics of an innovative extensible fixed architecture.
The new Catalyst 6880-X chassis is capable of delivering up to 220Gbps of per-slot bandwidth. This translates to a system capacity of up to approximately 2 Tbps.”
We have 16 10Gb ports per line card. The 220Gb/s slot can accept two linecards in it’s bus. Each linecard support up to 80Gb/s.
We can only assume that this calculation is based on full duplex!
No Hw-module Slot 1 Oversubscription
That would be 160Gb/s simplex or 320Gb/s full duplex. OMG! It’s oversubscribed. To allow line rate non-blocking we must disable ports from usage. And that’s where Performance mode comes into play.
When enabling Performance mode ports will be disabled. Both line cards have 2 ASIC group (or port-groups) per linecard. You can disable or enable the required mode per port-group per linecard.
Here are some examples:
Port-group 1: Performance mode
Port-group 2: Oversubscription mode
Port-group 1: 4 usable ports (4x 10Gbx2=80Gb/s)
Port-group 2: 8 usable ports (8x 10Gbx2=160Gb/s)
Total: 80Gb/s per linecard. Port-group one is 1:1 and port-group 2 is 2:1
Port-group 1: Oversubscription mode
Port-group 2: Oversubscription mode
Port-group 1: 8 usable ports (8x 10Gbx2=160Gb/s)
Port-group 2: 8 usable ports (8x 10Gbx2=160Gb/s)
Total: 80Gb/s per linecard. Both port-groups are oversubscribed 2:1
Port-group 1: Performance mode
Port-group 2: Performance mode
Port-group 1: 4 usable ports (4x 10Gbx2=80Gb/s)
Port-group 2: 4 usable ports (4x 10Gbx2=80Gb/s)
Total: 80Gb/s per linecard. 160Gb/s throughput.
Oversubscribed in a 2:1 relation
:: Does converting these mode cause impact?
Let’s first distinct the two supervisor options for the 6880-X platform:
- Sup6T
- Sup2T
With the SUP6T architecture and converting from the default oversubscription mode to Performance mode: You’ll need to reset the whole VSS system according to the Configuration Guide. Yaykes! Please read the SUP6T architecture and specifically sector VSS.
With the SUP2T there is actually nothing written about moving from one mode to the other. At least I couldn’t find it. There is nothing about convert mode in the documentation when it comes to the SUP2T. Time for a TAC question!
Hw-module Slot 1 Oversubscription Port-group 1
Filed in a TAC case Prio 4 to ask the question. Luckily Cisco TAC is very fast in answering Prio 4 questions. The TAC engineer wasn’t sure either, so he tested it for me in a testlab.
Result: No ports going down and up and no VSS system reload necessary. Cool!
BUT: as soon as I entered the commands per switch and per slot some things happened.
No Hw-module Slot 1 Oversubscription Port-group 1
Ports went down, failover happened on the connected cluster devices.
What happened?
Well I was converting from performance mode to oversubscription mode of one of the port-groups on the linecards (No VSL links attached). The best move you can make. As TAC mentioned ports don’t go down and VSS doesn’t need a reload. He was right.
Ports went down because a failover was triggered on the WLC member. The ASIC (port-group) was re-programmed and caused a slight interuption on the dataplane. This happens quite fast, but not fast enough to avoid WLC Clusters failovers.
WLC’s use keep-alives to their gateways to determine the overall health of a cluster. When the keep-alived fail the member of the cluster is deemed unhealthy and performs a failover. The former secondary member will reload to be put back into the cluster properly.
Then we see ports going down and up again. We also have a Firepower 4120 cluster connected to one of those port-groups and these didn’t have any issues. Firepower 4120 cluster is active/active on data plane level, so the traffic will be directed temporary to the other FPR members.
:: Conclusion
So bottomline, Does converting modes in port-groups on the Cat 6880-X create an impact?
Yes and No, but it depends on which type of platform and which type of cluster you have connected to the port-groups. Also it’s important how these are connected in the VSS system (straight or cross-connect). Cross-connecting those devices wouldn’t have caused a failover in the first place as the gateway would always be available in the port-channels. We did not have these WLC’s cross-connected.
Luckily SSO save the day and service was not impacted at all. Now we know that the port-groups are re-programmed and cause a little connectivity disruption when this happens.
:: Converting in action
And there goes the WLC member…
I’ve performed this for 4 port-groups on the VSS cluster. Results were all the same.
Hope you’ve like the post and if you have any questions… 42 would be the answer.