• Arista 7280R Series 40G/100G systems Multi-Speed Port Configuration

 
 
Print Friendly, PDF & Email

Overview

In high performance leaf and spine networks the Arista 7280R Series enables a high level of flexibility with a common consistent architecture, with a choice of 1RU and 2RU fixed systems, 10G to 100G interface speeds and port density up to 72 ports of 40G and 60 ports of 100G.

The 7280R Series include the ability for enabling multiple speeds on QSFP ports, with a per interface configuration that is optimized for the maximum overall system flexibility. On some members of the 7280R Series to maximise the total system port count, and at the same time facilitate the most flexible set of 10/25/40/50/100G interface speed configurations the total number of active ports varies depending on the actual configured interface speeds, and not all ports can support all speed permutations. This document intends to detail the 7280R systems with total port count and interface speed choices.

This document is relevant to systems running EOS release 4.19.0F on the Arista 7280QR-C72 and 7280QRA-C36S.

What are the 7280R Series

The Arista 7280R Series of family fixed systems include the 7280R, 7280RA, 7280R2 and 7280R2A. The 7280R Series are key components of the Arista 7000 Series portfolio of data center switches and are purpose built to support 10/25/40/50/100GbE for the highest performance environments, and to meet the needs of the largest scale data centers and service providers. They deliver scalable L2 and L3 resources combined with high density and advanced features for network monitoring, precision timing and network virtualization to deliver scalable and deterministic network performance while simplifying designs and reducing Opex. Deep packet buffers and large routing tables allow for internet peering, interconnect and Inter-DC networking. The broad range of interfaces and density choice provides deployment flexibility.

7280R support for 100GbE with QSFP ports incorporates support for a choice of interface speeds including both 25GbE and 50GbE providing flexibility and the ability to seamlessly transition data centers to the next generation of Ethernet performance.

The products detailed in this paper are the 7280QR-C72 and the 7280QRA-C36S:

7280QR-C72 – 2RU with 72 port QSFP+ and up to 16 ports QSFP100

  • Offers a choice of port combinations with QSFP+ and QSFP100 optics and cables

  • Flexible interface combinations – 72x 40G, 160x 10G, 16x 100G, 64 x 25G, 32x 50G

  • Up to 5 speeds for flexible 10GbE, 25GbE, 40GbE, 50GbE and 100GbE

  • System performance of 6.4Tbps with 16GB of packet buffer

 

7280QR-C72

7280QRA-C36S – 1RU with 36 port QSFP+ and up to 18 x 40G with 12 ports QSFP100

  • Offers a choice of port combinations with QSFP+ and QSFP100 optics and cables

  • Flexible interface combinations – 36x 40G, 120x 10G, 12x 100G, 24 x 25G, 12x 50G

  • Up to 5 speeds for flexible 10GbE, 25GbE, 40GbE, 50GbE and 100GbE

  • System performance of 3.84Tbps with 8GB of packet buffer

  • Support for Arista AlgoMatch

  • Accelerated sFlow

7280QRA-C36S

Flexible Port Combinations

7280QR-C72

The 7280QR-C72 is a 2RU fixed configuration system with 72 QSFP ports for high density 40G networks. A wide variety of other ports speeds are available, but not every port has the same set of combinations.

The 7280QR-C72 switch architecture consists of 4 high performance Packet Processors. Each of the four packet processors support up to 720Mpps of high performance switching and connects to a total of 18 QSFP front panel ports, for a system total of 72 ports and 2.88Bpps. All 72 QSFP ports support 40GbE.

Of the 72 ports up to 16 ports can be enabled as 100G ports, and 40 ports can be enabled in 4x10G mode.

Based on the system layout and the interface capabilities it is important to understand the different speed combinations that are possible to pick the right combination for each DC scenario and how to determine the capability. Depending on the underlying PHY, a port can be capable of one or possibly more speeds. The default speed for all the ports across the switch is set to 40GbE. The following table lists the interface speeds that are available for each port.

Speed

Applicable Ports

Notes

40GbE

1-72 – All ports

All 72 Ports

100GbE

Odd Ports 11- 25 and 47 – 61 (11,13,15,17,19,21,23,25,47,49,51,53,55,57,59,61)

Up to 16x 100G ports and 40x 40G

10GbE**

Ports 1-6, 31-42, 67-72

Odd ports 11-25, and 47-61

1-6,11,13,15,17,19,21,23,25,31-42,47,49,51,53,55,57,59,61,67-72

40 ports of 4 x 10GbE for 160 total

25GbE**

11,13,15,17,19,21,23,25,47,49,51,53,55,57,59,61

4x 25GbE mode for 64 x 25GbE

50GbE**

11,13,15,17,19,21,23,25,47,49,51,53,55,57,59,61

2x 50GbE mode for 32 x 50GbE

As there are 4 packet processors, each set of 18 ports has the same mapping, for example Ports 1-18 are mapped as below:

1

3

5

7

9

11

13

15

17

40G or 4 x 10G

40G or 4 x 10G

40G or 4 x 10G

40G

40G

100G / 2x50G /
4×25/10G / 40G

100G / 2x50G /
4×25/10G / 40G

100G / 2x50G /
4×25/10G / 40G

100G / 2x50G /
4×25/10G / 40G

40G or 4 x 10G

40G or 4 x 10G

40G or 4 x 10G

40G

40G

Disabled or 40G

Disabled or 40G

Disabled or 40G

Disabled or 40G

2

4

6

8

10

12

14

16

18

This port mapping is repeated in 4 identical blocks, as shown below, for the total of 72 ports.

1

3

5

7

9

11

13

15

17

19

21

23

25

27

29

31

33

35

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G

40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

40G

40G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G

40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

40G

40G

40G or 4x10G

40G or 4x10G

40G or 4x10G

2

4

6

8

10

12

14

16

18

20

22

24

26

28

30

32

34

36

37

39

41

43

45

47

49

51

53

55

57

59

61

63

65

67

69

71

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G

40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

40G

40G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G

40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

40G

40G

40G or 4x10G

40G or 4x10G

40G or 4x10G

38

40

42

44

46

48

50

52

54

56

58

60

62

64

66

68

70

72

7280QR-C72 Port Layout

** NOTE: As of EOS release 4.19.0F, breakout mode is not supported on any ports between 11-26 (inclusive) and ports between 47-62 (inclusive), and these ports can only run at 1x40GbE or 1x100GbE.

From the table and the port layout diagram the following is observed.

  • Only odd numbered ports between 11-25 (inclusive) and between 47-61 (inclusive) are capable of operating at the full set of speeds 10/25/50/100GbE.

  • As these ports are configured to 10/25/50/100GbE speed the adjacent even port is disabled.

For example, when port 11 is set to 100GbE, port 12 is disabled, or if port 61 is configured as 4x10G, port 62 is disabled. When these multi-speed ports between 11-25 (inclusive) and between 47-61 (inclusive) are set to operate at 40GbE, the partner even port remains enabled and can also operate at 40GbE. The ability to enable multiple speeds, with a per port configuration increases the overall system flexibility and allows for a very wide set of combinations.

Use Case 1: Setting a port to 100G, which disables a partner port:

!!! Initially port 11/1 is set to default speed, 40G !!!

 

7280QR-C72#show interfaces status

<<<<<<<<< Truncated Output >>>>>>>>>

   

Et11/1                    notconnect   1        full   40G    Not Present       

Et12/1                    notconnect   1        full   40G    Not Present

Et13/1                    notconnect   1        full   40G    Not Present

 

!!! Setting port 11/1 to 100G, see below that port 12/1 is no longer available to use !!!

 

7280QR-C72(config-if-Et11/1)#speed forced 100gfull

 

7280QR-C72#show interfaces status

<<<<<<<<< Truncated Output >>>>>>>>>

 

Et11/1                    notconnect   1        full   100G   Not Present       

Et13/1                    notconnect   1        full   40G    Not Present  

Use Case 2: Splitting 40G ports into 4x10G:

!!! Initially port 1/1 is set to default speed, 40G !!!

 

7280QR-C72#show interfaces status

<<<<<<<<< Truncated Output >>>>>>>>>

   

Et1/1                     notconnect   1        full   40G    Not Present       

Et2/1                     notconnect   1        full   40G    Not Present  

!!! After splitting port 1/1 to 4x10G, see below

 

7280QR-C72(config-if-Et1/1)#speed forced 10000full

 

7280QR-C72#show interfaces status

<<<<<<<<< Truncated Output >>>>>>>>>

 

Et1/1                     notconnect   1        full   10G    Not Present       

Et1/2                     notconnect   1        full   10G    Not Present       

Et1/3                     notconnect   1        full   10G    Not Present       

Et1/4                     notconnect   1        full   10G    Not Present       

Et2/1                     notconnect   1        full   40G    Not Present     

With the above guidelines in mind, these are a few examples of port combinations that the 7280QR-C72 is capable of:

  • 72x40G (default mode)

  • 96x10G, 48x40G (with 24 ports in 4 x 10G mode)

  • 160x10G, 16x40G (40 ports in 4x10G mode)

  • 60x40G,6x100G (6 ports 100G enabled, 6 ports disabled and remaining 60 ports active)

  • 56x40G, 8x100G (8 ports 100G enabled, 8 ports disable, remaining 56 ports active)

  • 48x40G, 12x100G (12 ports 100G enabled, 12 ports disabled, 48 remaining ports active)

  • 40x40G, 16x100G (16 ports 100G enabled, 16 ports disabled, 40 x 40G active)

7280QRA-C36S

The 7280QRA-C36S is a 1RU fixed system with 36 QSFP ports, all capable of supporting 40GbE. A wide variety of other ports speeds are available, but not every port has the same set of combinations.

The 7280QRA-C36S architecture leverages of 2 high performance Packet Processors, each enabling up to 18 ports of 40G and 720Mpps. All 36 ports support 40GbE mode, and can additionally support a range of speed choices.

To maximize the deployment flexibility it is important to understand the supported port speed combinations in order to select the combination that best meets the DC requirements.

Depending on the underlying port capability each interface is capable of one or more speeds. The default speed for odd interfaces numbered 7, 9, 11 and 25, 27, 29 is 100G, for the rest of the ports the default speed is set to 40GbE. The following table lists the interface speeds that are available for each port.

Speed

Applicable Ports

Notes

40GbE

1-36

All 36 Ports

100GbE

7,9,11,13,15,17,19,21,23,25,27,29

A maximum of 12

10GbE**

1-12,13,15,17,19,21,23,25-36

30 ports are 4x10G capable

25GbE**

7,9,11,13,15,17,19,21,23,25,27,29

100G ports support 4x25G mode

50GbE**

7,9,11,13,15,17,19,21,23,25,27,29

100G ports support 2x50G mode

 

1

3

5

7

9

11

13

15

17

19

21

23

25

27

29

31

33

35

40G or 4x10G

40G or 4x10G

40G or 4x10G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

100G / 2x50G / 4×25/10G / 40G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

Disable or 40G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

40G or 4x10G

2

4

6

8

10

12

14

16

18

20

22

24

26

28

30

32

34

36

7280QRA-C36S Port Layout

** NOTE: Prior to Release 4.21.3F, breakout is not supported on the following ports, 13,15,17,19,21,23. These ports can only run at 1x40GbE and 1x100GbE. This restriction no longer exists in 4.21.3F and later EOS versions.

From the table and the port layout diagram the following is observed.

  • Odd numbered ports 7-29 (inclusive) are capable of operating as 100GbE and in turn supporting a choice of 10/25/50/100GbE mode.

  • As each odd numbered port between 13-24 (inclusive) are set to 100G, 4×10/25 or 2x50GbE speeds the adjacent even numbered port is disabled. For example, port 13 is set to 100GbE, port 14 will be disabled, and if port 23 is configured for 4x10G, port 24 is disabled. Only when the odd ports between 13-23 (inclusive) are set to operate at 40GbE is the partner even port enabled and can operate at 40GbE only.

The 7280QRA-C36S is optimized for deployment in a mixed 10/40/100G environment, with 6 x 100G ports and the remaining 30 ports all active, and allowing for a choice of 4x10G and 1x40G port combinations. Adding more 100G ports reduces the available 40G ports, but increases the overall system throughput.

With the above guidelines in mind these are a few examples of port combinations that the 7280QRA-C36S is capable of, depending on the software support

  • 36x40G (all ports active)

  • 30x40G, 6x100G (all ports active and default)

  • 18x40G, 12x100G (total of 30 ports and maximum performance)

  • 96x10G, 12x40G (maximum 10G with all ports active)

  • 120x10G (maximum 10G density with 30 ports active in 4x10G mode)

Use Case 1: Set Port 7/1 defaults at 100G:

!!! Initially port 7/1 is set to default speed, 1000G !!!

 

7280QRA-C36S#show interfaces status

<<<<<<<<< Truncated Output >>>>>>>>>

   

Et6/1                     notconnect   1        full   40G    Not Present       

Et7/1                     notconnect   1        full   100G  Not Present       

Et8/1                     notconnect   1        full   40G    Not Present       

Use Case 2: Setting a port to 100G, which disables the partner port:

!!! Initially port 13/1 is set to default speed, 40G and port 14.1 is available for use  !!!

 

7280QRA-C36S#show interfaces status

<<<<<<<<< Truncated Output >>>>>>>>>

   

Et13/1                    notconnect   1        full   40G    Not Present

Et14/1                    notconnect   1        full   40G    Not Present

Et15/1                    notconnect   1        full   40G    Not Present   

 

!!! Setting port 13/1 to 100G, see below that port 14/1 is no longer available to use !!!

 

7280QRA-C36S(config-if-Et13/1)#speed forced 100gfull

 

7280QRA-C36S#show interfaces status

<<<<<<<<< Truncated Output >>>>>>>>>

 

Et13/1                    notconnect    1        full   100G   Not Present      

Et15/1                    notconnect   1        full   40G    Not Present      

 

Use Case 3: Splitting 40G ports into 4x10G:

!!! Initially port 1/1 is set to default speed, 40G !!!

 

7280QRA-C36S#show interfaces status

<<<<<<<<< Truncated Output >>>>>>>>>

   

Et1/1                     notconnect   1        full   40G    Not Present       

Et2/1                     notconnect   1        full   40G    Not Present  

!!! After splitting port 1/1 to 4x10G, see below

 

7280QRA-C36S(config-if-Et1/1)#speed forced 10000full

 

7280QRA-C36S#show interfaces status

<<<<<<<<< Truncated Output >>>>>>>>>

 

Et1/1                     notconnect   1        full   10G    Not Present       

Et1/2                     notconnect   1        full   10G    Not Present       

Et1/3                     notconnect   1        full   10G    Not Present       

Et1/4                     notconnect   1        full   10G    Not Present       

Et2/1                     notconnect   1        full   40G    Not Present     

The 7280QR-C72 and 7280QRA-C36S are high density systems with the capability to support a wide range of port speeds and a broad set of combinations. Port capability is enabled per port allowing for a high degree of flexibility. In some scenarios with 1x100G modes enabled adjacent ports are unavailable, and this can influence the selection of which ports are used for 40G modes. Similarly not all ports can be broken into 4x10G mode.

Follow

Get every new post on this blog delivered to your Inbox.

Join other followers: