Suggestion for cheap ToR switch 25GbE with some 100GbE ports

[Rand__]

sudo portconfig -p Ethernet124 -s 100000 -f rs

was the command I ran I think

 

[Scott Laird]

This didn't work at first, but it popped to life later, presumably after either a config reload or reboot. Thanks!

 

[Rand__]

Excellent, glad that helped.
Still can't believe how much time (and money) I spent searching before I found that that simple stupid command

 

[vangoose]

I finally got an Arista DCS-7060cs-32s, getting 2 Noctuas fan to mod the psu fans. also ordering some 100g to 25g breakout cables from fs. Hopefully it will work as expected.

Then I should be able to get rid of tons of 10G switches.
ICX 6650
ICX 6450-24
ICX 7250-24
ICX 7250-24P *2

 

[Rand__]

nice

 

[vangoose]

My arista just arrived, quite surprised since it's shipped yesterday.
However, the fans and cables will take a few more days to arrive.

 

[Rand__]

What price range are these in?

 

[vangoose]

What price range are these in?

1700, not cheap but I should get some $ backup from the ICX.
It should also allow me to do all the tests I need. iser, nvmeof, nsx, calico.

 

[Rand__]

Not too bad for a brand name switch

Also - whats calico?

 

[vangoose]

Kubernetes cni using bgp

 

[Rand__]

never heard of it, but then I am not into containers

 

[vangoose]

Turned it on, EOS version is 4.21.2.3F, I thought it had 4G ram but it comes with 8. Manufacturing date seems to Oct 2017.

localhost#sh ver
Arista DCS-7060CX-32S-F
Hardware version: 12.01
Serial number:
System MAC address: fcbd.677d.859d

Software image version: 4.21.2.3F
Architecture: i386
Internal build version: 4.21.2.3F-12902392.42123F
Internal build ID: fc996a6a-ce10-4309-b432-60a5738bc4b7

Uptime: 0 weeks, 0 days, 0 hours and 9 minutes
Total memory: 7916784 kB
Free memory: 6702024 kB


On boot, when fans run at full speed, it's like jet engine. Set fan speed to 30, measure from sound meter in ios, it's 53db from 1 cm, same as my 4 ICX 7250 stack together. Definitely not bad at all without fan mod, it will be in a separate room.
PSU fan speed comes down with overwrite as well.

localhost(config)#show environment all
System temperature status is: Ok
                                                                 Alert  Critical
                                               Temp    Setpoint  Limit     Limit
Sensor  Description                             (C)         (C)    (C)       (C)
------- ----------------------------------- ------- ----------- ------ ---------
1       Cpu temp sensor                        42.8   (60) 61.2     90        95
2       Cpu board temp sensor                  39.0   (55) 56.2     75        80
3       Back-panel temp sensor                 34.5   (50) 51.2     75        85
4       Board sensor                           35.0   (55) 56.2     65        75
5       Front-panel temp sensor                28.0   (55) 56.2     65        75
6       Switch chip right sensor               38.0   (55) 56.2     95       105
7       Switch chip left sensor                38.8   (55) 56.2     95       105
8       Tomahawk top left outer sensor         50.1   (80) 81.2    100       110
9       Tomahawk top right outer sensor        49.1   (80) 81.2    100       110
10      Tomahawk bottom right outer sensor     48.6   (80) 81.2    100       110
11      Tomahawk bottom left outer sensor      46.7   (80) 81.2    100       110
12      Tomahawk top outer sensor              48.2   (80) 81.2    100       110
13      Tomahawk left inner sensor             48.6   (80) 81.2    100       110
14      Tomahawk bottom inner sensor           46.7   (80) 81.2    100       110
15      Tomahawk bottom outer sensor           46.7   (80) 81.2    100       110

PowerSupply 1:
                                                                 Alert  Critical
                                               Temp    Setpoint  Limit     Limit
Sensor  Description                             (C)         (C)    (C)       (C)
------- ----------------------------------- ------- ----------- ------ ---------
1       Hotspot temperature sensor             41.0   (80) 81.2     95       100
2       Inlet temperature sensor               29.0   (55) 56.2     70        75

PowerSupply 2:
                                                                 Alert  Critical
                                               Temp    Setpoint  Limit     Limit
Sensor  Description                             (C)         (C)    (C)       (C)
------- ----------------------------------- ------- ----------- ------ ---------
1       Hotspot temperature sensor             40.0   (80) 81.2     95       100
2       Inlet temperature sensor               29.0   (55) 56.2     70        75

System cooling status is: Ok
Ambient temperature: 28C
Fan speed override mode enabled at 30%
Airflow: port-side intake
                      Config Actual           Speed   Stable
Fan            Status  Speed  Speed  Uptime Stability  Uptime
-------------- ------ ------ ------ ------- --------- -------
1/1            Ok        30%    29% 0:19:29 Stable    0:15:07
2/1            Ok        30%    29% 0:19:29 Stable    0:15:07
3/1            Ok        30%    30% 0:19:29 Stable    0:15:07
4/1            Ok        30%    29% 0:19:29 Stable    0:15:05
PowerSupply1/1 Ok        30%    33% 0:19:19 Stable    0:14:38
PowerSupply2/1 Ok        30%    33% 0:19:19 Stable    0:14:38

Power                        Input  Output  Output
Supply Model       Capacity Current Current  Power Status  Uptime
------ ----------- -------- ------- ------- ------ ------ -------
1      PWR-500AC-F     500W   0.62A   4.82A  58.5W Ok     0:19:19
2      PWR-500AC-F     500W   0.67A   5.21A  63.2W Ok     0:19:19
Total  --             1000W      --      -- 121.8W --          --