Thanks. I got him to check again, and they're Rev B. Photo shows two fans but I think only 1 PSU, and he's confirmed they're PoE rear exhaust with the rails included, so I've just taken one for £150; I suspect I could have gone lower, given how quickly he accepted. There are another 34 available at the moment...Here is a picture of the REV A and B psu that I have. The REV B is labeled "MREV 04" and the A is "MREV 03". Its still possible that the MREV isn't directly tied to the revision (Could be batch or inspection date or manufacture year or just about anything) You should still ask just to be safe
make sure you can ping your tftp server, just run "ping 192.168.1.110" from the same bootloader prompt. if you're on windows I would turn off the windows firewall, it always gets in the way of tftpI'm running the updates on my 6610 and while runningit will transfer for a bit (5mins-30mins) and then I getCode:
copy tftp flash 192.168.1.110 FCXR08030t.bin primary
Is there something I'm missing ?Code:
TFTP: received error request -- code 0
your switch is fine, the 7750 doesn't use big fan connectors like you're used to seeing, it uses the PCB, think of a PCI connector. that big blank looking tab in the middle has contacts on the bottom of it. as for the PSU, I have no clue. If it's the same exact model number and formfactor, then yes it should workDoes anyone have a working icx7750?
I snag one on ebay but it doesn't come with fans or power supply so I'm on the hunt for these parts.
About the power supply - the part number is RPS9+E (rear exhaust) or RPS9+I (side-port)
Will the RPS9 Net Iron power supply works the same?
Also, compared to the icx6610 - the fan headers are missing... did the fan header broke off?
View attachment 15987
I cant make anything larger than 1500 MTU to work, I gave up, sadly Perhaps I have something wrong, but this seems that just doesn't work.I'm looking to pick up this ICX 6610 switch but a few posts above says they had issues with vLAN and MTU working properly? This has me worried.
I plan to hook up a ESXi host with vSAN, vMotion, and LAN traffic running through a single 40GbE port on different vLANs on a mellanox connectX-4 NIC, and trunking it to the 40GbE port on this switch. Will this be of any issues?
did you run the "ip mtu 9000" command on the ve assigned to that vlan? should work fine. if you're trying to do it just on a per port basis I believe you'll need to run the layer2 only firmwareI cant make anything larger than 1500 MTU to work, I gave up, sadly Perhaps I have something wrong, but this seems that just doesn't work.
double checking this on mine, just running "jumbo" globally on the layer 3 routing firmware and rebooting, ports are now set to 10200 and I can pass jumbo frames between them. if you're using VEs for routing, running "ip mtu" on the VE only affects layer3 traffic getting routed through that VE (eg the layer2 ports themselves will still have an MTU of 10200 or whatever). was there a specific issue or use case you were trying to do that didn't work?I cant make anything larger than 1500 MTU to work, I gave up, sadly Perhaps I have something wrong, but this seems that just doesn't work.
All I did was run 'jubmo and reload on layer 3 routing fw too, all ports are now set to 10200. I dont have any VE, I just tried with a vlan with 2 ports, connecting two MTU9000 esxi vkernel vswitches. I can't ping from esxi (vmkping) with large frames to other one. If I connect them directly with a cable it works.double checking this on mine, just running "jumbo" globally on the layer 3 routing firmware and rebooting, ports are now set to 10200 and I can pass jumbo frames between them.
strange, what frame size are you trying? After setting jumbo and reloading I can pass 9000byte framesAll I did was run 'jubmo and reload on layer 3 routing fw too, all ports are now set to 10200. I dont have any VE, I just tried with a vlan with 2 ports, connecting two MTU9000 esxi vkernel vswitches. I can't ping from esxi (vmkping) with large frames to other one If I connect them directly with a cable it works.
You cannot set per-interface MTU on anything that is not VRF capable, period. The documentation is just wrong about that.I have MTU set to 9000 on both esxi, interestingly when connected with direct cable, I get 840Mb/s NFS disk transfer speed, with MTU 1500 it drops to 340Mb/s or so, therefore I want to use this. I will go and recheck again...
btw, is there a quick way to set all of the rest interfaces to MTU1500, or do I have to do it one by one?
# Untagged VLAN DHCP # The tag names (home,vlan11) are purely visual for you. # The dhcp range/options used will be based on whether the ICX switch relayed a DHCP request or not # (in which case it embeds the source VLAN's subnet! that is where the magic happens) dhcp-range=home,10.10.1.100,10.10.1.240,255.255.255.0,12h dhcp-option=home,option:router,10.10.1.1 dhcp-option=home,option:dns-server,10.10.1.8 dhcp-option=home,option:domain-search,BLAH.ca # A single VLAN (11) # Note you do NOT 'configure' the VLAN, you just configure the DHCP range and it will sort itself out dhcp-range=vlan11,10.11.1.100,10.11.1.240,255.255.255.0,12h dhcp-option=vlan11,option:router,10.11.1.1 dhcp-option=vlan11,option:dns-server,10.10.1.8 dhcp-option=vlan11,option:domain-search,BLAH.ca
# If you have NOT configured any VLANs before and need to enable dual-mode # (because you want to send untagged vlan1 or another vlan as WELL as tagged traffic) # you need to configure each interface with dual-mode, e.g.: interface eth 1/2/4 dual-mode # done # Create VLAN 11 and tag interfaces vlan 11 vlantest tagged ethernet 1/2/1 to 1/2/4 router-interface ve 11 # Assign ve11 as the default route interface ve 11 ip address 10.11.1.1/24 ip helper-address 1 10.10.1.8
# Change ve1's IP and default route interface ve 1 no ip address 10.10.1.19/24 ip address 10.10.1.1/24 # (You need this if your DHCP server is on a different VLAN) # (If it's the same VLAN, don't sweat it and you can omit this.) ip helper-address 1 10.10.1.8 # Change the default route to the new firewall exit no ip route 0.0.0.0/0 10.10.1.1 ip route 0.0.0.0/0 10.10.1.4
$ traceroute 10.11.1.223 traceroute to 10.11.1.223 (10.11.1.223), 64 hops max 1 10.10.1.1 1.764ms 1.757ms 0.762ms 2 10.11.1.223 1.025ms 0.222ms 0.119ms
# ./iperf3 -c 10.10.1.12 --bidir Connecting to host 10.10.1.12, port 5201 [ 6] local 10.11.1.223 port 51624 connected to 10.10.1.12 port 5201 [ 8] local 10.11.1.223 port 51626 connected to 10.10.1.12 port 5201 [ ID][Role] Interval Transfer Bitrate Retr Cwnd [ 6][TX-C] 0.00-1.00 sec 1.01 GBytes 8.67 Gbits/sec 301 413 KBytes [ 8][RX-C] 0.00-1.00 sec 1001 MBytes 8.39 Gbits/sec [ 6][TX-C] 1.00-2.00 sec 954 MBytes 8.01 Gbits/sec 0 721 KBytes [ 8][RX-C] 1.00-2.00 sec 962 MBytes 8.07 Gbits/sec [ 6][TX-C] 2.00-3.00 sec 1.05 GBytes 9.02 Gbits/sec 26 758 KBytes [ 8][RX-C] 2.00-3.00 sec 1.04 GBytes 8.93 Gbits/sec [...] - - - - - - - - - - - - - - - - - - - - - - - - - [ ID][Role] Interval Transfer Bitrate Retr [ 6][TX-C] 0.00-10.00 sec 10.1 GBytes 8.64 Gbits/sec 1026 sender [ 6][TX-C] 0.00-10.00 sec 10.1 GBytes 8.63 Gbits/sec receiver [ 8][RX-C] 0.00-10.00 sec 10.1 GBytes 8.67 Gbits/sec 0 sender [ 8][RX-C] 0.00-10.00 sec 10.1 GBytes 8.67 Gbits/sec receiver
I'll try using the RPS9 power supply for broacade net-iron - the connector appears to be the same but can't seems to find affordable fans refurbished or new anywhere...If you're lucky, you might find a set of fans for the 7750 for $600-$650 (for 4); I often see them listed at $150/ea. I passed up several opportunities for a cheap 7750 because when I added up the cost of finding PSUs and fans, it often equaled or exceeded just getting it with everything from a different seller. At this point, I've about given up hope of seeing a -48F for a reasonable price and am contemplating a -26Q and doing passive breakouts to a fiber patch, or 40G MPO SR or LR to a splitter for the breakout. Only reason I'm eyeing the 7750 over a 6610 is that I want to use the campus fabric feature and turn my 7150's into port extenders and have a single management interface.
hmm, I've removed the boards without much issue, nothing should be riveted - you have to unscrew and remove the silver standoffs, they're holding the board downFirst post here - love this community already and lots of helpful posts on modding for less noise. Have to run a small lab for VMware certs out of my home office and replacing a stack of 3750s with a 7250-48p and 8x licensed 10Gb ports. Already that is quieter, but not enough for me to be happy yet. I've read all of the fan mod threads multiple times and essentially it seems that there's a comedy of issues with the fan mods leading to people using wood screws to wedge fans on top of the ASIC heatsink to cool it down after putting in slower fans - otherwise the system might ramp up to speed 2 indefinitely or might switch between speed 1 and speed 2 relentlessly since slower fans move less air and cause the ASIC to go to speed 2. Top this with the fact that it sounds like the board itself requires a minimum RPM to boot and you can either put in fans that meet this RPM or you can spoof the signal - which is also quite tedious.
Annoyed slightly by this issue, I started thinking about re-applying thermal paste - because I didn't quite understand how my switch could idle at 58C on the ASIC with 68-70F ambient temps when I literally only had a serial cable plugged into it and nothing else. I think the thing deterring people from doing this is that it's very difficult to do without damaging the switch. The heat sink is mounted with push pins that typically require you to have access to the other side of the board to get them out. Once the pins are in, they're not coming out without some serious persuasion.
So I tried to take the circuit board out only to find that it's literally riveted to the switch chassis and practically impossible. What followed was almost 60 minutes of me trying to get these things out without damaging the circuit board. I think I may have been successful overall. I had to remove everything down to the board to work in the space. Small warning- the fins arekind of edgy - I sliced my finger tips twice getting this out proceeded by dousing them in alcohol when I was cleaning the junk off the heatsink/asic.
View attachment 15993
And what I found is in my opinion utter stupidity. If you've applied thermal compound to a heat sink before, you know that the best practice is a very thin layer of compound to aid the transmission of heat. Too thick and you lose effectiveness. CPUs call for a compound the size of a grain of rice. What I found left me dumbfounded that this is how this equipment was designed. Perhaps I'm missing some of the finer details of enterprise switching...?
View attachment 15994
View attachment 15995
Board after the fact - you can see a little scratching around the holes, but that should be fine given they're no circuitry there.
View attachment 15996
So I'm in a spot where I'd like to put a better heatsink on here - preferably one with a small fan integrated. The problem is that the heatsink literally doesn't have a part number and I cannot find any reference for the size / compatibility. I measure it to be approx 65mmx70mm 10mm fins and 2 push-pin mounts. There's nothing out there that fits the bill ... everything on digi and a few other sites are mostly square.
So I might just have to reapply paste and mount the heatsink. I think I have to replace the push-pins as I kind of mangled them getting them out - not really an issue as they're cheap I believe 3MM, and I can put slightly stronger springs on them this time around if I have to go that direction to improve contact with the ASIC.
Anyone know where I can get specs on this heatsink? I imagine re-applying good paste to the heatsink (like MX4 thermal compound or ceramique) could go a long ways here to improving temperatures given the previous situations.
Interesting - maybe I just need more torque - They just seemed quite resistant and when I looked at the bottom of the chassis, there were rivets beneath each and the soldering around it on the board gave me pause. So you're saying that these pegs can be removed?hmm, I've removed the boards without much issue, nothing should be riveted - you have to unscrew and remove the silver standoffs, they're holding the board down