Help! :) Quanta D51B-2U fan control via BMC / IPMI2.0 commands?

[Fritz]

0x64 = dez 100
0x24 = dez 36
0x16 = dez 22

be careful. there are some small chips on server mboards without thermal sensors which can overheat.

It's winter so overheating isn't a problem right now but I'll have to keep an eye on it come the summer. All temps are good at this point. The CPU temps could be a bit lower but my ears are o so happy. The dual 80mm fans this server uses have got to be the absolute worst server cooling solution of all time.

 

[RolloZ170]

All temps are good at this point.

the ASPEED chip gets to hot without airflow.

 

[Fritz]

the ASPEED chip gets to hot without airflow.

So how much air flow does it need?

 

[RolloZ170]

So how much air flow does it need?

hard to say. in a typical server environment there is many airflow.
you can put a heatsink on it.

 

[Fritz]

hard to say. in a typical server environment there is many airflow.
you can put a heatsink on it.

Just ordered a bunch of copper heatsinks. They should help.

 

[timpouce84]

Hi everyone,

I tried command ipmitool raw 0x30 0x39 0x01 0x0 0x0 0x16 to change fan speed on my QuantaPlex T41S-2U blade, but it has no effect although no error is thrown.
Does someone was able to change fan speed on QuantaPlex T41S-2U ?

A lot of commands from http://www.staroceans.org/e-book/S2B IPMI Commands.pdf are running as expected.

Thanks for your help.
Best,

Tim.

 

[Fritz]

Hi everyone,

I tried command ipmitool raw 0x30 0x39 0x01 0x0 0x0 0x16 to change fan speed on my QuantaPlex T41S-2U blade, but it has no effect although no error is thrown.
Does someone was able to change fan speed on QuantaPlex T41S-2U ?

A lot of commands from http://www.staroceans.org/e-book/S2B IPMI Commands.pdf are running as expected.

Thanks for your help.
Best,

Tim.

This is what works for me. Substitute your info where appropriate.

#!/bin/sh
ipmitool -I lanplus -H 192.168.10.233 -U admin -P admin raw 0x30 0x39 0x01 0x0 0x0 0x16
ipmitool -I lanplus -H 192.168.10.233 -U admin -P admin raw 0x30 0x39 0x01 0x0 0x1 0x16
ipmitool -I lanplus -H 192.168.10.233 -U admin -P admin raw 0x30 0x39 0x01 0x0 0x2 0x16
ipmitool -I lanplus -H 192.168.10.233 -U admin -P admin raw 0x30 0x39 0x01 0x0 0x3 0x16

 

[timpouce84]

Hi,

Thanks for your answer, in fact there is no reply like it's fine, but it has no effect (I removed fan #3 and #4 from the chassis as it's too much noisy and blades 3 & 4 are powered off):
ipmitool -I lanplus -H 192.168.X.X -U admin -P ***** sdr type fan
Fan_SYS0_0 | C0h | ok | 29.1 | 6700 RPM
Fan_SYS0_1 | C1h | ok | 29.1 | 5700 RPM
Fan_SYS1_0 | C2h | ok | 29.2 | 7000 RPM
Fan_SYS1_1 | C3h | ok | 29.2 | 5800 RPM
Fan_SYS2_0 | C4h | ns | 29.3 | No Reading
Fan_SYS2_1 | C5h | ns | 29.3 | No Reading
Fan_SYS3_0 | C6h | ns | 29.4 | No Reading
Fan_SYS3_1 | C7h | ns | 29.4 | No Reading
Fan_SYS0_Present | 20h | ok | 29.16 | Device Present
Fan_SYS1_Present | 21h | ok | 29.17 | Device Present
Fan_SYS2_Present | 22h | ok | 29.18 |
Fan_SYS3_Present | 23h | ok | 29.19 |

Then apply a fan speed change:
ipmitool -I lanplus -H 192.168.X.X -U admin -P ***** raw 0x30 0x39 0x01 0x0 0x1 0x16
< blank return>
ipmitool -I lanplus -H 192.168.X.X -U admin -P ***** raw 0x30 0x39 0x01 0x0 0x2 0x16
< blank return>
ipmitool -I lanplus -H 192.168.X.X -U admin -P ***** raw 0x30 0x39 0x01 0x0 0x3 0x16
< blank return>
ipmitool -I lanplus -H 192.168.X.X -U admin -P ***** raw 0x30 0x39 0x01 0x0 0x4 0x16
< blank return>

Checking again fan speed:
ipmitool -I lanplus -H 192.168.X.X -U admin -P ***** sdr type fan
Fan_SYS0_0 | C0h | ok | 29.1 | 6700 RPM
Fan_SYS0_1 | C1h | ok | 29.1 | 5700 RPM
Fan_SYS1_0 | C2h | ok | 29.2 | 7000 RPM
Fan_SYS1_1 | C3h | ok | 29.2 | 5800 RPM
Fan_SYS2_0 | C4h | ns | 29.3 | No Reading
Fan_SYS2_1 | C5h | ns | 29.3 | No Reading
Fan_SYS3_0 | C6h | ns | 29.4 | No Reading
Fan_SYS3_1 | C7h | ns | 29.4 | No Reading
Fan_SYS0_Present | 20h | ok | 29.16 | Device Present
Fan_SYS1_Present | 21h | ok | 29.17 | Device Present
Fan_SYS2_Present | 22h | ok | 29.18 |
Fan_SYS3_Present | 23h | ok | 29.19 |

I suppose there is some fan speed auto control that should be applied first but I didn't find any resource for that.
I tried same command as found on this video:

ipmitool -I lanplus -H 192.168.X.X -U admin -P ***** raw 0x30 0x30 0x01 0x0
Unable to send RAW command (channel=0x0 netfn=0x30 lun=0x0 cmd=0x30 rsp=0xc1): Invalid command

Not a big suprise as the video is about a Dell R510...

The main difference with you @Fritz is that I'm dealing with an older generation of Qt server: T41S-2U.
I would probably need to open a separate thread for this one and mention this post to refer the documentation and commands that looks similar to my needs.

Thanks again for helping me.

Tim.

 

[Fritz]

Good luck. I rarely fired mine up before I stumbled upon the above mentioned commands. Those double 8mm fans are fans from hell. Unless set to the lowest speed they are intolerable. Quanta really should have added fan control to the BIOS or IPMI. I won't be buying any more quanta servers because of the fans.

And also, the fan settings above do not survive a complete power down. You have to issue them every time power to the server is cut.

 

[timpouce84]

Thanks for trying to help me.
I will probably try to replace the fans by silent Noctua limited to ~2000RPM but I need to manage the cabling.

 

[Jubacho]

@Fritz Did you manage to turn down the PSU Fans as well ?

Thanks

 

[Fritz]

@Fritz Did you manage to turn down the PSU Fans as well ?

Thanks

Nope, once the fan wall was tamed I saw no need to lower the PSU fans. It can't be heard beyond the room it's in.

 

[Jubacho]

Ok ok! I see the sensors as Fan_PSU1 and Fan_PSU2 when doing ipmitool sdr type Fan but I can't find the ipmitool raw command to adjust speeds. 13000RPM is super loud!!

 

[RolloZ170]

Ok ok! I see the sensors as Fan_PSU1 and Fan_PSU2 when doing ipmitool sdr type Fan

are you sure the PSU fans can be adjusted by the motherboards BMC ?
if yes i wonder why some SM owners buy SQ PSUs instead of setting the PSU FAN speed down...

 

[Jubacho]

are you sure the PSU fans can be adjusted by the motherboards BMC ?
if yes i wonder why some SM owners buy SQ PSUs instead of setting the PSU FAN speed down...

Oh right that's a good point I didn't know that. I have the D51PH-1ULH, really nice specs but documentation is pretty limited. I'll check in their parts list to see if they sell a quiet PSU version to give me an idea.

 

[RolloZ170]

but I can't find the ipmitool raw command to adjust speeds. 13000RPM is super loud!!

note the PSU FANs are for cooling the PDB and the Unit behind the PSUs too. the 1U servers run in server rooms and it doesn't matter if they're loud.

 

[JunctionRunner]

Bit of a necro but I have a D51PH-1ULH, and yeah, wow the PSU fans running full tilt (maybe) are pretty damn bad...

I've had success with impitool to control the first six fans, but anything beyond that I get errors.

ipmitool -H 172.16.1.122 -U rescue -P quantarescue 0x30 0x39 0x01 0x0 0x0 0x64 set fan 0 to 100% (0x64)
ipmitool -H 172.16.1.122 -U rescue -P quantarescue 0x30 0x39 0x01 0x0 0x1 0x64 set fan 1 to 100% (0x64)

but, if I try fan 0x6 and up, and I get the following response:

Unable to send RAW command (channel=0x0 netfn=0x30 lun=0x0 cmd=0x39 rspc=0xcc): Invalid data field in request.


Does anyone know how to control the other six mainboard area fans? The main thing though, is can we control the psu fans to drop them down a bit? According to a similar part number these things are maybe capable of 27krpm, so this might be running them a little over half duty cycle?

A fan swap is my only other consideration, but the stock fans, again if the slight variant on the number is accurate, are pushing 31.x cfm. Arctic cooling's 6k ones are only 7.x cfm, and the 15k fans are a little over 20cfm. The fans are way slower at idle but I don't know if the tach signal is the only thing the motherboard gets or if it could possibly control the speed too?

I don't want to swap them all the way down to 7cfm for sure considering they are cooling the power and sas expander boards but there must be a midway point.


Any way to get ipmitools to spit out all the fan addresses or something? There's that second collumn of c0h, c8h, etc, but I don't know how to turn that into the hex address to control the fans beyond number 6

edit: Ok, right so I can do verbose output, that gives me a lot more info on the fans, which I'll trim down to the relevant stuff.

Sensor ID              : Fan_SYS0_1 (0xc0)
Entity ID             : 29.1 (Fan Device)

Sensor ID              : Fan_SYS0_2 (0xc1)
Entity ID             : 29.2 (Fan Device)

Sensor ID              : Fan_SYS1_1 (0xc2)
Entity ID             : 29.3 (Fan Device)

Sensor ID              : Fan_SYS1_2 (0xc3)
Entity ID             : 29.4 (Fan Device)

Sensor ID              : Fan_SYS2_1 (0xc4)
Entity ID             : 29.5 (Fan Device)

Sensor ID              : Fan_SYS2_2 (0xc5)
Entity ID             : 29.6 (Fan Device)

Sensor ID              : Fan_SYS3_1 (0xc6)
Entity ID             : 29.7 (Fan Device)

Sensor ID              : Fan_SYS3_2 (0xc7)
Entity ID             : 29.8 (Fan Device)

Sensor ID              : Fan_SYS4_1 (0xc8)
Entity ID             : 29.9 (Fan Device)

Sensor ID              : Fan_SYS4_2 (0xc9)
Entity ID             : 29.10 (Fan Device)

Sensor ID              : Fan_SYS5_1 (0xca)
Entity ID             : 29.11 (Fan Device)

Sensor ID              : Fan_SYS5_2 (0xcb)
Entity ID             : 29.12 (Fan Device)

Sensor ID              : Fan_PSU1 (0xcc)
Entity ID             : 10.1 (Power Supply)

Sensor ID              : Fan_PSU2 (0xcd)
Entity ID             : 10.2 (Power Supply)

So, 0xcc and 0xcd are the two power supply fans, or converted to decimal, 204 and 205

but if I try to send a command to lower those fans I get this error.

Running Get PICMG Properties my_addr 0x20, transit 0, target 0
Error response 0xc1 from Get PICMG Properities
Running Get VSO Capabilities my_addr 0x20, transit 0, target 0
Invalid completion code received: Invalid command
Discovered IPMB address 0x0
RAW REQ (channel=0x0 netfn=0x30 lun=0x0 cmd=0x39 data_len=4)
RAW REQUEST (4 bytes)

Maybe I'm missing something obvious and ipmitool seems to get... finnicky at random, maybe after putting in improper commands it locks it out, not sure as it's the first time messing with this for me, but maybe I'm missing something obvious.

You can't send 0xc0 to control fan 0, it has to drop the c, and year, above 5 it also doesn't work no matter what, but the question is why, what is it looking for instead. There must be some sort of simple conversion thing somebody with more knowledge has.

 

[RolloZ170]

Bit of a necro but I have a D51PH-1ULH, and yeah, wow the PSU fans running full tilt (maybe) are pretty damn bad...

the PSU FANs are NOT connected to motherboard PWM circuits.

but if I try to send a command to lower those fans I get this error.

try to set the Temp sensors of the CPU to something lower, not working because this is a one way.

 

[JunctionRunner]

the PSU FANs are NOT connected to motherboard PWM circuits.

try to set the Temp sensors of the CPU to something lower, not working because this is a one way.

Ah, ok, so the second rotor in each dual fan is only dependent on temperature (or that power up test) and there's no way to individually access it through impi except the tach reading? Bugger.

I guess this, and the confirmation about the psu fans then saves me head scratching even more, and it's going to take hardware modification to reduce the volume of those. That or if there is a compatible quieter model of psu.

Bugger, felt like I was really close to cracking it.

 

[RolloZ170]

Ah, ok, so the second rotor in each dual fan is only dependent on temperature (or that power up test) and there's no way to individually access it through impi except the tach reading? Bugger.

i had max. FAN running on Intel and Dell servers, but after PSU FW update and/or FRU/SDR update they get silent(as they can be)
sometimes there is a critical sensor event issueing the FANs running high RPM.