Are Tyan Boards Any Good?

zer0sum

Active Member
Mar 8, 2013
389
144
43
Bear in mind that this will only change the thresholds for when a fan low/high assert is triggered, it's not actually fan control. If it's possible to do fan control via ipmitool you'd need to know what raws the Tyan uses to control those values - asrock as supermicro use different raws even on the exact same BMC chipset so I wouldn't be surprised if Tyan was different still.
That's why I linked the thread with all the details :)
If someone can find out the Tyan zones it should be easy to assign pwm settings to each zone.

For example on an SM board:

#set fan mode to "full"
ipmitool raw 0x30 0x45 0x01 0x01
#set fans in "system" zone to 37.5%
ipmitool raw 0x30 0x70 0x66 0x01 0x00 0x24
#set fans in "peripheral" zone to 25%
ipmitool raw 0x30 0x70 0x66 0x01 0x01 0x16
 

hmw

Active Member
Apr 29, 2019
235
77
28
@jpmomo - what fan and heatsink do you have? I have the Supermicro 4U with PWM and I get a constant 1900RPM at 30% duty cycle. It doesn't vary
 

jpmomo

Member
Aug 12, 2018
99
30
18
I have tested with a couple of different configurations. The one from the ss above is a noctua nh u9 tr4. I use these servers with a proprietary app that enables dpdk on the VMs and sets the CPU to 100%. This causes the temps to go up which in turn causes the fans to spin up.
 

hmw

Active Member
Apr 29, 2019
235
77
28
@jpmomo

Right now I am running Prime 95 on a Windows VM with half the vCPUs available

The BIOS is set to exactly your settings - and here's my screenshots

You can see the CPU go from 35c to 65c
Screen Shot 2020-06-02 at 8.59.40 PM.png

If you look at the CPU fan - it is constant (and I just updated the BIOS and the BMC firmware and rebooted)

Screen Shot 2020-06-02 at 8.59.49 PM.png

A closer look at the fan speed - no variation

Screen Shot 2020-06-02 at 9.00.05 PM.png

ALL the fans in the system are PWM - so I can believe ONE of them is not working. But all of them being constant speed? 1700 RPM and 900 RPM?
 

jpmomo

Member
Aug 12, 2018
99
30
18
What type of CPU cooler are you using? Your temps don't look that high. My fan didn't kick in until I got past 70. Which CPU are you using? I currently have a 7742. If you are running VMware, check the overall host CPU utilization.
 

hmw

Active Member
Apr 29, 2019
235
77
28
What type of CPU cooler are you using? Your temps don't look that high. My fan didn't kick in until I got past 70. Which CPU are you using? I currently have a 7742. If you are running VMware, check the overall host CPU utilization.
I have 80% CPU util on VMWare and 100% on the host Prime95 is running on

CPU cooler is Supermicro SNK 64 with a 92mm PWM fan
 

hmw

Active Member
Apr 29, 2019
235
77
28
Weird - I have 100% utilization on the ESXi host and I STILL cannot get above 68c !


Screen Shot 2020-06-02 at 10.58.22 PM.png Screen Shot 2020-06-02 at 10.59.55 PM.png
 

hmw

Active Member
Apr 29, 2019
235
77
28
Did you set any cTDP or TDP in the bios?
I had set at 180W for cTDP and Package Power - but I cleared it for the current test. In any case I figured out the problem (it's a good one): With the supermicro heatsink and this weird 7302P, the temps were just not getting high enough for the Tyan fan 'control' to kick in. And it's a hot day (and night) in California !
 
Last edited:

zer0sum

Active Member
Mar 8, 2013
389
144
43
I had set at 180W for cTDP and Package Power - but I cleared it for the current test. In any case I figured out the problem (it's a good one): With the supermicro heatsink and this weird 7302P, the temps were just not getting high enough for the Tyan fan 'control' to kick in. And it's a hot day (and night) in California !
So...is the CPU fan actually running at 1700rpm constantly and then it's going to ramp up from there?
How loud is it at that speed?

I have the same HSF combo running on my Intel boxes and they are really quiet.
I run all my stuff inside in mid ATX towers so I need to keep them as quiet as possible :)
 

hmw

Active Member
Apr 29, 2019
235
77
28
So...is the CPU fan actually running at 1700rpm constantly and then it's going to ramp up from there?
How loud is it at that speed?

I have the same HSF combo running on my Intel boxes and they are really quiet.
I run all my stuff inside in mid ATX towers so I need to keep them as quiet as possible :)
At 1700 RPM the fan won’t need to ramp up and down BUT its really quiet at that speed. It was next to the desk and the same noise level as a normal workstation. I’m guessing if the temps do get over 76c - it will ramp up from there (max I could get by setting the fan @100% is 3100 RPM)

I’m using Artic Cooling P8 PWM fans for case fans ...
 

Kev

Active Member
Feb 16, 2015
439
84
28
37
Definitely the Tyan board has some rough spots around the IPMI since it's not as well used and polished as the SM implementation. I'm seeing things like the KVM connection will drop even though timeout is 1800 seconds. I have to reload the IPMI webpage, log back in and start KVM again. Once, the IPMI completely rejected my root logon even though I am sure of my password. I just pulled power to the server, plugged it back in and waited for IPMI and I was in again. My conclusion is the IPMI lost itself.
 

hmw

Active Member
Apr 29, 2019
235
77
28
Definitely the Tyan board has some rough spots around the IPMI since it's not as well used and polished as the SM implementation. I'm seeing things like the KVM connection will drop even though timeout is 1800 seconds. I have to reload the IPMI webpage, log back in and start KVM again. Once, the IPMI completely rejected my root logon even though I am sure of my password. I just pulled power to the server, plugged it back in and waited for IPMI and I was in again. My conclusion is the IPMI lost itself.
The worst is that it accepted the password on first logon and then refused to log me in (and I had saved the password to 1Pass). I was left scrounging the house looking for a monitor that supported VGA ... :D
 

Kev

Active Member
Feb 16, 2015
439
84
28
37
Does anyone know how the AMD SATA controllers are mapped? I'm trying to pass 4 of the SATA ports on the board. Anyone with the board want to set passthrough in ESXI to figure out which ports map to what? I can't be stuck in a situation where I passthrough SATA12 (1 of the 2 onboard sata connectors) and hence force me to redo my ESXI install.

Code:
0000:00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
0000:00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
0000:00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [PCIe RP[0000:00:03.1]]
0000:00:03.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [PCIe RP[0000:00:03.2]]
0000:00:03.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [PCIe RP[0000:00:03.3]]
0000:00:03.5 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [PCIe RP[0000:00:03.5]]
0000:00:03.6 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [PCIe RP[0000:00:03.6]]
0000:00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [PCIe RP[0000:00:07.1]]
0000:00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [PCIe RP[0000:00:08.1]]
0000:00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
0000:00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
0000:00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0
0000:00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1
0000:00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2
0000:00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3
0000:00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4
0000:00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5
0000:00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6
0000:00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7
0000:01:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge
0000:02:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family
0000:03:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [vmhba0]
0000:04:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [vmhba1]
0000:05:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection [vmnic0]
0000:06:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection [vmnic1]
0000:07:00.0 Non-Essential Instrumentation: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
0000:07:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PTDMA
0000:08:00.0 Non-Essential Instrumentation: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
0000:08:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PTDMA
0000:08:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller
0000:20:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
0000:20:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
0000:20:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:20:01.4 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [PCIe RP[0000:20:01.4]]
0000:20:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:20:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:20:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [PCIe RP[0000:20:03.1]]
0000:20:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:20:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:20:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:20:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [PCIe RP[0000:20:07.1]]
0000:20:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:20:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [PCIe RP[0000:20:08.1]]
0000:20:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [PCIe RP[0000:20:08.2]]
0000:21:00.0 Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane] [vmhba2]
0000:22:00.0 Ethernet controller: Mellanox Technologies MT27700 Family [ConnectX-4] [vmnic2]
0000:22:00.1 Ethernet controller: Mellanox Technologies MT27700 Family [ConnectX-4] [vmnic3]
0000:23:00.0 Non-Essential Instrumentation: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
0000:23:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PTDMA
0000:24:00.0 Non-Essential Instrumentation: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
0000:24:00.1 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP
0000:24:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PTDMA
0000:24:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller
0000:25:00.0 SATA controller: Advanced Micro Devices Inc AMD FCH SATA Controller [AHCI Mode] [vmhba3]
0000:40:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
0000:40:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
0000:40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:40:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [PCIe RP[0000:40:07.1]]
0000:40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [PCIe RP[0000:40:08.1]]
0000:40:08.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [PCIe RP[0000:40:08.2]]
0000:40:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [PCIe RP[0000:40:08.3]]
0000:41:00.0 Non-Essential Instrumentation: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
0000:41:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PTDMA
0000:42:00.0 Non-Essential Instrumentation: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
0000:42:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PTDMA
0000:43:00.0 SATA controller: Advanced Micro Devices Inc AMD FCH SATA Controller [AHCI Mode] [vmhba4]
0000:44:00.0 SATA controller: Advanced Micro Devices Inc AMD FCH SATA Controller [AHCI Mode] [vmhba5]
0000:60:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
0000:60:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
0000:60:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:60:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [PCIe RP[0000:60:01.1]]
0000:60:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:60:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:60:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:60:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:60:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:60:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [PCIe RP[0000:60:07.1]]
0000:60:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
0000:60:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [PCIe RP[0000:60:08.1]]
0000:61:00.0 RAID bus controller: Avago (LSI) ThinkSystem RAID 530-8i PCIe 12Gb Adapter [vmhba6]
0000:62:00.0 Non-Essential Instrumentation: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
0000:62:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PTDMA
0000:63:00.0 Non-Essential Instrumentation: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
0000:63:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PTDMA
 
Last edited:

jpmomo

Member
Aug 12, 2018
99
30
18
which drive did you install esxi? Which version? It looks like you have an optane drive at pci id 21. do you have another datastore in sata12 (I am guessing that you plugged a sata drive into the right side when facing the front). You would like to passthrough another sata drive that you plugged in where? I am currently using 2 m.2 drives (main drive for datastore1 (also includes hypervisor) and the other m.2 for datastore2. I can try and find a sata drive and plug it into one of the blue sata ports (let me know which one) and then set try setting vmhba2,3,4? as pci passthrough. can you check the storage section in the vsphere client and let me know what you see for adapters and devices?
 

Kev

Active Member
Feb 16, 2015
439
84
28
37
which drive did you install esxi? Which version? It looks like you have an optane drive at pci id 21. do you have another datastore in sata12 (I am guessing that you plugged a sata drive into the right side when facing the front). You would like to passthrough another sata drive that you plugged in where? I am currently using 2 m.2 drives (main drive for datastore1 (also includes hypervisor) and the other m.2 for datastore2. I can try and find a sata drive and plug it into one of the blue sata ports (let me know which one) and then set try setting vmhba2,3,4? as pci passthrough. can you check the storage section in the vsphere client and let me know what you see for adapters and devices?
Thanks for helping out. I plugged in a SATA DOM to SATA12 (closest to ATX 24-pin pwr) and embarrassingly soldered the 5V and GND wire to the adjacent 24-pin ATX connector pins 23 and 24 which was the most easily accessible 5V. Anyways, I don't think the ESXI adapter matters because I have a datastore on the SATA DOM and P4801x. So for me, the "FCH SATA Controller" are VMHBA3, 4, 5. I think the PCI ID assignments don't change so as long as you can isolate which PCIe root corresponds to SATA12, that would be most helpful! Thanks!
 

jpmomo

Member
Aug 12, 2018
99
30
18
I think it was pretty creative regarding the getting the power to the new "sata dom":)! So what I think you need me to try is connect a sata drive into the sata 12 connector:

1591277063103.png

and then try and see which vmbaXXX corresponds to that drive when I enable pci passthrough?
 

Kev

Active Member
Feb 16, 2015
439
84
28
37
I think I need to know which pcie ID, 25:00.0 or 43:00.0 or 44:00.0 corresponds to sata12 so that when you toggle pass through for each of these devices, which path makes the data store go away. Then I won’t touch this device when I’m doing pass through.