Synology Replacement
- Thread starter T_Minus
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
I do, my SAN runs the 1.6TB p3600 and p3605.
I have a single 400GB P3600 PCIE I was hoping to use as a SLOG and/or L2ARC but since I can't pass it through to "work" in OmniOS I'll likely just sell it as performance for other tasks aren't that special over a couple s3700's for mixed work.
I really like the P3700 for mixed work-load performance for the AIO/Dev-Box as it saves me from having to have a couple different arrays for higher performing... just throw VMs on there and leave the DBs on the same file system while in my AIO/Dev-box and they perform very well. The mixed workload performance of the p3700 is just amazing in my opinion...
If I could have gotten 2x more 1.6TB P3600's for what I paid for the last half dozen I'd have gotten those instead but those deals have dried up as of lately it would seem
Well the IcyDock 8x.25" has the loudest fans out of entire system, lol.
That includes the 4800 RPM 30mm noctua I have on the LSI onboard 3008 chipset too.. I think I'll be turning the icydock fans down! hopefuly it has a low/high switch just not on/off, I forget now.
That includes the 4800 RPM 30mm noctua I have on the LSI onboard 3008 chipset too.. I think I'll be turning the icydock fans down! hopefuly it has a low/high switch just not on/off, I forget now.
T-Minus how is the Define XL besides the missing screw issue. I've been looking for a case to replace my $30 RaidMax Comet case (Want to throw this case off a bridge) I bought at Frys years ago and was considering the Define XL as it will house my mythtv box that I plug in to my cable box via firewire and was looking for something "quiet" for the living room.
Hmmm. this very weird.
I loaded up ESXI 6.0 went to Configuration->Health Status and it just says "Supermicro Super Server" and doesn't have any drop downs for any of the sensor groups at all.
So not only are the fans surging no information is available either...
I loaded up ESXI 6.0 went to Configuration->Health Status and it just says "Supermicro Super Server" and doesn't have any drop downs for any of the sensor groups at all.
So not only are the fans surging no information is available either...
Low Threshold set to 600, fans no longer surge!
Here's how it looked after I installed my "DIY NVME CAGE" which screwed on top of a 120mm fan (very hard to see), and then the 2.5" NVME attach to that. The case has 2x 140MM fans blowing 'in' over the 3.5" HDD which also go across the back of the 1x NVME. Then we have 120MM case fan on bottom of NVME blowing air up. There's also the red square basically starting at the top of the power supply on the side-case 120mm fan blowing cool ar in / onto AOCs, and then the tiny fan on the 3008 HBA on the motherboard, and then there's a 120mm rear-exhaust fan, and the rest of the air exits between/above PCIE area. The icy dock also has 2x 30mm (I thnk) fans on the rear sucking air in through the SSD.
Note: This was before I cleaned up the cabling, especially the bottom cables near/around my NVME cage. Zip ties installed, wires moved away from sharp edges, etc...
It's not dead silent with all the fans in/on it now but I think it's got enough air flow to keep the HBAs, SSD, NVME, HDD cool.
Final build with drives:
- 6x WD RED 5TB (General Storage)
- 2x WD RED PRO 2TB (Archive(sad I know for the fast drives haha))
- 1x HGST/HP 12Gb/s SAS - Security Camera Footage
- 1x HGST/HP 12Gb/s SAS - VMs/Testing
- 2x Intel P3700 800GV NVME VMs/Testing
- 4x Intel 730 240gb Unused/Testing likely to go in another system
- 2x Intel S3500 80GB (Napp-IT + Backup Copy/Image)
- 1x 32gb USB Drive -- ESXi
I have room to add 4x more SSD to the Icy Dock, and an entire 5.25 bay free for a 2nd icy dock, which I may get for running 4x of the thicker SAS SSD seen above 'sideways' installed currently. Although, I'm not sure the IcyDock can handle 12Gb/s may be worth testing to clean that up a bit more.
I have room to add 2x more SAS SSD on existing channel.
I have 1x 3008 SAS channel unused.
Idle Temps:
CPU: 35*C
HDD: 28-32*C
Ambient: 22*C
Here's how it looked after I installed my "DIY NVME CAGE" which screwed on top of a 120mm fan (very hard to see), and then the 2.5" NVME attach to that. The case has 2x 140MM fans blowing 'in' over the 3.5" HDD which also go across the back of the 1x NVME. Then we have 120MM case fan on bottom of NVME blowing air up. There's also the red square basically starting at the top of the power supply on the side-case 120mm fan blowing cool ar in / onto AOCs, and then the tiny fan on the 3008 HBA on the motherboard, and then there's a 120mm rear-exhaust fan, and the rest of the air exits between/above PCIE area. The icy dock also has 2x 30mm (I thnk) fans on the rear sucking air in through the SSD.
Note: This was before I cleaned up the cabling, especially the bottom cables near/around my NVME cage. Zip ties installed, wires moved away from sharp edges, etc...
It's not dead silent with all the fans in/on it now but I think it's got enough air flow to keep the HBAs, SSD, NVME, HDD cool.
Final build with drives:
- 6x WD RED 5TB (General Storage)
- 2x WD RED PRO 2TB (Archive(sad I know for the fast drives haha))
- 1x HGST/HP 12Gb/s SAS - Security Camera Footage
- 1x HGST/HP 12Gb/s SAS - VMs/Testing
- 2x Intel P3700 800GV NVME VMs/Testing
- 4x Intel 730 240gb Unused/Testing likely to go in another system
- 2x Intel S3500 80GB (Napp-IT + Backup Copy/Image)
- 1x 32gb USB Drive -- ESXi
I have room to add 4x more SSD to the Icy Dock, and an entire 5.25 bay free for a 2nd icy dock, which I may get for running 4x of the thicker SAS SSD seen above 'sideways' installed currently. Although, I'm not sure the IcyDock can handle 12Gb/s may be worth testing to clean that up a bit more.
I have room to add 2x more SAS SSD on existing channel.
I have 1x 3008 SAS channel unused.
Idle Temps:
CPU: 35*C
HDD: 28-32*C
Ambient: 22*C
I did some testing for temps by blocking vents on the case and unused PCIE slots... my hopes were to actually lower the HBA temps since there are 3 in a row (2x M1015 1x SM NVME).
There's the single 'exhaust' fan, and the rest would be forced over the in-use PCIE cards.
Since I don't have temps of the HBA and the side of the case has a fan blowing air directly onto them I couldn't use my thermal imaging to monitor them, so I used the 'finger test' on the exhaust of the PCIE bracket, and monitored HDD temps via SMART.
What I found surprised me... blocking the exhaust vents actually resulted in less air flow as I believe the fans in-use for intake are not made for high static pressure. The HDD temps went up 1-3*C depending on location, and the metal on the HBA PCIE bracket was noticeably hot to the touch. The HDD had 0 usage during the test.
It took a good 30m+ for the metal brackets to go back to being 'cool' to the touch, and HDD to drop back down. The SSD (4x Intel 730) in the Icy Dock which have 2x 30mm fans also went up 1-2*.
Low RPM fans + fans not made for high-static pressure don't work well when trying to direct and restrict air flow.
Keep in mind I'm using 2x 140MM intake, 2x 30MM intake, 1x 120MM intake on side that blows directly on the PCIE slots, and the large fan that's barely moving in the PSU.
With all those fans moving air at 800-1400 RPM the less restrictive (no tape on exhaust vents) setup keeps the inside temps cooler, and much more air moving through the entire case.
I got some other random sized fans to play around with mounting on the outside/external PCIE bracket to 'pull' air through there.
HDD temps jump when moving data. (Remember: 6x WD RED 5TB, 2x WD RED PRO 2TB)
Sadly my 12Gb/s SAS HGST drives are "HP" firmware and I can't retrieve smart info / temps -- which I'd really like to since they're just sitting next to the case. Oh-well, the 4x 15mm Icy Dock is in my mail, so those will go in front of some fans here shortly, and hopefully I can find a deal on 2 more to expand.
There's the single 'exhaust' fan, and the rest would be forced over the in-use PCIE cards.
Since I don't have temps of the HBA and the side of the case has a fan blowing air directly onto them I couldn't use my thermal imaging to monitor them, so I used the 'finger test' on the exhaust of the PCIE bracket, and monitored HDD temps via SMART.
What I found surprised me... blocking the exhaust vents actually resulted in less air flow as I believe the fans in-use for intake are not made for high static pressure. The HDD temps went up 1-3*C depending on location, and the metal on the HBA PCIE bracket was noticeably hot to the touch. The HDD had 0 usage during the test.
It took a good 30m+ for the metal brackets to go back to being 'cool' to the touch, and HDD to drop back down. The SSD (4x Intel 730) in the Icy Dock which have 2x 30mm fans also went up 1-2*.
Low RPM fans + fans not made for high-static pressure don't work well when trying to direct and restrict air flow.
Keep in mind I'm using 2x 140MM intake, 2x 30MM intake, 1x 120MM intake on side that blows directly on the PCIE slots, and the large fan that's barely moving in the PSU.
With all those fans moving air at 800-1400 RPM the less restrictive (no tape on exhaust vents) setup keeps the inside temps cooler, and much more air moving through the entire case.
I got some other random sized fans to play around with mounting on the outside/external PCIE bracket to 'pull' air through there.
HDD temps jump when moving data. (Remember: 6x WD RED 5TB, 2x WD RED PRO 2TB)
Sadly my 12Gb/s SAS HGST drives are "HP" firmware and I can't retrieve smart info / temps -- which I'd really like to since they're just sitting next to the case. Oh-well, the 4x 15mm Icy Dock is in my mail, so those will go in front of some fans here shortly, and hopefully I can find a deal on 2 more to expand.
on my understanding
this never works, here are some reasons on my head:
*you have one low rpm fan and not for pulling air, you need to add extra exhaust fan
*blocking pci slots is a bad idea, since the heat will stay due on no flow from bottom to top. hot air always raises when there is adequate space to flow.
* by not blocking pci slots, hot air has less consntrait to raise aka ventilated.
Went to add a fan extension to route cable better... whoops, forgot the supermicro goes full speed at fan loss!
The problem... after reboot the fans are still at 80% or more.
The 2nd problem... vSphere Configuration->Health Status just says "SuperMicro" no + sign next to it. This occurred once before, but never again since...
It seems like the "BIOS" isn't resetting or becoming available after a panic, any idea how to fix this?
(Note: I haven't powered down, and rebooted but will do that next, and it likely will fix it. This is all fine since it's at home, all in one, but in a data center this would be a huge hassle not having accessing to view the data and/or requesting a hard-power off.)
The problem... after reboot the fans are still at 80% or more.
The 2nd problem... vSphere Configuration->Health Status just says "SuperMicro" no + sign next to it. This occurred once before, but never again since...
It seems like the "BIOS" isn't resetting or becoming available after a panic, any idea how to fix this?
(Note: I haven't powered down, and rebooted but will do that next, and it likely will fix it. This is all fine since it's at home, all in one, but in a data center this would be a huge hassle not having accessing to view the data and/or requesting a hard-power off.)
Went to add a fan extension to route cable better... whoops, forgot the supermicro goes full speed at fan loss!
The problem... after reboot the fans are still at 80% or more.
The 2nd problem... vSphere Configuration->Health Status just says "SuperMicro" no + sign next to it. This occurred once before, but never again since...
It seems like the "BIOS" isn't resetting or becoming available after a panic, any idea how to fix this?
(Note: I haven't powered down, and rebooted but will do that next, and it likely will fix it. This is all fine since it's at home, all in one, but in a data center this would be a huge hassle not having accessing to view the data and/or requesting a hard-power off.)
The problem... after reboot the fans are still at 80% or more.
The 2nd problem... vSphere Configuration->Health Status just says "SuperMicro" no + sign next to it. This occurred once before, but never again since...
It seems like the "BIOS" isn't resetting or becoming available after a panic, any idea how to fix this?
(Note: I haven't powered down, and rebooted but will do that next, and it likely will fix it. This is all fine since it's at home, all in one, but in a data center this would be a huge hassle not having accessing to view the data and/or requesting a hard-power off.)
I didn't read the whole 5 pages, but this sure sounds like a disconnected tachometer lead somewhere. Do you see reasonably accurate fan speeds for each fan? On the Supermicro server boards I've used, missing fans are correctly detected as "NA". I've had issues in the past with other sensor readings (DIMM temperature, mainly) not showing up, even as "NA", and Supermicro had me re-flash the IPMI with the DOS utility and have that utility also clear the config.Well, I changed the High Threshold and it's still running 100%.
Changed the Fan from Standard to optimal in IPMI, and then back to standard still 100%.
Powered off 100%, and still fans at 100%
Code:
Fan1 | na | RPM | na | 405.000 | 540.000 | 675.000 | 34155.000 | 34290.000 | 34425.000
Fan2 | 4860.000 | RPM | ok | 405.000 | 540.000 | 675.000 | 34155.000 | 34290.000 | 34425.000
Fan3 | 4860.000 | RPM | ok | 405.000 | 540.000 | 675.000 | 34155.000 | 34290.000 | 34425.000
Fan4 | 4590.000 | RPM | ok | 405.000 | 540.000 | 675.000 | 34155.000 | 34290.000 | 34425.000
Fan5 | 4860.000 | RPM | ok | 405.000 | 540.000 | 675.000 | 34155.000 | 34290.000 | 34425.000
Fan6 | 4590.000 | RPM | ok | 405.000 | 540.000 | 675.000 | 34155.000 | 34290.000 | 34425.000
Fan7 | 4860.000 | RPM | ok | 405.000 | 540.000 | 675.000 | 34155.000 | 34290.000 | 34425.000
Fan8 | 4590.000 | RPM | ok | 405.000 | 540.000 | 675.000 | 34155.000 | 34290.000 | 34425.000All the reading via ipmitool/util and ipmi web login are accurate. It's worked the last week+ running non-stop, and when I've accidentally unplugged fans before and rebooted it hasfixed it...
It's now running 'right' again. It required me to completely remove the power plug and let it sit then plug it back in and power up. Rebooting, and powering it off and back on did not fix it. This seems like a glitch in the SuperMicro BIOS -- for not resetting on power-off.
It's back to being nearly completely silent... well other than the TERRIBLE ICY DOCK fans
I'm going to hunt around here for some 3 pin fans that may fit, and if I find any cancel my return... would rather not hassle with the seller who has told me numerous times he's going to make sure I didn't "scam him and return a different item" with loud fans... ridiculous! Sadly, I think the only fans I have that may fit are plug-less or $$$ NOCTUA brand.
It's now running 'right' again. It required me to completely remove the power plug and let it sit then plug it back in and power up. Rebooting, and powering it off and back on did not fix it. This seems like a glitch in the SuperMicro BIOS -- for not resetting on power-off.
It's back to being nearly completely silent... well other than the TERRIBLE ICY DOCK fans
I'm going to hunt around here for some 3 pin fans that may fit, and if I find any cancel my return... would rather not hassle with the seller who has told me numerous times he's going to make sure I didn't "scam him and return a different item" with loud fans... ridiculous! Sadly, I think the only fans I have that may fit are plug-less or $$$ NOCTUA brand.