Wiwynn 1U Dual Node 2 x Xeon Gold 5118 64GB 25GbE $150/node

[Cruzader]

Not that I am going to buy one (I just tipped my wallet upside down and only dust fell out), but does anyone know how much trays for these would cost? I tried searching but couldn't figure out which were the right ones. Seems like an OK value at first look, but if trays are $$$$ , 24 of them could more than double the total price of fitting one of these out.

Id not expect to find trays for this.
They have been listed for ages and likely the lack of caddys/parts to be what has kept people away.

Id expect even a 100$ offer to be accepted by how many years they have been just taking up space already.
Might be able to spot what its a rebrand on with a hands on look tho, to try the original brand/models trays.

 

[sparx]

Id not expect to find trays for this.
They have been listed for ages and likely the lack of caddys/parts to be what has kept people away.

Id expect even a 100$ offer to be accepted by how many years they have been just taking up space already.
Might be able to spot what its a rebrand on with a hands on look tho, to try the original brand/models trays.

That looks like a Celestica chassis. Front looks like IBM storewiz jbods and others. Perhaps there are cheaper options. Like the caddy for ibm storwize v3700. But I havnt seen the HGST server version, so Im not totally sure.

 

[Karpo]

Dual Node Wiwynn SV302G3-U

Per node:
- 2 Xeon Gold 5118
- 64 GB
- 1 tray for U.2 NVMe
- 25GbE SFP28
- Static rails


any idea if nodes have free pcie slots? Nic is in ocp slot. Would need x16 for 100g

 

[semidetached]

That looks like a Celestica chassis. Front looks like IBM storewiz jbods and others. Perhaps there are cheaper options. Like the caddy for ibm storwize v3700. But I havnt seen the HGST server version, so Im not totally sure.

There are some better images in the datasheet

http://www.genstor.com/assets/uploads/products/datasheet9201851538133878Ultrastar-Serv24-HA-DS.pdf

Also, this seems to be the matching manual

Chapter 1 Overview; Description - HGST Ultrastar Serv24-HA User Manual [Page 11]

HGST Ultrastar Serv24-HA Manual Online: chapter 1 ultrastar serv24-ha overview, Ultrastar Serv24-Ha Description. On Page 20. The...

www.manualslib.com

 

[semidetached]

any idea if nodes have free pcie slots? Nic is in ocp slot. Would need x16 for 100g

It looks like there is a single physical x16 slot in each node. Not sure if it is electrically x16. If the -U model is similar to the -I model, then there should be "One PCIe x16 FHHL slot". Also, the OCP V2.0 is "PCIe 3.0 x16", which means there should be 100g NICs for that form factor.
Server Datasheet

 

[sparx]

There are some better images in the datasheet

Aha. So its not the same as the JBOD/JBOF caddies. They are longer versions for better air circulation.
But this might be similar? IBM X3400 caddy

 

[Markess]

Id not expect to find trays for this.
They have been listed for ages and likely the lack of caddys/parts to be what has kept people away.

Id expect even a 100$ offer to be accepted by how many years they have been just taking up space already.
Might be able to spot what its a rebrand on with a hands on look tho, to try the original brand/models trays.

Part of me says, “but that’s what 3D printers are for! Make an offer!” Im resisting the temptation…so far. OTOH, they come with rails and Xeon 6138s can be had for less than $1 per core.

 

[Cruzader]

Part of me says, “but that’s what 3D printers are for! Make an offer!” Im resisting the temptation…so far. OTOH, they come with rails and Xeon 6138s can be had for less than $1 per core.

but id prefer having atleast one original caddy to model from than making from scratch.

 

[zdude]

Eh screw it. I needed some new NVME storage nodes and a project to mess with, grabbed 2 of them (well below asking price) Planning to combine them with the U.2 to M.2 adapters from one of the other threads.

 

[KWTSS]

Yes, the SV302G3-I nodes have 1x PCIe slot available, (per node).

 

[werewolf191]

Eh screw it. I needed some new NVME storage nodes and a project to mess with, grabbed 2 of them (well below asking price) Planning to combine them with the U.2 to M.2 adapters from one of the other threads.

Hi. How is the experience so far with these servers? I wanted to buy a few bit wanted to check if it is worth the time and money. Appreciate your insights

 

[zdude]

They work but the bios on the boards is…. Incredibly restrictive, no SSDs that are not WD built will show up as the port is disabled during post when a non-WD drive is present. I have tried non-WD sata-m.2, AIC, U.2 and M.2 via adapter on the board and without a complicated online reset (If you plug in a second PLX chip to one of the U.2 ports then while the OS is booted reset that secondary PLX chip non WD ssds will show up) have not been able to get any of them to show up either in the OS or bios.

The other challenge I had with these systems is the PLX chips are configured to force dual port operation by default, this isn’t a problem when one node is powered on but when both nodes are powered on the single port adapters I was using started to get…. buggy. I got 90% of the way through re-configuring the PLX chips (Can set them up online in the OS but not flashed to the board yet)

Currently the nodes are sitting powered off, when I get more time this fall/winter I may get back to playing with them to try making them work but without a more generic bios image I suspect I will end up not using the boards. Overall, I suspect I will never put them into my “production” cluster.

 

[Karpo]

Hi. How is the experience so far with these servers?

Got one, has single eth port for ipmi only, added usb dongle for second. All pcie ports are on same numa node one x16 and one x8 ocp2, many slimsas x8(?) on board but all on same numa node. Have not find manual. KVM VMs seems to work ok

 

[werewolf191]

They work but the bios on the boards is…. Incredibly restrictive, no SSDs that are not WD built will show up as the port is disabled during post when a non-WD drive is present. I have tried non-WD sata-m.2, AIC, U.2 and M.2 via adapter on the board and without a complicated online reset (If you plug in a second PLX chip to one of the U.2 ports then while the OS is booted reset that secondary PLX chip non WD ssds will show up) have not been able to get any of them to show up either in the OS or bios.

The other challenge I had with these systems is the PLX chips are configured to force dual port operation by default, this isn’t a problem when one node is powered on but when both nodes are powered on the single port adapters I was using started to get…. buggy. I got 90% of the way through re-configuring the PLX chips (Can set them up online in the OS but not flashed to the board yet)

Currently the nodes are sitting powered off, when I get more time this fall/winter I may get back to playing with them to try making them work but without a more generic bios image I suspect I will end up not using the boards. Overall, I suspect I will never put them into my “production” cluster.

Thank you for the detailed response. Truly appreciate it. I asked the vendor to provide dual port 25G Mezzanine card and hopefully that should solve the challenge with PLX chips.. Also could you let me know the bios version so that I can ask the seller what Bios version they will have in the units i am buying... I have variety of U.2s mostly intel and micron but do have a few WD SN200s.. Do you know if they would work? also have a few WD SN850X M.2s as well...

 

[werewolf191]

Got one, has single eth port for ipmi only, added usb dongle for second. All pcie ports are on same numa node one x16 and one x8 ocp2, many slimsas x8(?) on board but all on same numa node. Have not find manual. KVM VMs seems to work ok

Did you ask seller about the manual? The numa might be because of lack of dual ports. I will let you know once i get mine.

 

[werewolf191]

Did you ask seller about the manual? The numa might be because of lack of dual ports. I will let you know once i get mine. I also wrote to Wiwynn about manuals and latest bios.. I will let you know if i get a response. I have dealt earlier with Inspur and they have been incredibly supportive in providing all the information i needed. I am not sure how Wiwynn would be and hoping for the best.

 

[werewolf191]

I still have to get servers but here is the manual i got from Wiwynn. Hopefully it is useful.

 

[Karpo]

Hi, great that you got the manual! I do not see it attached on your post, though. Can you try to attach it again? I just updated OCP2.0 NIC to 100G ConnectX-5 and swapped Xeon 2x5118 to single 6148 for now

 

[werewolf191]

Hi, great that you got the manual! I do not see it attached on your post, though. Can you try to attach it again? I just updated OCP2.0 NIC to 100G ConnectX-5 and swapped Xeon 2x5118 to single 6148 for now

Apologies for the delay. I have been traveling. Seems like file upload failed due to size. I created a mediashare link for it...

SV302G3_UM_V1.0

MediaFire is a simple to use free service that lets you put all your photos, documents, music, and video in a single place so you can access them anywhere and share them everywhere.

www.mediafire.com

 

[werewolf191]

Apologies for the delay. I have been traveling. Seems like file upload failed due to size. I created a mediashare link for it... I also just got the servers delivered this week. They are still at my storage and plan to bring one next week to try configuring it. Will keep you updated. Also, Wiwynn responded they do not have spare drive caddies. So, I might give a try to get them 3d printed and see how they come.

SV302G3_UM_V1.0

MediaFire is a simple to use free service that lets you put all your photos, documents, music, and video in a single place so you can access them anywhere and share them everywhere.

www.mediafire.com