Hi StH members,
I am a new publishing member here, but been lurking on/off for months.
I need a new server for the home. But I am torn between the D-1540 and a E5 x2 platform of various configurations.
Goal / Purpose:
- The platform will be bought privately for both
--- Work experiments for work; Training and gaining experience with on-premise self-management cluster installations as well as software that run on clusters, like Hadoop and various new Spark based products and NoSQL databases.
--- Secondary: Entertainment at home. Just a virtual Win10 Pro for movies, browsing, development in VS/Eclipse etc
--- Secondary: File server hosting. Virtual FreeNAS for Z2 experiments and easy management of media and datasets.
- I seek to gain experience with auto-deployment of clusters for companies with strict no-cloud governance and not much cluster experience in-house and to gain experience from self-managed clusters (and totally free hands unlike the shared clusters at work). On top of that I need to test various cluster products like Hadoop performance insights
- I prefer to have one physical box to sit somewhere in a small flat (Expensive area)
Software implementation plan:
- I plan on doing this via a Win 2012R2/2016 base and then run a VM server off that. I have experience with VMWare, Oracle VB and Hyper-V already.
--- An on/off VM a Win10Pro for home/entertainment
--- Up to 6 simultanous VMs (2+4 nodes) running a cluster installation of various kinds. I cannot do this via AWS / Azure because of not totally free reigns, license fees for stuff I get for free, as well as the NEED for gaining more experience with on-premise cluster installations, especially deployment of Kickstart installations via PXE / servers and Chef/Ansible management of the rest once the 1-click deployment stuff runs.
Background / Situation:
- I work in Big Data and have vast experience with M-L, Hadoop (IBM/Hortonworks (ODPi) and Cloudera), VM setups (not much organized cluster management yet like Puppet, Chef, Ansible, CFEngine etc), plus AWS experience, so I know many of the options I phase.
- I have two on-premise clusters (2+4 nodes each) at work already for experiments, but as these are not owned by me or my department and share users, I only have limited admin rights on these for experiments and are under certain rules for what I can and cannot do. These are also datacenter hosted so planning OS installs takes weeks, if I were allowed, fx.
Budget:
- 2k-3k usd/euro ex external disks, ie OS disk only (4k absolute max = 2x D-1540s)
(EU based but if X costs 1 usd in US, it usually costs 1 euro in EU so potato potato)
Needs:
- Host a VM server and 6-8 concurrent VMs running
- ECC mem for computations, so Xeon.
- Low power bill, as I will be footing the bill. And my current TDP 130W i7-950 already cost more in power over 5 years than it cost to buy ($2000) and it has never been OC'd.
- A slot for a cheap 960 gfx card for 4k 444 60Hz Admin (I need/want the real estate for VM windows and multitasking comfortably and already got the monitor)
-----
Solutions thought of:
- D-1540 (List is a purchase list with prices, ignore the fans/case stuff)
D-1540 - VM server and virtual Hadoop workstation Preisvergleich | geizhals.eu EU
Pro: Small, modern ports, low power, fastest OS disk available, cheap 8/16 core/threads setup, great netcard setup and comes in microblade form, should I need to expand.
Con: Low on CPU power, only 1 PCI-e slot taken by a 960 so no HBA (1015), Might be too low in memory with 64GB being the feasible limit.
- E5 v3 platform, using 2x 2618L v3 bought legit from new
Hadoop Data node 2x2600v3 - 2x D1540 budget Preisvergleich | geizhals.eu EU
Pro: Modern as the D-1540, DDR4, flexible Hz 2.3 -> 3.4 turbo, low power, more versatile
Con: Expensive to buy and run.
- E5 v3 platform, same as above, but using 2x 26xx ES off eBay, (Not sure if ES are illegal to buy?)
Pro: Cheaper than 2618L. Lots more power and might be competitive with 2x 1540s
Con: No warrenty, might be dodgy to buy, high power bill, possible cons
- E5 v1 platform, same as above, but used 2670 v1's or similar
Pro: Very cheap power to buy, lots of core/memory power
Con: Old tech, Regular SSD OS, Expensive power wise, slow memory, used parts, no warrenty
- Physical second-hand setup,
(Cheap Desktop/Laptop system for fun, Cheap Xeon for disk/server + 6 cheap physical Opteron nodes for the experiments).
Pro: Real physical environment, flexible setup, no VM problems, no issues if HW dies because of low costs
Con: Slow memory, slow disks, high powerbill, HW might be so old it does not reflect reality etc.
Any insights on what system to pick for the purpose? (tia)
I am a new publishing member here, but been lurking on/off for months.
I need a new server for the home. But I am torn between the D-1540 and a E5 x2 platform of various configurations.
Goal / Purpose:
- The platform will be bought privately for both
--- Work experiments for work; Training and gaining experience with on-premise self-management cluster installations as well as software that run on clusters, like Hadoop and various new Spark based products and NoSQL databases.
--- Secondary: Entertainment at home. Just a virtual Win10 Pro for movies, browsing, development in VS/Eclipse etc
--- Secondary: File server hosting. Virtual FreeNAS for Z2 experiments and easy management of media and datasets.
- I seek to gain experience with auto-deployment of clusters for companies with strict no-cloud governance and not much cluster experience in-house and to gain experience from self-managed clusters (and totally free hands unlike the shared clusters at work). On top of that I need to test various cluster products like Hadoop performance insights
- I prefer to have one physical box to sit somewhere in a small flat (Expensive area)
Software implementation plan:
- I plan on doing this via a Win 2012R2/2016 base and then run a VM server off that. I have experience with VMWare, Oracle VB and Hyper-V already.
--- An on/off VM a Win10Pro for home/entertainment
--- Up to 6 simultanous VMs (2+4 nodes) running a cluster installation of various kinds. I cannot do this via AWS / Azure because of not totally free reigns, license fees for stuff I get for free, as well as the NEED for gaining more experience with on-premise cluster installations, especially deployment of Kickstart installations via PXE / servers and Chef/Ansible management of the rest once the 1-click deployment stuff runs.
Background / Situation:
- I work in Big Data and have vast experience with M-L, Hadoop (IBM/Hortonworks (ODPi) and Cloudera), VM setups (not much organized cluster management yet like Puppet, Chef, Ansible, CFEngine etc), plus AWS experience, so I know many of the options I phase.
- I have two on-premise clusters (2+4 nodes each) at work already for experiments, but as these are not owned by me or my department and share users, I only have limited admin rights on these for experiments and are under certain rules for what I can and cannot do. These are also datacenter hosted so planning OS installs takes weeks, if I were allowed, fx.
Budget:
- 2k-3k usd/euro ex external disks, ie OS disk only (4k absolute max = 2x D-1540s)
(EU based but if X costs 1 usd in US, it usually costs 1 euro in EU so potato potato)
Needs:
- Host a VM server and 6-8 concurrent VMs running
- ECC mem for computations, so Xeon.
- Low power bill, as I will be footing the bill. And my current TDP 130W i7-950 already cost more in power over 5 years than it cost to buy ($2000) and it has never been OC'd.
- A slot for a cheap 960 gfx card for 4k 444 60Hz Admin (I need/want the real estate for VM windows and multitasking comfortably and already got the monitor)
-----
Solutions thought of:
- D-1540 (List is a purchase list with prices, ignore the fans/case stuff)
D-1540 - VM server and virtual Hadoop workstation Preisvergleich | geizhals.eu EU
Pro: Small, modern ports, low power, fastest OS disk available, cheap 8/16 core/threads setup, great netcard setup and comes in microblade form, should I need to expand.
Con: Low on CPU power, only 1 PCI-e slot taken by a 960 so no HBA (1015), Might be too low in memory with 64GB being the feasible limit.
- E5 v3 platform, using 2x 2618L v3 bought legit from new
Hadoop Data node 2x2600v3 - 2x D1540 budget Preisvergleich | geizhals.eu EU
Pro: Modern as the D-1540, DDR4, flexible Hz 2.3 -> 3.4 turbo, low power, more versatile
Con: Expensive to buy and run.
- E5 v3 platform, same as above, but using 2x 26xx ES off eBay, (Not sure if ES are illegal to buy?)
Pro: Cheaper than 2618L. Lots more power and might be competitive with 2x 1540s
Con: No warrenty, might be dodgy to buy, high power bill, possible cons
- E5 v1 platform, same as above, but used 2670 v1's or similar
Pro: Very cheap power to buy, lots of core/memory power
Con: Old tech, Regular SSD OS, Expensive power wise, slow memory, used parts, no warrenty
- Physical second-hand setup,
(Cheap Desktop/Laptop system for fun, Cheap Xeon for disk/server + 6 cheap physical Opteron nodes for the experiments).
Pro: Real physical environment, flexible setup, no VM problems, no issues if HW dies because of low costs
Con: Slow memory, slow disks, high powerbill, HW might be so old it does not reflect reality etc.
Any insights on what system to pick for the purpose? (tia)