All flash storage server

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
P

Paladin

New Member
Sep 26, 2016
25
4
3
37
I am in the process of building a storage server with the following components:

Intel 2u chassis
Intel S2600GL motherboard
2 x E5-2660
128gb ram
18 x 500gb dual port NetApp sm1625
Chelsio T580-CR connected to Cisco 3064
3 x Intel dual port backplane
X x Hba's as I would like to avoid using the expander

The server will be used for general file storage for a render farm and iscsi boot for the render nodes. The ssd's are giving strange performance numbers while testing single drives in s2016 using crystaldiskmark with a 4gb test file:
single port ReFS 521/552
single port NTFS 353/197
dual port ReFS 883/769
dual port NTFS 896/529

What is the recomended os for the project? s2016 with storage spaces, freenas, ubuntu with mdadm or else?

Thanks!
 
T_Minus

T_Minus

Build. Break. Fix. Repeat
Feb 15, 2015
7,731
2,122
113
I'm not a windows guy so I wouldn't suggest anything windoes for storage.

I'd be more comfortable with FreeNAS (ZFS), Napp-IT (OmniOS or?? with ZFS) or Ubuntu with mdadm.
 
  • Like
Reactions: wildchild
P

Paladin

New Member
Sep 26, 2016
25
4
3
37
Installed Ubuntu and started playing, just need to find out how to setup multipath io.
ubuntu 1 drive sp.JPG
 
G

gea

Well-Known Member
Dec 31, 2010
3,258
1,249
113
DE
If we talk about modern storage, especially OpenSource Storage we talk about ZFS. This means mainly Solaris, the source of ZFS and even today the fastest/most feature complete ZFS. There is a free Solaris fork now (Illumos) with most of its features. There is Open-ZFS as a common platform among BSD, Illumos, OSX and Linux, There is the BSD family that took over most of ZFS years ago. Now we have ZFS on Linux that tries to make it mainstream.

Btrfs on Linux is an effort to add some of the innovations of ZFS like CopyOnWrite or checksums to its former native filesystem ext4. This is the same with ReFS that tries to add some ZFS features to ntfs. Both are caught by its former "ideas" how to manage storage or by "home wants" how to extend storage. With btrfs you lack stability, with ReFS you lack the simplicity or performance of ZFS,

If you want to try the the genuine "ZFS Experience" intended by Sun, the leading server firm when ZFS was introduced - the only one to fight against Windows NT as a full featured server OS with its own NFS and SMB service among others at that time, first try Solaris or its free forks, then BSD and then the adventure game named "ZFS on Linux"

This is how I see it!
 
Last edited:
  • Like
Reactions: KC8FLB
G

gea

Well-Known Member
Dec 31, 2010
3,258
1,249
113
DE
Yes for commercial use (min 1k USD/year),
no for demo an development - but without updates

.... Someone must pay to win the Americas Cup
 
  • Like
Reactions: pgh5278 and RyC
G

gea

Well-Known Member
Dec 31, 2010
3,258
1,249
113
DE
Its Irony.
Last year there was a buy now button where you was able to select cpu cores and just buy online. The reference to the buy now is on the page, the buy button not.

I wonder quite often why they (they=Dell, HP, IBM, Oracle,..) make buying something often so complicated and user unfriendly.
 
  • Like
Reactions: gigatexal
P

Paladin

New Member
Sep 26, 2016
25
4
3
37
Installed Solaris 11.3 and napp-it. Now to setup multipath, seems a lot easier than on ubuntu

-multipath enabled using # stmsboot -e
 
Last edited:
P

Paladin

New Member
Sep 26, 2016
25
4
3
37
I followed the second guide, but after using the
# mpathadm list LU command, I don't get anything :(

On Windows, after adding the mpio feature, I had to add the drive in the mpio settings, and after a reboot, they were working in dual port configuration.
 

Attachments

T_Minus

T_Minus

Build. Break. Fix. Repeat
Feb 15, 2015
7,731
2,122
113
gea said:
Its Irony.
Last year there was a buy now button where you was able to select cpu cores and just buy online. The reference to the buy now is on the page, the buy button not.

I wonder quite often why they (they=Dell, HP, IBM, Oracle,..) make buying something often so complicated and user unfriendly.
Click to expand...
There's no "set in stone" price, this way they can offer the same software/license/whatever to much smaller businesses while not upsetting their enterprise clients paying 100x more for nearly the same thing. A % of their clients businesses grow, and with it their licensing cost usually do too until they're at enterprise paying level, etc... (This is obviously over simplified but the enterprise service/license/software market is hugely profitable for a reason.)
 
P

Paladin

New Member
Sep 26, 2016
25
4
3
37
small update, edited the scsi_vhci.conf file and added:

scsi-vhci-failover-override =
"NETAPP X452_1625500MCSG", "f_sym",
"XYZ ABC", "f_sym";

now I can see the drive but with only one path. :)
 

Attachments

D

dragonme

Active Member
Apr 12, 2016
282
25
28
anyone messed with openattic? I think CERN used it for some peatbyte storage... its based on zfs I think..

Features
Storage Management and Monitoring
The code is based on a modern and extensible architecture, built with proven web technologies like AngularJS, Bootstrap and the Django web application framework.

  • Wizard-based workflows for common tasks
  • Supports multiple file systems for file-based storage management (XFS, ext3/4, Btrfs, ZFS on Linux)
  • LVM2 support
  • Syncronous volume mirroring via DRBD ®
  • CIFS (via Samba)
  • NFS
  • iSCSI and Fibre Channel (via LIO)
  • Volume snapshots (LVM2, ZFS)
  • Automatic monitoring of performance data with Nagios/Icinga and PNP4Nagios
Ceph Management and Monitoring
  • Customizable Ceph Cluster dashboard (cluster health, cluster performance data)
  • Supports managing multiple Ceph clusters from the same UI
  • Ceph Pool management (view/create/delete) and Monitoring
  • Ceph Pool Erasure code profile management
  • RADOS Block device management (view/create/delete/map) and monitoring
  • Object Storage Daemon (OSD) management (view)
  • CRUSH Map editor
Other features
  • Installation packages for multiple Linux distributions (Debian/Ubuntu/RHEL/CentOS/SUSE)
  • Multi-user support
  • Multi-node support (one UI to manage multiple openATTIC instances)
  • API Recorder for easy application development/debugging
Missing a feature?
openATTIC is under active development. If you're missing a particular feature, please let us know!

© 2017 openATTIC
 
P

Paladin

New Member
Sep 26, 2016
25
4
3
37
Multipath finaly working.

It turns out that Solaris didn't see the RMS25CB080 raid module, it seems that the drivers are missing. I also found out that it has some bandwith limitations, so will try and skip that one. Curently using 2 x hp h222 flashed to lsi p20, will need to downgrade to p19 as I read on napp-it FAQ that p20 has performance issues with fast ssd's.

Now to do some tests with 4 drives :)
 
  • Like
Reactions: gigatexal
G

gea

Well-Known Member
Dec 31, 2010
3,258
1,249
113
DE
Fine that you got it working

P20 was reported buggy between 20.0.0.0 and 20.0.0.4.
Current 20.0.0.7 seems ok
 
You must log in or register to reply here.
Top Bottom