NAS on Baremetal or VM...
- Thread starter T_Minus
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
It should be noted just as a FYI. If you decide to roll your own don't get stuck on this bug. Learned about it today the hard way.
You need to add an empty floppy disk to see Disks in the Installer.
VMwareNotes
Keywords for Search Engines: ESXi 5.x, 5.1, OmniOS installer loop, OmniOS no disk condition.
You need to add an empty floppy disk to see Disks in the Installer.
VMwareNotes
Keywords for Search Engines: ESXi 5.x, 5.1, OmniOS installer loop, OmniOS no disk condition.
WHEN TO (AND NOT TO) USE RAID-Z (Bizarre ! Vous avez dit Bizarre ?)
Thought that was appropriate for this thread.
Thought that was appropriate for this thread.
Another good primer with lots of warnings 
Slideshow explaining VDev, zpool, ZIL and L2ARC for noobs! | FreeNAS Community
I think this guide gives good perspective into some of the main pros/cons and dangers of running ZFS.
Slideshow explaining VDev, zpool, ZIL and L2ARC for noobs! | FreeNAS CommunityI think this guide gives good perspective into some of the main pros/cons and dangers of running ZFS.
Has anyone compared L2ARC and ZIL performance with various SSD?
What about matching the L2ARC and ZIL drives, no need since they're not used the same/together?
Do certain ones perform better due to their controller and cache?
Obviously the 'RAM' SSD would be best, too bad they aren't "affordable"... or capable of customization, all seems so possible just no1 has made the hardware/software to do it. Imagine old RDIMMS or UDIMMS like the PC3-8500 super cheap, $200 for 64GB RAM drive would be nice throw some in a "enclosure" that has SATA connectors... dream
What about matching the L2ARC and ZIL drives, no need since they're not used the same/together?
Do certain ones perform better due to their controller and cache?
Obviously the 'RAM' SSD would be best, too bad they aren't "affordable"... or capable of customization, all seems so possible just no1 has made the hardware/software to do it. Imagine old RDIMMS or UDIMMS like the PC3-8500 super cheap, $200 for 64GB RAM drive would be nice
throw some in a "enclosure" that has SATA connectors... dream
Well, someone has done it:
Acard ANS 9010BA 5 25'' Dynamic SSD SATA x1 RAM Disk RAM Modules not Included | eBay
Too bad it's limited to 32GB, and cost $400 w/no RAM.
Acard ANS 9010BA 5 25'' Dynamic SSD SATA x1 RAM Disk RAM Modules not Included | eBay
Too bad it's limited to 32GB, and cost $400 w/no RAM.
L2ARC and SLOG do not need to be matched. I would use lower cost consumerish drives for the L2ARC (assuming you have the ram for it), but SLOG devices need to be super fast at committing sync writes so the choices are far more limited.
I did some tests a while ago comparing a S3500/730/600 Pro/MX100, not sure if I added a S3700 or not. Basically it came down to S3500/730 being okay and the S3700 being even better. It is not the kind of thing you see websites doing reviews on, would be nice to see a roundup of enterprise drives doing sync=always writes in ZFS.
SSDs are faster then that now... Something like a NVMe PCI-e ramdrive using registered DDR3 is what we need
I did some tests a while ago comparing a S3500/730/600 Pro/MX100, not sure if I added a S3700 or not. Basically it came down to S3500/730 being okay and the S3700 being even better. It is not the kind of thing you see websites doing reviews on, would be nice to see a roundup of enterprise drives doing sync=always writes in ZFS.
SATA2/3Gbit though
SSDs are faster then that now... Something like a NVMe PCI-e ramdrive using registered DDR3 is what we need
Why does lower end/consumer drivers require RAM? They're not sized different than enterprise, and for the cost would likely have more space available? I think I may be misunderstanding here. Or, are you saying go with a larger consumer-drive to save $, but you need more RAM to go along with it?
How far off were the 730, just curious as I have 10x480gb I'm putting into various usages. What size were the drives?
I'll use a S3700 for both or the Hitachi HUSSL4020ASS600 which have even greater write endurance than the S3700. Or maybe a 850 pro for L2ARC, I'd like to test that
Although I ust got a 500gb bx100, maybe that would work with a 64gb ARC? That seems to be the ratio or darn close peopel shoot for, no? I need to see what SSDs I have that would be best for this that are >200gb although 200 may be enough, and iirc you can add another drive to the cache pool easily, right? Yeah, I could BIN for $200 and just not fast enough anymore.SATA2/3Gbit though
Its not the SSD that require RAM it is the L2ARC. The more L2ARC you add the more ram you need in your system. The FreeNAS guide recommends no L2ARC till you get past 64GB of ram (as it can actually slow you down). That might be a bit extreme, but an example none the less.
The 730 and S3500s were pretty much identical (within a margin of error). In my tests it was 480GB 730, 120GB S3500 and 200GB S3700. SLOG devices do not need to be big (<16GB, usually 8 is fine) . Sync write speed didn't seem to be dependent on # of channels (likely a controller limit) so 480 vs 120 didn't do much. May for consistency though.
If you are running a full SSD array of 730/S3500/S3700s you will not need a SLOG at all as they can commit sync writes fast enough that it wont hold you up. Not familiar with the HUSSL4020ASS600 . In fact the 4 730s I have (2 mirrors) can do sync writes ~25% faster then the single S3700 and my spinners.
The 730 and S3500s were pretty much identical (within a margin of error). In my tests it was 480GB 730, 120GB S3500 and 200GB S3700. SLOG devices do not need to be big (<16GB, usually 8 is fine) . Sync write speed didn't seem to be dependent on # of channels (likely a controller limit) so 480 vs 120 didn't do much. May for consistency though.
If you are running a full SSD array of 730/S3500/S3700s you will not need a SLOG at all as they can commit sync writes fast enough that it wont hold you up. Not familiar with the HUSSL4020ASS600 . In fact the 4 730s I have (2 mirrors) can do sync writes ~25% faster then the single S3700 and my spinners.
Gotcha! Thanks.
Good to know about the drive speeds.
Yeah, no SSD will have L2ARC. With that said, can yo have seperate L2ARCs for separate ARRays?
IE:
1- SSD array with L2ARC of a ZeusRAM SSD.
1- SPINNER array with L2ARC of SSD Pool
Good to know about the drive speeds.
Yeah, no SSD will have L2ARC. With that said, can yo have seperate L2ARCs for separate ARRays?
IE:
1- SSD array with L2ARC of a ZeusRAM SSD.
1- SPINNER array with L2ARC of SSD Pool
Yes each pool can have its own L2ARC . So for example your SSD pool wont benefit from it (will read faster then any cache you put on it) but a spinner pool would some value in having a SSD read cache.
I mentioned the ZeusRAM SSD on purpose I think you missed that
I think it would benefit a SSD array
I didn't miss it, I just don't think it will help and is way too small for a L2ARC. Remember L2ARC is a read cache (in addition to system ram). So having a 8GB of read cache, even if it is a Zues RAM is not going to help you when you can pull data off a SSD array quite a bit faster. Spinners with low IOPs is a different story, but you are going to want way more then 8GB. My 2c anyways.
Now using a ZuesRAM as a SLOG on a SSD array is different but I doubt it is going to be worlds better then your native SSD pool. It seems to trail even a single S3700 (unless you are wiring massive amounts of data)
Now using a ZuesRAM as a SLOG on a SSD array is different but I doubt it is going to be worlds better then your native SSD pool. It seems to trail even a single S3700 (unless you are wiring massive amounts of data)