That does look good. So those are the same two VMs you were using for file transfer test? I know you also clocked a vmotion (assuming that's what you meant), but I think it's important to separate that kind of activity since there is more involved than a straight copy of files.
For a plain old file copy test between VMs are you using samba shares?
Sorry for the delay in replying but I think I have some good news. My new Samsung SM863 480GB SATA SSD drive arrived today. After setting it up as a single drive datastore connected to one of the SAS ports on the LSI-2308 controller all I can say is...WOW! I am now getting 400+MB/s write speeds!! I feel like I have hit the jackpot or have a brand new server. Migrating a VM from one of the consumer SSDs to the Enterprise drive took about 98 seconds whereas this used to take about 20min between two consumer driver!
I then deleted the datastore with the enterprise drive and enabled VSAN. I used the enterprise drive for the capacity tier and my consumer Samsung 850 Pro NVMe PCIe SSD drive for the cache tier. Performance was....disappointing but not bad. I was getting about 200MB/s write speeds so clearly this NVMe drive ISN'T a good choice for VSAN.
I have a bit more testing to do but I was thinking of using two of the SM863 drives in a VSAN datastore and then doing another test.
Things are looking up! I'll be avoiding consumer gear from now on if I have the choice ;-)