Oracle Solaris 11.4

Discussion in 'Solaris, Nexenta, OpenIndiana, and napp-it' started by gea, Jan 3, 2018.

  1. m4r1k

    m4r1k Member

    Joined:
    Nov 4, 2016
    Messages:
    44
    Likes Received:
    5
    That’s Oracle’s strategy. The same happened on 11.2 to 11.3
     
    #81
  2. mstone

    mstone Active Member

    Joined:
    Mar 11, 2015
    Messages:
    505
    Likes Received:
    117
    to be fair, even with paid support their upgrades always kinda sucked
     
    #82
  3. nezach

    nezach Active Member

    Joined:
    Oct 14, 2012
    Messages:
    158
    Likes Received:
    70
    I was able to update from 11.2 to 11.3 using "pkg update" without problems, didn't need to do re-install.
     
    #83
  4. gea

    gea Well-Known Member

    Joined:
    Dec 31, 2010
    Messages:
    2,097
    Likes Received:
    674
    #84
  5. gea

    gea Well-Known Member

    Joined:
    Dec 31, 2010
    Messages:
    2,097
    Likes Received:
    674
    #85
  6. Gremlin190

    Gremlin190 New Member

    Joined:
    Dec 14, 2018
    Messages:
    4
    Likes Received:
    0
    Pass through of an LSI 2308 with ESXI 6.7U1 and 11.4 doesn't seem to work. System just freezes
    Tried copying the mpt files from omnios 15028 and get a bunch of 'invalid kernel relocation type' messages and the driver does not load.
    Any suggestions or am I out of luck with this controller?
    If I am out of luck, can someone recommend one that would work?

    Snapshot of the freeze by using the “-m verbose -v” after $kern on file /rpool/boot/grub/grub.cfg
     

    Attached Files:

    #86
    Last edited: Dec 14, 2018
  7. gea

    gea Well-Known Member

    Joined:
    Dec 31, 2010
    Messages:
    2,097
    Likes Received:
    674
    #87
  8. Gremlin190

    Gremlin190 New Member

    Joined:
    Dec 14, 2018
    Messages:
    4
    Likes Received:
    0
    This has been an issue before with possibly *some* LSI 9207 cardsESXI 6U1 passthrough with Solaris 11.3

    I bought the IBM 1015 and cross flashed it to the LSI 92111 and all is fine. The card had worked for months in OmniOS

    Everything is working better than expected. One thing I'd like to know is how I can get rid of the picket fence when writing. I tried adding write cache, but it still happens. I understand that it's a flush from memory, but I have over 550MB/s bandwidth and I am only writing at gigabit speeds

    upload_2018-12-22_13-12-44.png
     
    #88
  9. gea

    gea Well-Known Member

    Joined:
    Dec 31, 2010
    Messages:
    2,097
    Likes Received:
    674
    This is the effect of the writecache flush in Solaris every 5s.
    Solaris collects all (small) writes in RAM for 5s and writes it then as a single large sequential write to pool. This is why performance goes to upper limit (write to RAM) and zero duting a flush to pool.

    Open-ZFS (OmniOS) behaves different. There the cache is size determined, ex 4GB/ 10% of RAM. A flush to disk is initiated there when the cache is full not after a given time.

    The result is that on short write peaks Solaris ZFS is much faster (ok, Solaris is mostly faster) while Open-ZFS has a more even write behaviour on a steady write load without reaching the upper limit but without the drops. The effective performance is the area covered by the graph over say your 60s.
     
    #89
    Last edited: Dec 22, 2018
    sth likes this.
  10. gea

    gea Well-Known Member

    Joined:
    Dec 31, 2010
    Messages:
    2,097
    Likes Received:
    674
    SMB performance on Solaris 11.4 with Windows 10 clients

    There are reports of performance problems with a default Solaris 11.4 setup on Windows 10
    Windows SMB client performance issues | Oracle Community

    This is fixed in current Solaris service releases (requires a subscription)
    To fix the problem on a base Solaris setup:

    #add to /etc/system
    set ip:tcp_reass_max=3000
     
    #90
    gigatexal and Boris like this.
  11. DedoBOT

    DedoBOT New Member

    Joined:
    Dec 24, 2018
    Messages:
    15
    Likes Received:
    0
    Is this real, i want to believe but its suspicious, zpool iostat 2 output: IMG_20190526_161104.jpg

    10k +write iops?! 16 hdds in raid10, no dedicated cache drives. There is something fishy.
     
    #91
  12. gea

    gea Well-Known Member

    Joined:
    Dec 31, 2010
    Messages:
    2,097
    Likes Received:
    674
    10k write operations in 2s means around 5k per second.
    You are correct that this is far above of the pool's physical capability.

    A single disk can give around 100 physical io iops. A pool from 8 mirror vdevs can give around 800 write iops and 1600 read iops. Your remark about a cache drive points into the right direction. But a cache drive (L2Arc) is only for reads.

    Here you see the effect of the rambased write cache. On Solaris it has a size of around 5s of writes until it is flushed as a single large write operation to disk. Your 5k write operations are mainly writes to ram.

    If you enable sync without an Slog where every write commit must land on disk your write operations per second should be more in the region of the physical capability of the pool.
     
    #92
  13. DedoBOT

    DedoBOT New Member

    Joined:
    Dec 24, 2018
    Messages:
    15
    Likes Received:
    0
    Thank Gea for detailed explanation.
    Default pool's setup,atime=off datasets. Ram 128 gb .
     
    #93
    Last edited: May 26, 2019
  14. Evan

    Evan Well-Known Member

    Joined:
    Jan 6, 2016
    Messages:
    2,631
    Likes Received:
    383
    I wound up @gea estimate of 100 write IOP’s to maybe 150 though on the newer disk would be possible.
    But a safe rule of thumb as pointed out is 100 iops per spinning disk.
     
    #94
Similar Threads: Oracle Solaris
Forum Title Date
Solaris, Nexenta, OpenIndiana, and napp-it Oracle Solaris 11.3 and Intel X552/X554 10GbE drivers May 21, 2017
Solaris, Nexenta, OpenIndiana, and napp-it Oracle Solaris 11.3 Oct 28, 2015
Solaris, Nexenta, OpenIndiana, and napp-it Oracle Solaris 11.3 beta Jul 19, 2015
Solaris, Nexenta, OpenIndiana, and napp-it Oracle rumours Dec 4, 2016
Solaris, Nexenta, OpenIndiana, and napp-it An Oracle ZFS Storage All in One Appliance for your Home Lab Nov 28, 2015

Share This Page