LSI 9300-8i Freenas SCSI Error Logs

Discussion in 'RAID Controllers and Host Bus Adapters' started by azev, Nov 21, 2018.

  1. azev

    azev Active Member

    Joined:
    Jan 18, 2013
    Messages:
    509
    Likes Received:
    124
    Just finished setting up a new all flash raid array in a supermicro CSE-836 case with BPN-SAS2-836EL2 backplane and are having some weird issue. The SSD i am using is Lenovo OEM HUSSM1680 800gb variance.
    The logs are created whenever there's a heavy load on the array and I tried upgrading both the controller firmware to the latest P16, as well as replace the cable. I also tried shuffling the ssd just so i eliminate the issue with particular drive. Unfortunately the issue persist although much less that it was before I replace the cable & upgrade the firmware.
    Here are the log I am seeing:

    Nov 21 02:06:46 freenas (da9:mpr0:0:27:0): READ(10). CDB: 28 00 30 98 38 c8 00 00 20 00
    Nov 21 02:06:46 freenas (da9:mpr0:0:27:0): CAM status: SCSI Status Error
    Nov 21 02:06:46 freenas (da9:mpr0:0:27:0): SCSI status: Check Condition
    Nov 21 02:06:46 freenas (da9:mpr0:0:27:0): SCSI sense: ABORTED COMMAND asc:4b,4 (NAK received)
    Nov 21 02:06:46 freenas (da9:mpr0:0:27:0): Retrying command (per sense data)
    Nov 21 02:07:06 freenas (da9:mpr0:0:27:0): READ(10). CDB: 28 00 30 6f 2b 78 00 00 10 00
    Nov 21 02:07:06 freenas (da9:mpr0:0:27:0): CAM status: SCSI Status Error
    Nov 21 02:07:06 freenas (da9:mpr0:0:27:0): SCSI status: Check Condition
    Nov 21 02:07:06 freenas (da9:mpr0:0:27:0): SCSI sense: ABORTED COMMAND asc:4b,4 (NAK received)
    Nov 21 02:07:06 freenas (da9:mpr0:0:27:0): Retrying command (per sense data)
    Nov 21 02:07:53 freenas (da9:mpr0:0:27:0): READ(10). CDB: 28 00 23 fc a3 e0 00 00 08 00
    Nov 21 02:07:53 freenas (da9:mpr0:0:27:0): CAM status: SCSI Status Error
    Nov 21 02:07:53 freenas (da9:mpr0:0:27:0): SCSI status: Check Condition
    Nov 21 02:07:53 freenas (da9:mpr0:0:27:0): SCSI sense: ABORTED COMMAND asc:4b,4 (NAK received)

    The server is running the latest stable freenas (FreeNAS-11-STABLE) and it is setup using active/active multipath.

    When the issue occuring, there's a major drop in performance which you can see during activities such as svmotion between 2 different iscsi zvol.

    One thing I have not tried is to replace the controller with the onboard SAS2308 controller, this way both controller and backplane are all 6gb, and I have supermicro sas cable just to eliminate the possibility of bad generic quality cable.

    Anyone have seen similar issue ?? any idea or suggestion what I should try next to troubleshoot the issue ?
     
    #1
  2. Rand__

    Rand__ Well-Known Member

    Joined:
    Mar 6, 2014
    Messages:
    2,646
    Likes Received:
    357
    Cable or drive I'd say
     
    #2
  3. PnoT

    PnoT Active Member

    Joined:
    Mar 1, 2015
    Messages:
    560
    Likes Received:
    113
    I second a fresh cable being put in and test.
     
    #3
  4. Dave Corder

    Dave Corder New Member

    Joined:
    Dec 21, 2015
    Messages:
    24
    Likes Received:
    10
    I vaguely recall hearing about something similar with a 92xx card that turned out to be inadequate cooling of the controller. How's your cooling setup?
     
    #4
  5. azev

    azev Active Member

    Joined:
    Jan 18, 2013
    Messages:
    509
    Likes Received:
    124
    Ok, I plan to buy a supermicro cable from supermicro store and see if that helps.

    Hmmm I can't see the temp of the controller via cli in freenas or at least I dont know how... But I assume supermicro 836 chassis have sufficient cooling from the factory. I even set the fan speed at maximum just to see if it was cooling, but it still throwing the same error.

    I regret swapping cables and updating firmware the same time, now I am not sure what actually helps during the initial troubleshooting.

    Maybe I'll just drop the 9300-8i controller and just use the onboard 2308 controller, the reason I use 9300-8i is to eliminate bottleneck, but if I think about it again, the backplane is the bottleneck since this is all SSD setup.
     
    #5
Similar Threads: 9300-8i Freenas
Forum Title Date
RAID Controllers and Host Bus Adapters Can't get LSI 9300-8i to work in Supermicro X10 board Apr 30, 2018
RAID Controllers and Host Bus Adapters LSI SAS 9300-8i - LTO-5 tape drive not being shown Apr 15, 2018
RAID Controllers and Host Bus Adapters LSI 9300-8i does it run 8087 @ 6GB/s? Compatibility with SAS2? Jan 23, 2018
RAID Controllers and Host Bus Adapters LSI 9300-8I IT Mode not seeing drives in windows Sep 21, 2017
RAID Controllers and Host Bus Adapters Crossflashed 9341-8i to 9300-8i - limited to 200MB/s!? Jul 5, 2016

Share This Page