LSI 9300-16i $129 obo

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

SINN78

Active Member
Apr 3, 2016
111
25
28
44
Yep,

Of all the boards I have kicking around in the office, it wasn't the one I expected that worked.

I already tested the Asus workstation board, and a Supermicro board as well. Both gave me problems.

It was this old custom build mini ITS Small Form Factor that worked when nothing else would...

View attachment 25551

Since I don't need it, I took the opportunity to remove the bios (for faster boot times) by doing a:

SAS3FLASH -c 0 -o -e 6

to erase the first one and

SAS3FLASH -c 1 -o -e 6

to erase the second.

Then reflashed with new firmware only (no bios) with

SAS3FLASH -c 0 -o -f <firmware.bin>
SAS3FLASH -c 1 -o -f <firmware.bin>

Worked like a charm once I found a compatible board.

Side note:

These puppies get HOT even when idle in an open air situation in a cold New England winter room.

I might add an additional fan over it just to keep it reasonable.
Thanks for posting the link to the firmware, in my case I had to use the sas3flash.efi after booting into an UEFI shell
just leaving this here in case anyone runs into issues
 
  • Like
Reactions: mattlach

ocfguy

Active Member
Oct 25, 2022
100
50
28
So I bought a 9300-16i on eBay for $85, and I called Broadcom/LSI to verify the serial number, which was valid.

I was a little nervous about the power draw so I mounted a NF-F12 iPPC running at ~2000 rpm, and I'm seeing

ROC temperature(Degree Celsius) = 39
ROC temperature(Degree Celsius) = 36

at 65F/18C ambient with 8 drives plugged in to one of the two controllers (I'm assuming it's the hotter one).

Flashed the firmware from TrueNAS above and it's running pretty smoothly.
 

ocfguy

Active Member
Oct 25, 2022
100
50
28
For reference, the SAS3108 on a Supermicro X10 motherboard in a 2U chassis is running at 51C and a SAS3008 on a Supermicro AOC in a 2U chassis is running at 66C (ambient ~71F/22C)
 
  • Like
Reactions: Rcdriver and Fritz

mattlach

Active Member
Aug 1, 2014
343
97
28
@myongha I think this is the latest firmware (16.00.12.00 vs 16.00.11.00 on Broadcom's website).
That's very interesting.

It's highly uncommon for firmwares like this to be special made together with an open source project, and not to be available on the hardware manufacturers own website.

I have not seen any disconnect issues with mine with sata drives under Linux. I wonder if it is a specific FreeBSD issue it addresses.

Thanks for the heads up either way. This is good to know!
 

Fritz

Well-Known Member
Apr 6, 2015
3,386
1,387
113
70
That's very interesting.

It's highly uncommon for firmwares like this to be special made together with an open source project, and not to be available on the hardware manufacturers own website.

I have not seen any disconnect issues with mine with sata drives under Linux. I wonder if it is a specific FreeBSD issue it addresses.

Thanks for the heads up either way. This is good to know!
Sounds like you've never searched Broadcom / Avago website for drivers, LOL.
 
  • Like
Reactions: mattlach

mattlach

Active Member
Aug 1, 2014
343
97
28
Sounds like you've never searched Broadcom / Avago website for drivers, LOL.
Lol, I am well aware how difficult it is to find drivers on their site, just look at my post earlier in this thread :p
It's just that usually difficult to find or not, they are at least there.

This appears to be a special firmware solely distributed by the TrueNAS project, which is highly unusual.
 

Fritz

Well-Known Member
Apr 6, 2015
3,386
1,387
113
70
Lol, I am well aware how difficult it is to find drivers on their site, just look at my post earlier in this thread :p
It's just that usually difficult to find or not, they are at least there.

This appears to be a special firmware solely distributed by the TrueNAS project, which is highly unusual.
I am so utterly disgusted with their site that I actually look for firmware on other sites. It's absolutely ridiculous that files are so hard to find. And search is totally useless. Yea, I hope somebody at Broadcom reads this. :p
 

mattlach

Active Member
Aug 1, 2014
343
97
28
I am so utterly disgusted with their site that I actually look for firmware on other sites. It's absolutely ridiculous that files are so hard to find. And search is totally useless. Yea, I hope somebody at Broadcom reads this. :p
I'm with you, but at the same time I have an inherent distrust of files not distributed on their official websites. There is a lot of malware out there. An open source project like FreeNAS as is one of the few 3rd parties I'd actually trust.

When I am forced to search the Broadcoms site and others with similar problems for drivers and firmware I usually use Google with the "site:broadcom.com" filter. It's usually more successful than using their actual on site search or navigation.
 
Last edited:
  • Like
Reactions: gsambolin

Fritz

Well-Known Member
Apr 6, 2015
3,386
1,387
113
70
I'm with you, but at the same time I have an inherent distrust of files bit distributed on their official websites. There is a lot of malware out there. An open source project like Green as is one of the few 3rd parties I'd actually trust.

When I am forces to search broadcoms site for drivers and firmware I usually use Google with the "site:broadcom.com" filter. It's usually more successful than using their actual site.
Thanks, I'll have to try that.
 

bambinone

New Member
Dec 26, 2020
18
21
3
Chicago, Illinois
There are a couple of listings for $75 now.
I bought one of the $75 ones from this listing to replace a 9212-4i4e and I'm pretty sure I got a brand new card. I had the same issue as @mattlach disabling Secure Boot on an Asus board (X99 in my case) and ended up creating a quick VM with UEFI "firmware", passing through the two PCIe devices, and booting up an EFI shell following the directions here (just the first part) so I could use sas3flash.efi to erase the boot areas and flash the latest firmware.

It's a neat card. The two controllers get their own IOMMU groups, and I have one passed through to my always-on Windows VM. This lets me divvy up the hot-swap bays in my system between Linux and Windows so I have some flexibility when doing data recovery, disk imaging, etc. The controllers are reset-able so I can shut down Windows and it comes right back in Linux. (The one caveat is that you can't run sas3flash from Linux when one of the two controllers is passed through... hard crash and corrupt firmware.)

I went back into the system this morning to swap out another card and just about burned the tips of my fingers off. I suppose the supplemental PCIe power input on the card should have raised more red flags! That's with a 200mm fan blowing cool air down on it, so I might need to get something smaller with more directed airflow to keep it cooler. I wish Broadcom would give us better power management control over these things... with each generation it seems to become more and more of an issue.

lspci -tv
Code:
|           +-02.0-[04-08]----00.0-[05-08]--+-00.0-[06]----00.0  Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3
|           |                               +-08.0-[07]--
|           |                               \-09.0-[08]----00.0  Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3
lspci -knn
Code:
4:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:87
24] (rev ca)
        Subsystem: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:8724]
        Kernel driver in use: pcieport
05:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:8724] (rev ca)
        Subsystem: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:8724]
05:08.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:8724] (rev ca)
        Subsystem: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:8724]
        Kernel driver in use: pcieport
05:09.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:8724] (rev ca)
        Subsystem: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:8724]
        Kernel driver in use: pcieport
06:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3 [1000:0097] (rev 02)
        Subsystem: Broadcom / LSI SAS 9300-16i [1000:3130]
        Kernel driver in use: mpt3sas
        Kernel modules: mpt3sas
08:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3 [1000:0097] (rev 02)
        Subsystem: Broadcom / LSI SAS 9300-16i [1000:3130]
        Kernel driver in use: vfio-pci
        Kernel modules: mpt3sas
IOMMU groups
Code:
IOMMU Group 54:
        04:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:8724] (rev ca)
IOMMU Group 55:
        05:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:8724] (rev ca)
IOMMU Group 56:
        05:08.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:8724] (rev ca)
IOMMU Group 57:
        05:09.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8724 24-Lane, 6-Port PCI Express Gen 3 (8 GT/s) Switch, 19 x 19mm FCBGA [10b5:8724] (rev ca)
IOMMU Group 58:
        06:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3 [1000:0097] (rev 02)
IOMMU Group 59:
        08:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS3008 PCI-Express Fusion-MPT SAS-3 [1000:0097] (rev 02)
SAS3Flash -listall (Linux)
Code:
Avago Technologies SAS3 Flash Utility
Version 17.00.00.00 (2018.04.02)
Copyright 2008-2018 Avago Technologies. All rights reserved.

    Adapter Selected is a Avago SAS: SAS3008(C0)

Num   Ctlr            FW Ver        NVDATA        x86-BIOS         PCI Addr
----------------------------------------------------------------------------

0  SAS3008(C0)  16.00.10.00    0e.01.00.03      No Image      00:06:00:00
1  SAS3008(C0)  16.00.10.00    0e.01.00.03      No Image      00:08:00:00

    Finished Processing Commands Successfully.
    Exiting SAS3Flash.
SAS3Flash -list (Windows)
Code:
Avago Technologies SAS3 Flash Utility
Version 17.00.00.00 (2018.04.02)
Copyright 2008-2018 Avago Technologies. All rights reserved.

        Adapter Selected is a Avago SAS: SAS3008(C0)

        Controller Number              : 0
        Controller                     : SAS3008(C0)
        PCI Address                    : 00:08:00:00
        SAS Address                    : 500062b-2-0026-c440
        NVDATA Version (Default)       : 0e.01.00.03
        NVDATA Version (Persistent)    : 0e.01.00.03
        Firmware Product ID            : 0x2221 (IT)
        Firmware Version               : 16.00.10.00
        NVDATA Vendor                  : LSI
        NVDATA Product ID              : SAS9300-16i
        BIOS Version                   : N/A
        UEFI BSD Version               : N/A
        FCODE Version                  : N/A
        Board Name                     : SAS9300-16i
        Board Assembly                 : 03-25600-01B
        Board Tracer Number            : SP52410893

        Finished Processing Commands Successfully.
        Exiting SAS3Flash.
 

Attachments

Last edited:
  • Like
Reactions: custom90gt

undecided

New Member
Jan 28, 2023
8
11
3
Yep,

Of all the boards I have kicking around in the office, it wasn't the one I expected that worked.

I already tested the Asus workstation board, and a Supermicro board as well. Both gave me problems.

It was this old custom build mini ITX-Small Form Factor that worked when nothing else would...

View attachment 25551

Since I don't need it, I took the opportunity to remove the bios (for faster boot times) by doing a:

SAS3FLASH -c 0 -o -e 6

to erase the first one and

SAS3FLASH -c 1 -o -e 6

to erase the second.

Then reflashed with new firmware only (no bios) with

SAS3FLASH -c 0 -o -f <firmware.bin>
SAS3FLASH -c 1 -o -f <firmware.bin>

Worked like a charm once I found a compatible board.

Side note:

These puppies get HOT even when idle in an open air situation in a cold New England winter room.

I might add an additional fan over it just to keep it reasonable.
So, will this work in dos using the SAS3FLSH utility? Any risk in removing the bios? Can it be reinstalled if needed?
 

undecided

New Member
Jan 28, 2023
8
11
3
Hi, I seem to be getting 'Write Errors' on a bunch of my HDDs that are attached to the 9300-16i. This happens under heavy load. The drives themselves seem fine. The SSDs that are on a separate RAID group do not have these issues. Is it a case of a defective 9300-16i or do you think I need to add the addition pciex power? It's plugged into a pciEx 16 so I figured that would have enough power. It also has a 92mm fan so it's nice and cool. I have a Corsair Rm750x, which is modular. Which power output should I use to provide the extra power if that is indeed the issue?
 
Last edited:

Fritz

Well-Known Member
Apr 6, 2015
3,386
1,387
113
70
Hi, I seem to be getting 'Write Errors' on a bunch of my HDDs that are attached to the 9300-16i. This happens under heavy load. The drives themselves seem fine. The SSDs that are on a separate RAID group do not have these issues. Is it a case of a defective 9300-16i or do you think I need to add the addition molex power? It's plugged into a pciEx 16 so I figured that would have enough power. It also has a 92mm fan so it's nice and cool. I have a Corsair Rm750x, which is modular. Which power output should I use to provide the extra power if that is indeed the issue?
Are you using a backplane?