LSI 9400-16i Power-on or device reset occurred

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
D

Darkwing314

New Member
Oct 30, 2025
29
8
3
Hi everyone,

EDIT: For anyone just starting to read this, the TL;DR is that my Gooxi backplane had an old firmware that had issues handling some health checks while drives were loaded. Updating the firmware of the backplane completely resolved the issue for me.

Sorry in advance for the wall of text. I figured it could be useful to see the whole story.

I've recently built up a new storage server based on a Supermicro X11SAE motherboard with an Epyc 7304p CPU all in a 36-bay chassis. I picked up a used (ebay special, from China, possibly a 'knockoff' and the source of my problems? more on that later) LSI 9400-16i and for the most part it has been working great. Read/writes are solid (or so I thought). A bit more about the system in case it's relevant: I'm running TrueNAS Scale virtualized in Proxmox. HBA is passed through so TrueNAS has direct access to the drives. Like I said, it's by all appearances working great (I can read at 800MB/s from the ZFS array over my 10g network). I've been super happy with it.

On to the problem. I started getting complaints fairly soon after deploying this system from people streaming media from me (mostly in my own household) that occasionally media playback would freeze up (pause) for 10-30 seconds, then start, then freeze, then start a few times. This would go on for maybe 3-5 minutes and then it goes back to normal. Typically this only happens once or twice a day. Initially I wrote this off as a random glitch but then a pattern emerged. This issue was always happening at 10:26pm (fairly reliably in fact, it just depended on if anyone was also streaming anything at the time). Then I saw it happen a few times at 7:26pm and once at 1:26pm. Initially I assumed it was something related to the media server (I'm using Emby) but after looking it's it's logs it became clear it was a bigger problem then that - it was seeing a dropped connection to the server every time this happens so it seemed to be a server issue.

Through some investigation I discovered that the proxmox server was last rebooted also at 10:26pm so it seemed like something was happening on an hourly or every 3 hour period and causing this occasionally. I spent a ton of time investigating all my services to see if one of them was causing it (I have a separate VM where I run a couple dozen docker containers). Long story short, I couldn't find anything that was happening at xx:26 and was back to square one.

Then I looked at TrueNAS itself and noticed at the same time as the problem, the "System Load" was spiking to >10 whereas it's normally more like 0.4 when something is streaming. Through some testing I found out that during the problematic time (shortly after 10:26pm), reads/writes to the server (over SMB) would drop to zero and start timing out. If I started a transfer before 10:26 it would run at 800MB/s, then drop to zero for a few minutes, then carry on as if nothing happened. Okay, so now I've isolated this to TrueNAS. I rebooted the TrueNAS VM (to see if the xx:26 pattern changed) and sure enough, it no longer happens like clock-work. In fact it seems a bit random now as to when it occurs but it's only been a few days since I rebooted so maybe I just haven't figured out the pattern yet.

Onwards: last night I dug into this deeper and discovered the following in dmesg. What I think this is showing me (looking for confirmation of this) is that my HBA is causing the issue. It looks like it's basically dropping the connection to all of my drives (I have 8x 20TB drives in ZFS RAIDZ2) and then once they recover all is good until it happens again. Why this hasn't corrupted the ZFS pool I have no idea (I'm new to ZFS) but I'm thankful for that at least.

Code: 
[599381.601538] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
[599443.038701] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
[599504.476025] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
[599565.913107] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
[599627.350522] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
[599666.296559] sd 2:0:9:0: attempting task abort!scmd(0x0000000020e32656), outstanding for 31112 ms & timeout 30000 ms
[599666.296573] sd 2:0:9:0: [sdj] tag#4799 CDB: Read(16) 88 00 00 00 00 03 b7 76 f8 38 00 00 00 28 00 00
[599666.296578] scsi target2:0:9: handle(0x001b), sas_address(0x3474f4f584a11c0f), phy(15)
[599666.296585] scsi target2:0:9: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[599666.296590] scsi target2:0:9: enclosure level(0x0000), connector name( C0  )
[599666.560446] sd 2:0:9:0: task abort: SUCCESS scmd(0x0000000020e32656)
[599666.899646] sd 2:0:9:0: Power-on or device reset occurred
[599688.787603] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
[599699.063186] sd 2:0:9:0: attempting task abort!scmd(0x00000000f04428cd), outstanding for 32052 ms & timeout 30000 ms
[599699.063200] sd 2:0:9:0: [sdj] tag#4746 CDB: Inquiry 12 00 00 00 24 00
[599699.063206] scsi target2:0:9: handle(0x001b), sas_address(0x3474f4f584a11c0f), phy(15)
[599699.063213] scsi target2:0:9: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[599699.063218] scsi target2:0:9: enclosure level(0x0000), connector name( C0  )
[599699.558451] sd 2:0:9:0: task abort: SUCCESS scmd(0x00000000f04428cd)
[599699.558490] sd 2:0:9:0: attempting task abort!scmd(0x00000000ae37a982), outstanding for 32560 ms & timeout 30000 ms
[599699.558497] sd 2:0:9:0: [sdj] tag#4745 CDB: Write(16) 8a 00 00 00 00 06 a0 01 3a e8 00 00 00 08 00 00
[599699.558502] scsi target2:0:9: handle(0x001b), sas_address(0x3474f4f584a11c0f), phy(15)
[599699.558508] scsi target2:0:9: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[599699.558513] scsi target2:0:9: enclosure level(0x0000), connector name( C0  )
[599699.558519] sd 2:0:9:0: No reference found at driver, assuming scmd(0x00000000ae37a982) might have completed
[599699.558524] sd 2:0:9:0: task abort: SUCCESS scmd(0x00000000ae37a982)
[599699.558560] sd 2:0:9:0: attempting task abort!scmd(0x00000000f7c8812b), outstanding for 32560 ms & timeout 30000 ms
[599699.558566] sd 2:0:9:0: [sdj] tag#4744 CDB: Write(16) 8a 00 00 00 00 06 a0 01 3a d0 00 00 00 08 00 00
[599699.558570] scsi target2:0:9: handle(0x001b), sas_address(0x3474f4f584a11c0f), phy(15)
[599699.558575] scsi target2:0:9: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[599699.558580] scsi target2:0:9: enclosure level(0x0000), connector name( C0  )
[599699.558585] sd 2:0:9:0: No reference found at driver, assuming scmd(0x00000000f7c8812b) might have completed
[599699.558590] sd 2:0:9:0: task abort: SUCCESS scmd(0x00000000f7c8812b)
[599699.558620] sd 2:0:9:0: attempting task abort!scmd(0x000000007706778f), outstanding for 64372 ms & timeout 30000 ms
[599699.558626] sd 2:0:9:0: [sdj] tag#4743 CDB: Read(16) 88 00 00 00 00 03 b7 76 f8 08 00 00 00 28 00 00
[599699.558630] scsi target2:0:9: handle(0x001b), sas_address(0x3474f4f584a11c0f), phy(15)
[599699.558635] scsi target2:0:9: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[599699.558640] scsi target2:0:9: enclosure level(0x0000), connector name( C0  )
[599699.558645] sd 2:0:9:0: No reference found at driver, assuming scmd(0x000000007706778f) might have completed
[599699.558649] sd 2:0:9:0: task abort: SUCCESS scmd(0x000000007706778f)
[599700.019498] sd 2:0:9:0: Power-on or device reset occurred
[599731.825577] sd 2:0:8:0: attempting task abort!scmd(0x00000000b5635389), outstanding for 30912 ms & timeout 30000 ms
[599731.825590] sd 2:0:8:0: [sdi] tag#4796 CDB: Read(16) 88 00 00 00 00 03 b7 77 3e 68 00 00 00 28 00 00
[599731.825596] scsi target2:0:8: handle(0x001a), sas_address(0x3474f4f584a11c0e), phy(14)
[599731.825604] scsi target2:0:8: enclosure logical id(0x3474f4f584a11c3e), slot(14)
[599731.825609] scsi target2:0:8: enclosure level(0x0000), connector name( C0  )
[599732.306434] sd 2:0:8:0: task abort: SUCCESS scmd(0x00000000b5635389)
[599732.306448] sd 2:0:8:0: attempting task abort!scmd(0x00000000f5f98665), outstanding for 31336 ms & timeout 30000 ms
[599732.306453] sd 2:0:8:0: [sdi] tag#4736 CDB: Read(16) 88 00 00 00 00 03 b7 77 3e 90 00 00 00 58 00 00
[599732.306455] scsi target2:0:8: handle(0x001a), sas_address(0x3474f4f584a11c0e), phy(14)
[599732.306459] scsi target2:0:8: enclosure logical id(0x3474f4f584a11c3e), slot(14)
[599732.306462] scsi target2:0:8: enclosure level(0x0000), connector name( C0  )
[599732.306465] sd 2:0:8:0: No reference found at driver, assuming scmd(0x00000000f5f98665) might have completed
[599732.306468] sd 2:0:8:0: task abort: SUCCESS scmd(0x00000000f5f98665)
[599732.646094] sd 2:0:8:0: Power-on or device reset occurred
[599750.225074] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
[599764.596187] sd 2:0:7:0: attempting task abort!scmd(0x000000006d10dbd2), outstanding for 31248 ms & timeout 30000 ms
[599764.596201] sd 2:0:7:0: [sdh] tag#4788 CDB: Write(16) 8a 00 00 00 00 06 a0 01 3b d8 00 00 00 08 00 00
[599764.596207] scsi target2:0:7: handle(0x0019), sas_address(0x3474f4f584a11c0d), phy(13)
[599764.596214] scsi target2:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(13)
[599764.596219] scsi target2:0:7: enclosure level(0x0000), connector name( C0  )
[599765.054605] sd 2:0:7:0: task abort: SUCCESS scmd(0x000000006d10dbd2)
[599765.054619] sd 2:0:7:0: attempting task abort!scmd(0x00000000357b6c28), outstanding for 31744 ms & timeout 30000 ms
[599765.054623] sd 2:0:7:0: [sdh] tag#4787 CDB: Write(16) 8a 00 00 00 00 06 a0 01 3b c0 00 00 00 08 00 00
[599765.054626] scsi target2:0:7: handle(0x0019), sas_address(0x3474f4f584a11c0d), phy(13)
[599765.054629] scsi target2:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(13)
[599765.054632] scsi target2:0:7: enclosure level(0x0000), connector name( C0  )
[599765.054635] sd 2:0:7:0: No reference found at driver, assuming scmd(0x00000000357b6c28) might have completed
[599765.054638] sd 2:0:7:0: task abort: SUCCESS scmd(0x00000000357b6c28)
[599765.396465] sd 2:0:7:0: Power-on or device reset occurred
[599797.362635] sd 2:0:7:0: attempting task abort!scmd(0x00000000a829bbf8), outstanding for 31688 ms & timeout 30000 ms
[599797.362645] sd 2:0:7:0: [sdh] tag#4791 CDB: Read(16) 88 00 00 00 00 03 b7 77 5a 00 00 00 06 28 00 00
[599797.362649] scsi target2:0:7: handle(0x0019), sas_address(0x3474f4f584a11c0d), phy(13)
[599797.362653] scsi target2:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(13)
[599797.362656] scsi target2:0:7: enclosure level(0x0000), connector name( C0  )
[599797.802532] sd 2:0:7:0: task abort: SUCCESS scmd(0x00000000a829bbf8)
[599797.802604] sd 2:0:7:0: attempting task abort!scmd(0x00000000cdc5d40a), outstanding for 32056 ms & timeout 30000 ms
[599797.802610] sd 2:0:7:0: [sdh] tag#4790 CDB: Write(16) 8a 00 00 00 00 06 a0 01 3c 28 00 00 00 28 00 00
[599797.802613] scsi target2:0:7: handle(0x0019), sas_address(0x3474f4f584a11c0d), phy(13)
[599797.802617] scsi target2:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(13)
[599797.802620] scsi target2:0:7: enclosure level(0x0000), connector name( C0  )
[599797.802623] sd 2:0:7:0: No reference found at driver, assuming scmd(0x00000000cdc5d40a) might have completed
[599797.802626] sd 2:0:7:0: task abort: SUCCESS scmd(0x00000000cdc5d40a)
[599798.141499] sd 2:0:7:0: Power-on or device reset occurred
[599811.662235] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
[599830.121282] sd 2:0:5:0: attempting task abort!scmd(0x00000000ec185423), outstanding for 30568 ms & timeout 30000 ms
[599830.121296] sd 2:0:5:0: [sdf] tag#4765 CDB: Read(16) 88 00 00 00 00 03 b7 77 d8 20 00 00 00 30 00 00
[599830.121301] scsi target2:0:5: handle(0x0017), sas_address(0x3474f4f584a11c0b), phy(11)
[599830.121308] scsi target2:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(11)
[599830.121313] scsi target2:0:5: enclosure level(0x0000), connector name( C0  )
[599830.550724] sd 2:0:5:0: task abort: SUCCESS scmd(0x00000000ec185423)
[599830.550734] sd 2:0:5:0: attempting task abort!scmd(0x00000000dbb7afbb), outstanding for 30996 ms & timeout 30000 ms
[599830.550740] sd 2:0:5:0: [sdf] tag#4764 CDB: Read(16) 88 00 00 00 00 03 b7 77 d6 f8 00 00 01 28 00 00
[599830.550743] scsi target2:0:5: handle(0x0017), sas_address(0x3474f4f584a11c0b), phy(11)
[599830.550747] scsi target2:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(11)
[599830.550750] scsi target2:0:5: enclosure level(0x0000), connector name( C0  )
[599830.550753] sd 2:0:5:0: No reference found at driver, assuming scmd(0x00000000dbb7afbb) might have completed
[599830.550756] sd 2:0:5:0: task abort: SUCCESS scmd(0x00000000dbb7afbb)
[599831.007409] sd 2:0:5:0: Power-on or device reset occurred
[599862.887922] sd 2:0:3:0: attempting task abort!scmd(0x00000000934c4112), outstanding for 30872 ms & timeout 30000 ms
[599862.887935] sd 2:0:3:0: [sdd] tag#4788 CDB: Write(16) 8a 00 00 00 00 06 a0 01 3d a0 00 00 00 18 00 00
[599862.887941] scsi target2:0:3: handle(0x0015), sas_address(0x3474f4f584a11c09), phy(9)
[599862.887948] scsi target2:0:3: enclosure logical id(0x3474f4f584a11c3e), slot(9)
[599862.887953] scsi target2:0:3: enclosure level(0x0000), connector name( C0  )
[599863.298701] sd 2:0:3:0: task abort: SUCCESS scmd(0x00000000934c4112)
[599863.636150] sd 2:0:3:0: Power-on or device reset occurred
[599873.099595] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
[599895.662359] sd 2:0:4:0: attempting task abort!scmd(0x0000000088a9fe2b), outstanding for 31144 ms & timeout 30000 ms
[599895.662373] sd 2:0:4:0: [sde] tag#4755 CDB: Write(16) 8a 00 00 00 00 03 8a 59 96 28 00 00 00 08 00 00
[599895.662379] scsi target2:0:4: handle(0x0016), sas_address(0x3474f4f584a11c0a), phy(10)
[599895.662386] scsi target2:0:4: enclosure logical id(0x3474f4f584a11c3e), slot(10)
[599895.662391] scsi target2:0:4: enclosure level(0x0000), connector name( C0  )
[599896.047082] sd 2:0:4:0: task abort: SUCCESS scmd(0x0000000088a9fe2b)
[599896.638284] sd 2:0:4:0: Power-on or device reset occurred
[599928.432807] sd 2:0:0:0: attempting task abort!scmd(0x00000000c969a1bc), outstanding for 30952 ms & timeout 30000 ms
[599928.432817] sd 2:0:0:0: [sdc] tag#4742 CDB: Write(16) 8a 00 00 00 00 06 a0 01 3f 40 00 00 00 08 00 00
[599928.432821] scsi target2:0:0: handle(0x0014), sas_address(0x3474f4f584a11c08), phy(8)
[599928.432825] scsi target2:0:0: enclosure logical id(0x3474f4f584a11c3e), slot(8)
[599928.432828] scsi target2:0:0: enclosure level(0x0000), connector name( C0  )
[599928.794807] sd 2:0:0:0: task abort: SUCCESS scmd(0x00000000c969a1bc)
[599928.794828] sd 2:0:0:0: attempting task abort!scmd(0x000000001c0c6aaf), outstanding for 31280 ms & timeout 30000 ms
[599928.794833] sd 2:0:0:0: [sdc] tag#4741 CDB: Write(16) 8a 00 00 00 00 03 8a 59 96 f0 00 00 00 08 00 00
[599928.794835] scsi target2:0:0: handle(0x0014), sas_address(0x3474f4f584a11c08), phy(8)
[599928.794839] scsi target2:0:0: enclosure logical id(0x3474f4f584a11c3e), slot(8)
[599928.794842] scsi target2:0:0: enclosure level(0x0000), connector name( C0  )
[599928.794846] sd 2:0:0:0: No reference found at driver, assuming scmd(0x000000001c0c6aaf) might have completed
[599928.794848] sd 2:0:0:0: task abort: SUCCESS scmd(0x000000001c0c6aaf)
[599929.137637] sd 2:0:0:0: Power-on or device reset occurred
[599934.536859] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
[599995.974063] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
[600057.411446] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205)
Storcli shows the following for my HBA which seems pretty generic (I was expecting to see mention of LSI or Avago or Broadcom) and I notice the FW Package Build is all zeros. I also notice that if this is a legit card the FW version (08.xx) is ancient (latest is 24.xx I think?). Also note that the mpt3sas_cm0 lines from above repeat basically every minute and I've read that these are also likely due to old firmware so that reinforces my idea that a firmware update might fix this?

Code: 
sudo storcli /c0 show nolog
CLI Version = 007.2807.0000.0000 Dec 22, 2023
Operating system = Linux 6.12.33-production+truenas
Controller = 0
Status = Success
Description = None

Product Name = HBA 9400-16i
Serial Number = SP92722307
SAS Address =  500605b00f3212d0
PCI Address = 00:00:10:00
System Time = 03/10/2026 05:05:30
FW Package Build = 00.00.00.00
FW Version = 08.00.00.00
BIOS Version = 09.15.00.00_08.00.00.00
NVDATA Version = 08.00.00.15
Driver Name = mpt3sas
Driver Version = 48.100.00.00
Bus Number = 0
Device Number = 16
Function Number = 0
Domain ID = 0
Vendor Id = 0x1000
Device Id = 0xAC
SubVendor Id = 0x1000
SubDevice Id = 0x3000
Board Name = HBA 9400-16i
Board Assembly = 03-50008-15005
Board Tracer Number = SP92722307
Security Protocol = None
Physical Drives = 8
So my questions are:
  • Do you think this is a legit 9400-16i? Or a 'knockoff' (which I understand might come out of the same factory as the originals so maybe not really a knock-off)
  • Should my next step be to try a firmware update? Will using the latest Broadcom firmware for 9400-16i even work if it's a 'knock-off' card? Is there any risk of it bricking the card and should I have a spare on-hand before I attempt this?
  • At what point should I just cut my losses and buy a replacement that is known to be legit?
  • Is there anything else that might be causing this? Could it be a bad backplane? One thing I haven't tried yet is swapping out the cable from HBA to backplane
Thanks in advance for any tips/advice you might have!
 
Last edited:
BLinux

BLinux

cat lover server enthusiast
Jul 7, 2016
2,770
1,137
113
artofserver.com
Your firmware is really outdated. This generation had a lot of problems, so as a baseline, I would update the firmware to the latest, which is P24. Not saying the problem is the firmware, but I would want to rule out any potential old firmware bugs at least.

Does the heatsink have brass pins or plastic pins? And on the back of the PCB, does it say "Assembled in Thailand"? Or does it say some other country?
 
BLinux

BLinux

cat lover server enthusiast
Jul 7, 2016
2,770
1,137
113
artofserver.com
As for other potential causes:

1) power instability. Had a customer that had inadequate power supply and under load, voltage dropped on 12v and some drives would drop out.

2) Seagate EPC issue. Search online for workaround.

3) defective cabling that is intermittently disconnecting. Although, this also often results in UDMA CRC errors increasing. Not sure if you see that?
 
D

Darkwing314

New Member
Oct 30, 2025
29
8
3
Okay, I've updated the firmware (used boot to EFI method) and that all completed successfully and I'm on v24 now (see below).

Pics of the card attached, turns out it does say AVAGO on the back, has brass pins on the heatsink and it does say Assembled in Thailand. Does that confirm this is a legit card?

dmesg output from a fresh boot included as well. Problem seems to be the same from what I can tell.

Code: 
vault% sudo storcli /c0 show nolog
CLI Version = 007.2807.0000.0000 Dec 22, 2023
Operating system = Linux 6.12.33-production+truenas
Controller = 0
Status = Success
Description = None

Product Name = HBA 9400-16i
Serial Number = SP92722307
SAS Address =  500605b00f3212d0
PCI Address = 00:00:10:00
System Time = 03/11/2026 02:21:52
FW Package Build = 24.00.00.00
FW Version = 24.00.00.00
BIOS Version = 09.15.00.00_24.00.00.00
NVDATA Version = 24.00.00.22
PSOC FW Version = 0x0001
PSOC Part Number = 05689
Driver Name = mpt3sas
Driver Version = 48.100.00.00
Bus Number = 0
Device Number = 16
Function Number = 0
Domain ID = 0
Vendor Id = 0x1000
Device Id = 0xAC
SubVendor Id = 0x1000
SubDevice Id = 0x3000
Board Name = HBA 9400-16i
Board Assembly = 03-50008-15005
Board Tracer Number = SP92722307
Security Protocol = None
Physical Drives = 8
Code: 
[    0.000000] Linux version 6.12.33-production+truenas (root@tnsbuilds02) (gcc (Debian 12.2.0-14+deb12u1) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Wed Dec 17 21:17:21 UTC 2025
[    0.000000] Command line: BOOT_IMAGE=/ROOT/25.10.1@/boot/vmlinuz-6.12.33-production+truenas root=ZFS=boot-pool/ROOT/25.10.1 ro libata.allow_tpm=1 amd_iommu=on iommu=pt kvm_amd.npt=1 kvm_amd.avic=1 intel_iommu=on zfsforce=1 nvme_core.multipath=N
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd9fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bffda000-0x00000000bfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000043fffffff] usable
[    0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] APIC: Static calls initialized
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014
[    0.000000] DMI: Memory slots populated: 1/1
[    0.000000] Hypervisor detected: KVM
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000000] kvm-clock: using sched offset of 18335888933 cycles
[    0.000001] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.000004] tsc: Detected 2999.998 MHz processor
[    0.000909] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000911] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000915] last_pfn = 0x440000 max_arch_pfn = 0x400000000
[    0.000951] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs
[    0.000953] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT
[    0.001004] last_pfn = 0xbffda max_arch_pfn = 0x400000000
[    0.003274] found SMP MP-table at [mem 0x000f5490-0x000f549f]
[    0.003284] Using GB pages for direct mapping
[    0.003414] RAMDISK: [mem 0x2dea3000-0x32f48fff]
[    0.003418] ACPI: Early table checksum verification disabled
[    0.003420] ACPI: RSDP 0x00000000000F5290 000014 (v00 BOCHS )
[    0.003424] ACPI: RSDT 0x00000000BFFE3C21 000034 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003428] ACPI: FACP 0x00000000BFFE3A2B 000074 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003432] ACPI: DSDT 0x00000000BFFDF040 0049EB (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003435] ACPI: FACS 0x00000000BFFDF000 000040
[    0.003437] ACPI: APIC 0x00000000BFFE3A9F 000090 (v03 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003440] ACPI: SSDT 0x00000000BFFE3B2F 0000CA (v01 BOCHS  VMGENID  00000001 BXPC 00000001)
[    0.003442] ACPI: WAET 0x00000000BFFE3BF9 000028 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003444] ACPI: Reserving FACP table memory at [mem 0xbffe3a2b-0xbffe3a9e]
[    0.003445] ACPI: Reserving DSDT table memory at [mem 0xbffdf040-0xbffe3a2a]
[    0.003446] ACPI: Reserving FACS table memory at [mem 0xbffdf000-0xbffdf03f]
[    0.003447] ACPI: Reserving APIC table memory at [mem 0xbffe3a9f-0xbffe3b2e]
[    0.003447] ACPI: Reserving SSDT table memory at [mem 0xbffe3b2f-0xbffe3bf8]
[    0.003448] ACPI: Reserving WAET table memory at [mem 0xbffe3bf9-0xbffe3c20]
[    0.003927] No NUMA configuration found
[    0.003929] Faking a node at [mem 0x0000000000000000-0x000000043fffffff]
[    0.003937] NODE_DATA(0) allocated [mem 0x43ffd4b40-0x43fffffff]
[    0.004140] cma: Reserved 256 MiB at 0x0000000100000000 on node -1
[    0.004170] Zone ranges:
[    0.004171]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.004172]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.004174]   Normal   [mem 0x0000000100000000-0x000000043fffffff]
[    0.004175]   Device   empty
[    0.004176] Movable zone start for each node
[    0.004177] Early memory node ranges
[    0.004178]   node   0: [mem 0x0000000000001000-0x000000000009efff]
[    0.004179]   node   0: [mem 0x0000000000100000-0x00000000bffd9fff]
[    0.004180]   node   0: [mem 0x0000000100000000-0x000000043fffffff]
[    0.004182] Initmem setup node 0 [mem 0x0000000000001000-0x000000043fffffff]
[    0.004190] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.004212] On node 0, zone DMA: 97 pages in unavailable ranges
[    0.008650] On node 0, zone Normal: 38 pages in unavailable ranges
[    0.010843] ACPI: PM-Timer IO Port: 0x608
[    0.010858] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.010894] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[    0.010897] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.010898] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.010899] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.010900] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.010902] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.010905] ACPI: Using ACPI (MADT) for SMP configuration information
[    0.010911] CPU topo: Max. logical packages:   1
[    0.010912] CPU topo: Max. logical dies:       1
[    0.010912] CPU topo: Max. dies per package:   1
[    0.010917] CPU topo: Max. threads per core:   1
[    0.010917] CPU topo: Num. cores per package:     4
[    0.010918] CPU topo: Num. threads per package:   4
[    0.010919] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs
[    0.010939] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()
[    0.010954] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.010956] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]
[    0.010957] PM: hibernation: Registered nosave memory: [mem 0xbffda000-0xffffffff]
[    0.010958] [mem 0xc0000000-0xfeffbfff] available for PCI devices
[    0.010960] Booting paravirtualized kernel on KVM
[    0.010961] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.016042] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1
[    0.016273] percpu: Embedded 66 pages/cpu s233472 r8192 d28672 u524288
[    0.016277] pcpu-alloc: s233472 r8192 d28672 u524288 alloc=1*2097152
[    0.016279] pcpu-alloc: [0] 0 1 2 3
[    0.016303] kvm-guest: PV spinlocks enabled
[    0.016305] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)
[    0.016308] Kernel command line: BOOT_IMAGE=/ROOT/25.10.1@/boot/vmlinuz-6.12.33-production+truenas root=ZFS=boot-pool/ROOT/25.10.1 ro libata.allow_tpm=1 amd_iommu=on iommu=pt kvm_amd.npt=1 kvm_amd.avic=1 intel_iommu=on zfsforce=1 nvme_core.multipath=N
[    0.016369] AMD-Vi: Unknown option - 'on'
[    0.016419] DMAR: IOMMU enabled
[    0.016447] Unknown kernel command line parameters "BOOT_IMAGE=/ROOT/25.10.1@/boot/vmlinuz-6.12.33-production+truenas zfsforce=1", will be passed to user space.
[    0.016468] random: crng init done
[    0.017786] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear)
[    0.018451] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)
[    0.018495] Fallback order for Node 0: 0
[    0.018498] Built 1 zonelists, mobility grouping on.  Total pages: 4194168
[    0.018499] Policy zone: Normal
[    0.018501] mem auto-init: stack:all(zero), heap alloc:off, heap free:off
[    0.018506] software IO TLB: area num 4.
[    0.037673] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.037702] ftrace: allocating 45371 entries in 178 pages
[    0.045043] ftrace: allocated 178 pages with 4 groups
[    0.045639] Dynamic Preempt: voluntary
[    0.045676] rcu: Preemptible hierarchical RCU implementation.
[    0.045677] rcu:     RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=4.
[    0.045678]  Trampoline variant of Tasks RCU enabled.
[    0.045678]  Rude variant of Tasks RCU enabled.
[    0.045679]  Tracing variant of Tasks RCU enabled.
[    0.045679] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.045680] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.045686] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.
[    0.045687] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.
[    0.045689] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.
[    0.048687] NR_IRQS: 524544, nr_irqs: 456, preallocated irqs: 16
[    0.048893] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.070955] Console: colour VGA+ 80x25
[    0.070958] printk: legacy console [tty0] enabled
[    0.073091] ACPI: Core revision 20240827
[    0.073146] APIC: Switch to symmetric I/O mode setup
[    0.073354] x2apic enabled
[    0.073663] APIC: Switched APIC routing to: physical x2apic
[    0.074810] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.074837] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2b3e43c8763, max_idle_ns: 440795360101 ns
[    0.074841] Calibrating delay loop (skipped) preset value.. 5999.99 BogoMIPS (lpj=11999992)
[    0.074927] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[    0.075005] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127
[    0.075006] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0
[    0.075010] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    0.075013] Spectre V2 : Mitigation: Retpolines
[    0.075014] Spectre V2 : Spectre v2 / SpectreRSB: Filling RSB on context switch and VMEXIT
[    0.075015] Spectre V2 : Enabling Speculation Barrier for firmware calls
[    0.075015] RETBleed: Mitigation: untrained return thunk
[    0.075017] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    0.075018] Speculative Store Bypass: Vulnerable
[    0.075019] Speculative Return Stack Overflow: IBPB-extending microcode not applied!
[    0.075337] Speculative Return Stack Overflow: WARNING: See https://kernel.org/doc/html/latest/admin-guide/hw-vuln/srso.html for mitigation options.
[    0.075338] x86/bugs: return thunk changed
[    0.076010] Speculative Return Stack Overflow: Vulnerable: Safe RET, no microcode
[    0.076024] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.076025] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.076026] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.076027] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.076028] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'compacted' format.
[    0.105079] Freeing SMP alternatives memory: 40K
[    0.105083] pid_max: default: 32768 minimum: 301
[    0.105131] LSM: initializing lsm=lockdown,capability,landlock,yama,apparmor,tomoyo,bpf,ipe,ima,evm
[    0.105231] landlock: Up and running.
[    0.105232] Yama: becoming mindful.
[    0.105340] AppArmor: AppArmor initialized
[    0.105375] TOMOYO Linux initialized
[    0.105657] LSM support for eBPF active
[    0.105742] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.105761] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.214078] smpboot: CPU0: AMD EPYC-Rome Processor (family: 0x17, model: 0x31, stepping: 0x0)
[    0.214364] Performance Events: Fam17h+ core perfctr, AMD PMU driver.
[    0.214404] ... version:                0
[    0.214406] ... bit width:              48
[    0.214407] ... generic registers:      6
[    0.214409] ... value mask:             0000ffffffffffff
[    0.214411] ... max period:             00007fffffffffff
[    0.214413] ... fixed-purpose events:   0
[    0.214414] ... event mask:             000000000000003f
[    0.214526] signal: max sigframe size: 1776
[    0.214556] rcu: Hierarchical SRCU implementation.
[    0.214558] rcu:     Max phase no-delay instances is 1000.
[    0.214610] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level
[    0.217232] smp: Bringing up secondary CPUs ...
[    0.217370] smpboot: x86: Booting SMP configuration:
[    0.217372] .... node  #0, CPUs:      #1 #2 #3
[    0.224842] smp: Brought up 1 node, 4 CPUs
[    0.224842] smpboot: Total of 4 processors activated (23999.98 BogoMIPS)
[    0.235977] node 0 deferred pages initialised in 12ms
[    0.238882] Memory: 16027096K/16776672K available (16384K kernel code, 2484K rwdata, 11592K rodata, 4232K init, 5012K bss, 482660K reserved, 262144K cma-reserved)
[    0.239778] devtmpfs: initialized
[    0.239778] x86/mm: Memory block size: 128MB
[    0.241238] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.241238] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.243936] pinctrl core: initialized pinctrl subsystem
[    0.244710] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.244984] DMA: preallocated 2048 KiB GFP_KERNEL pool for atomic allocations
[    0.244984] DMA: preallocated 2048 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.244984] DMA: preallocated 2048 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.244984] audit: initializing netlink subsys (disabled)
[    0.244984] audit: type=2000 audit(1773187085.195:1): state=initialized audit_enabled=0 res=1
[    0.244984] thermal_sys: Registered thermal governor 'fair_share'
[    0.244984] thermal_sys: Registered thermal governor 'bang_bang'
[    0.244984] thermal_sys: Registered thermal governor 'step_wise'
[    0.244984] thermal_sys: Registered thermal governor 'user_space'
[    0.244984] thermal_sys: Registered thermal governor 'power_allocator'
[    0.244984] cpuidle: using governor ladder
[    0.244984] cpuidle: using governor menu
[    0.247000] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.247189] PCI: Using configuration type 1 for base access
[    0.247192] PCI: Using configuration type 1 for extended access
[    0.247429] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    0.247429] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[    0.247429] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page
[    0.247429] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    0.247429] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page
[    0.250867] ACPI: Added _OSI(Module Device)
[    0.250870] ACPI: Added _OSI(Processor Device)
[    0.250872] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.250875] ACPI: Added _OSI(Processor Aggregator Device)
[    0.253844] ACPI: 2 ACPI AML tables successfully acquired and loaded
[    0.271339] ACPI: Interpreter enabled
[    0.271339] ACPI: PM: (supports S0 S5)
[    0.271339] ACPI: Using IOAPIC for interrupt routing
[    0.271339] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.271339] PCI: Using E820 reservations for host bridge windows
[    0.271566] ACPI: Enabled 3 GPEs in block 00 to 0F
[    0.282753] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.282761] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    0.283686] acpiphp: Slot [3] registered
[    0.283739] acpiphp: Slot [16] registered
[    0.283778] acpiphp: Slot [18] registered
[    0.283850] acpiphp: Slot [4] registered
[    0.283880] acpiphp: Slot [6] registered
[    0.283910] acpiphp: Slot [7] registered
[    0.283940] acpiphp: Slot [8] registered
[    0.283977] acpiphp: Slot [9] registered
[    0.284007] acpiphp: Slot [10] registered
[    0.284039] acpiphp: Slot [11] registered
[    0.284069] acpiphp: Slot [12] registered
[    0.284099] acpiphp: Slot [13] registered
[    0.284129] acpiphp: Slot [14] registered
[    0.284160] acpiphp: Slot [15] registered
[    0.284190] acpiphp: Slot [17] registered
[    0.284220] acpiphp: Slot [19] registered
[    0.284250] acpiphp: Slot [20] registered
[    0.284282] acpiphp: Slot [21] registered
[    0.284312] acpiphp: Slot [22] registered
[    0.284344] acpiphp: Slot [23] registered
[    0.284374] acpiphp: Slot [24] registered
[    0.284403] acpiphp: Slot [25] registered
[    0.284433] acpiphp: Slot [26] registered
[    0.284463] acpiphp: Slot [27] registered
[    0.284494] acpiphp: Slot [28] registered
[    0.284524] acpiphp: Slot [29] registered
[    0.284544] PCI host bridge to bus 0000:00
[    0.284549] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.284553] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.284556] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.284558] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]
[    0.284561] pci_bus 0000:00: root bus resource [mem 0xc000000000-0xc0a0207fff window]
[    0.284564] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.284863] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint
[    0.285606] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint
[    0.286617] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint
[    0.290843] pci 0000:00:01.1: BAR 4 [io  0xf1a0-0xf1af]
[    0.292691] pci 0000:00:01.1: BAR 0 [io  0x01f0-0x01f7]: legacy IDE quirk
[    0.292695] pci 0000:00:01.1: BAR 1 [io  0x03f6]: legacy IDE quirk
[    0.292697] pci 0000:00:01.1: BAR 2 [io  0x0170-0x0177]: legacy IDE quirk
[    0.292700] pci 0000:00:01.1: BAR 3 [io  0x0376]: legacy IDE quirk
[    0.292958] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint
[    0.298125] pci 0000:00:01.2: BAR 4 [io  0xf180-0xf19f]
[    0.300411] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint
[    0.301201] pci 0000:00:01.3: quirk: [io  0x0600-0x063f] claimed by PIIX4 ACPI
[    0.301219] pci 0000:00:01.3: quirk: [io  0x0700-0x070f] claimed by PIIX4 SMB
[    0.301592] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint
[    0.304040] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]
[    0.310843] pci 0000:00:02.0: BAR 2 [mem 0xfeb50000-0xfeb50fff]
[    0.321233] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb4ffff pref]
[    0.321324] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.321792] pci 0000:00:03.0: [1af4:1002] type 00 class 0x00ff00 conventional PCI endpoint
[    0.323535] pci 0000:00:03.0: BAR 0 [io  0xf100-0xf13f]
[    0.325015] pci 0000:00:03.0: BAR 1 [mem 0xfeb51000-0xfeb51fff]
[    0.332176] pci 0000:00:03.0: BAR 4 [mem 0xc0a0200000-0xc0a0203fff 64bit pref]
[    0.335838] pci 0000:00:05.0: [1b36:0001] type 01 class 0x060400 conventional PCI bridge
[    0.338194] pci 0000:00:05.0: BAR 0 [mem 0xc000000000-0xc0000000ff 64bit]
[    0.339893] pci 0000:00:05.0: PCI bridge to [bus 01]
[    0.339937] pci 0000:00:05.0:   bridge window [io  0xe000-0xefff]
[    0.339967] pci 0000:00:05.0:   bridge window [mem 0xfe800000-0xfe9fffff]
[    0.342896] pci 0000:00:05.0:   bridge window [mem 0xc080000000-0xc09fffffff 64bit pref]
[    0.344266] pci 0000:00:10.0: [1000:00ac] type 00 class 0x010700 PCIe Endpoint
[    0.349638] pci 0000:00:10.0: BAR 0 [mem 0xc0a0000000-0xc0a00fffff 64bit pref]
[    0.354843] pci 0000:00:10.0: BAR 2 [mem 0xc0a0100000-0xc0a01fffff 64bit pref]
[    0.358843] pci 0000:00:10.0: BAR 4 [mem 0xfea00000-0xfeafffff]
[    0.365515] pci 0000:00:10.0: BAR 5 [io  0xf000-0xf0ff]
[    0.371456] pci 0000:00:10.0: supports D1 D2
[    0.372788] pci 0000:00:12.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint
[    0.374843] pci 0000:00:12.0: BAR 0 [io  0xf140-0xf17f]
[    0.376103] pci 0000:00:12.0: BAR 1 [mem 0xfeb52000-0xfeb52fff]
[    0.381822] pci 0000:00:12.0: BAR 4 [mem 0xc0a0204000-0xc0a0207fff 64bit pref]
[    0.383533] pci 0000:00:12.0: ROM [mem 0xfeb00000-0xfeb3ffff pref]
[    0.385438] pci 0000:00:1e.0: [1b36:0001] type 01 class 0x060400 conventional PCI bridge
[    0.386843] pci 0000:00:1e.0: BAR 0 [mem 0xc000001000-0xc0000010ff 64bit]
[    0.387783] pci 0000:00:1e.0: PCI bridge to [bus 02]
[    0.387833] pci 0000:00:1e.0:   bridge window [io  0xd000-0xdfff]
[    0.387863] pci 0000:00:1e.0:   bridge window [mem 0xfe600000-0xfe7fffff]
[    0.388519] pci 0000:00:1e.0:   bridge window [mem 0xc060000000-0xc07fffffff 64bit pref]
[    0.389508] pci 0000:00:1f.0: [1b36:0001] type 01 class 0x060400 conventional PCI bridge
[    0.391422] pci 0000:00:1f.0: BAR 0 [mem 0xc000002000-0xc0000020ff 64bit]
[    0.394041] pci 0000:00:1f.0: PCI bridge to [bus 03]
[    0.394084] pci 0000:00:1f.0:   bridge window [io  0xc000-0xcfff]
[    0.394115] pci 0000:00:1f.0:   bridge window [mem 0xfe400000-0xfe5fffff]
[    0.394672] pci 0000:00:1f.0:   bridge window [mem 0xc040000000-0xc05fffffff 64bit pref]
[    0.396053] pci_bus 0000:01: extended config space not accessible
[    0.396399] acpiphp: Slot [1-2] registered
[    0.396431] acpiphp: Slot [2] registered
[    0.396462] acpiphp: Slot [0] registered
[    0.396497] acpiphp: Slot [3-2] registered
[    0.396532] acpiphp: Slot [4-2] registered
[    0.396562] acpiphp: Slot [5] registered
[    0.396599] acpiphp: Slot [6-2] registered
[    0.396634] acpiphp: Slot [7-2] registered
[    0.396669] acpiphp: Slot [8-2] registered
[    0.396704] acpiphp: Slot [9-2] registered
[    0.396739] acpiphp: Slot [10-2] registered
[    0.396775] acpiphp: Slot [11-2] registered
[    0.396810] acpiphp: Slot [12-2] registered
[    0.396847] acpiphp: Slot [13-2] registered
[    0.396882] acpiphp: Slot [14-2] registered
[    0.396917] acpiphp: Slot [15-2] registered
[    0.396953] acpiphp: Slot [16-2] registered
[    0.396995] acpiphp: Slot [17-2] registered
[    0.397032] acpiphp: Slot [18-2] registered
[    0.397068] acpiphp: Slot [19-2] registered
[    0.397105] acpiphp: Slot [20-2] registered
[    0.397143] acpiphp: Slot [21-2] registered
[    0.397178] acpiphp: Slot [22-2] registered
[    0.397214] acpiphp: Slot [23-2] registered
[    0.397249] acpiphp: Slot [24-2] registered
[    0.397284] acpiphp: Slot [25-2] registered
[    0.397320] acpiphp: Slot [26-2] registered
[    0.397355] acpiphp: Slot [27-2] registered
[    0.397391] acpiphp: Slot [28-2] registered
[    0.397427] acpiphp: Slot [29-2] registered
[    0.397457] acpiphp: Slot [30] registered
[    0.397487] acpiphp: Slot [31] registered
[    0.397678] pci 0000:01:01.0: [1af4:1004] type 00 class 0x010000 conventional PCI endpoint
[    0.398842] pci 0000:01:01.0: BAR 0 [io  0xe000-0xe03f]
[    0.400688] pci 0000:01:01.0: BAR 1 [mem 0xfe800000-0xfe800fff]
[    0.407860] pci 0000:01:01.0: BAR 4 [mem 0xc080000000-0xc080003fff 64bit pref]
[    0.412220] pci 0000:01:02.0: [1af4:1004] type 00 class 0x010000 conventional PCI endpoint
[    0.413560] pci 0000:01:02.0: BAR 0 [io  0xe040-0xe07f]
[    0.414843] pci 0000:01:02.0: BAR 1 [mem 0xfe801000-0xfe801fff]
[    0.420142] pci 0000:01:02.0: BAR 4 [mem 0xc080004000-0xc080007fff 64bit pref]
[    0.423623] pci 0000:00:05.0: PCI bridge to [bus 01]
[    0.424554] pci_bus 0000:02: extended config space not accessible
[    0.424921] acpiphp: Slot [0-2] registered
[    0.424970] acpiphp: Slot [1-3] registered
[    0.425007] acpiphp: Slot [2-2] registered
[    0.425044] acpiphp: Slot [3-3] registered
[    0.425080] acpiphp: Slot [4-3] registered
[    0.425116] acpiphp: Slot [5-2] registered
[    0.425152] acpiphp: Slot [6-3] registered
[    0.425188] acpiphp: Slot [7-3] registered
[    0.425225] acpiphp: Slot [8-3] registered
[    0.425262] acpiphp: Slot [9-3] registered
[    0.425299] acpiphp: Slot [10-3] registered
[    0.425335] acpiphp: Slot [11-3] registered
[    0.425372] acpiphp: Slot [12-3] registered
[    0.425409] acpiphp: Slot [13-3] registered
[    0.425445] acpiphp: Slot [14-3] registered
[    0.425482] acpiphp: Slot [15-3] registered
[    0.425521] acpiphp: Slot [16-3] registered
[    0.425558] acpiphp: Slot [17-3] registered
[    0.425596] acpiphp: Slot [18-3] registered
[    0.425633] acpiphp: Slot [19-3] registered
[    0.425670] acpiphp: Slot [20-3] registered
[    0.425707] acpiphp: Slot [21-3] registered
[    0.425744] acpiphp: Slot [22-3] registered
[    0.425783] acpiphp: Slot [23-3] registered
[    0.425820] acpiphp: Slot [24-3] registered
[    0.425857] acpiphp: Slot [25-3] registered
[    0.425896] acpiphp: Slot [26-3] registered
[    0.425934] acpiphp: Slot [27-3] registered
[    0.425979] acpiphp: Slot [28-3] registered
[    0.426017] acpiphp: Slot [29-3] registered
[    0.426053] acpiphp: Slot [30-2] registered
[    0.426092] acpiphp: Slot [31-2] registered
[    0.426530] pci 0000:00:1e.0: PCI bridge to [bus 02]
[    0.427783] pci_bus 0000:03: extended config space not accessible
[    0.428155] acpiphp: Slot [0-3] registered
[    0.428194] acpiphp: Slot [1-4] registered
[    0.428246] acpiphp: Slot [2-3] registered
[    0.428285] acpiphp: Slot [3-4] registered
[    0.428323] acpiphp: Slot [4-4] registered
[    0.428361] acpiphp: Slot [5-3] registered
[    0.428398] acpiphp: Slot [6-4] registered
[    0.428436] acpiphp: Slot [7-4] registered
[    0.428475] acpiphp: Slot [8-4] registered
[    0.428513] acpiphp: Slot [9-4] registered
[    0.428552] acpiphp: Slot [10-4] registered
[    0.428591] acpiphp: Slot [11-4] registered
[    0.428629] acpiphp: Slot [12-4] registered
[    0.428668] acpiphp: Slot [13-4] registered
[    0.428707] acpiphp: Slot [14-4] registered
[    0.428747] acpiphp: Slot [15-4] registered
[    0.428785] acpiphp: Slot [16-4] registered
[    0.428824] acpiphp: Slot [17-4] registered
[    0.428864] acpiphp: Slot [18-4] registered
[    0.428903] acpiphp: Slot [19-4] registered
[    0.428942] acpiphp: Slot [20-4] registered
[    0.428981] acpiphp: Slot [21-4] registered
[    0.429020] acpiphp: Slot [22-4] registered
[    0.429060] acpiphp: Slot [23-4] registered
[    0.429099] acpiphp: Slot [24-4] registered
[    0.429138] acpiphp: Slot [25-4] registered
[    0.429177] acpiphp: Slot [26-4] registered
[    0.429216] acpiphp: Slot [27-4] registered
[    0.429262] acpiphp: Slot [28-4] registered
[    0.429301] acpiphp: Slot [29-4] registered
[    0.429341] acpiphp: Slot [30-3] registered
[    0.429380] acpiphp: Slot [31-3] registered
[    0.429818] pci 0000:00:1f.0: PCI bridge to [bus 03]
[    0.432867] ACPI: PCI: Interrupt link LNKA configured for IRQ 10
[    0.433044] ACPI: PCI: Interrupt link LNKB configured for IRQ 10
[    0.433199] ACPI: PCI: Interrupt link LNKC configured for IRQ 11
[    0.433352] ACPI: PCI: Interrupt link LNKD configured for IRQ 11
[    0.433559] ACPI: PCI: Interrupt link LNKS configured for IRQ 9
[    0.434137] iommu: Default domain type: Passthrough (set via kernel command line)
[    0.434137] pps_core: LinuxPPS API ver. 1 registered
[    0.434137] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.434137] PTP clock support registered
[    0.434137] EDAC MC: Ver: 3.0.0
[    0.435151] NetLabel: Initializing
[    0.435153] NetLabel:  domain hash size = 128
[    0.435155] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.435181] NetLabel:  unlabeled traffic allowed by default
[    0.435183] PCI: Using ACPI for IRQ routing
[    0.435185] PCI: pci_cache_line_size set to 64 bytes
[    0.435574] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
[    0.435578] e820: reserve RAM buffer [mem 0xbffda000-0xbfffffff]
[    0.435607] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[    0.435607] pci 0000:00:02.0: vgaarb: bridge control possible
[    0.435607] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.435607] vgaarb: loaded
[    0.435607] clocksource: Switched to clocksource kvm-clock
[    0.436163] VFS: Disk quotas dquot_6.6.0
[    0.437231] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.437431] AppArmor: AppArmor Filesystem Enabled
[    0.437456] pnp: PnP ACPI init
[    0.437548] pnp 00:02: [dma 2]
[    0.437724] pnp: PnP ACPI: found 4 devices
[    0.446631] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.446706] NET: Registered PF_INET protocol family
[    0.446877] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.462939] tcp_listen_portaddr_hash hash table entries: 8192 (order: 5, 131072 bytes, linear)
[    0.462955] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.462960] TCP established hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.463108] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)
[    0.463235] TCP: Hash tables configured (established 131072 bind 65536)
[    0.463298] MPTCP token hash table entries: 16384 (order: 6, 393216 bytes, linear)
[    0.463331] UDP hash table entries: 8192 (order: 6, 262144 bytes, linear)
[    0.463357] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes, linear)
[    0.463421] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.463431] NET: Registered PF_XDP protocol family
[    0.463445] pci 0000:00:05.0: PCI bridge to [bus 01]
[    0.463470] pci 0000:00:05.0:   bridge window [io  0xe000-0xefff]
[    0.464351] pci 0000:00:05.0:   bridge window [mem 0xfe800000-0xfe9fffff]
[    0.465091] pci 0000:00:05.0:   bridge window [mem 0xc080000000-0xc09fffffff 64bit pref]
[    0.466317] pci 0000:00:1e.0: PCI bridge to [bus 02]
[    0.466335] pci 0000:00:1e.0:   bridge window [io  0xd000-0xdfff]
[    0.467065] pci 0000:00:1e.0:   bridge window [mem 0xfe600000-0xfe7fffff]
[    0.468255] pci 0000:00:1e.0:   bridge window [mem 0xc060000000-0xc07fffffff 64bit pref]
[    0.469209] pci 0000:00:1f.0: PCI bridge to [bus 03]
[    0.469228] pci 0000:00:1f.0:   bridge window [io  0xc000-0xcfff]
[    0.469932] pci 0000:00:1f.0:   bridge window [mem 0xfe400000-0xfe5fffff]
[    0.470399] pci 0000:00:1f.0:   bridge window [mem 0xc040000000-0xc05fffffff 64bit pref]
[    0.471340] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.471344] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.471347] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.471350] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]
[    0.471353] pci_bus 0000:00: resource 8 [mem 0xc000000000-0xc0a0207fff window]
[    0.471356] pci_bus 0000:01: resource 0 [io  0xe000-0xefff]
[    0.471358] pci_bus 0000:01: resource 1 [mem 0xfe800000-0xfe9fffff]
[    0.471361] pci_bus 0000:01: resource 2 [mem 0xc080000000-0xc09fffffff 64bit pref]
[    0.471364] pci_bus 0000:02: resource 0 [io  0xd000-0xdfff]
[    0.471367] pci_bus 0000:02: resource 1 [mem 0xfe600000-0xfe7fffff]
[    0.471369] pci_bus 0000:02: resource 2 [mem 0xc060000000-0xc07fffffff 64bit pref]
[    0.471372] pci_bus 0000:03: resource 0 [io  0xc000-0xcfff]
[    0.471375] pci_bus 0000:03: resource 1 [mem 0xfe400000-0xfe5fffff]
[    0.471377] pci_bus 0000:03: resource 2 [mem 0xc040000000-0xc05fffffff 64bit pref]
[    0.471548] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[    0.471568] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    0.472744] ACPI: \_SB_.LNKD: Enabled at IRQ 11
[    0.474126] PCI: CLS 64 bytes, default 64
[    0.474210] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.474213] software IO TLB: mapped [mem 0x00000000bbfda000-0x00000000bffda000] (64MB)
[    0.474290] Trying to unpack rootfs image as initramfs...
[    0.478336] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2b3e43c8763, max_idle_ns: 440795360101 ns
[    0.479753] Initialise system trusted keyrings
[    0.480111] Key type blacklist registered
[    0.480583] workingset: timestamp_bits=36 max_order=22 bucket_order=0
[    0.480591] zbud: loaded
[    0.480728] fuse: init (API version 7.41)
[    0.480999] integrity: Platform Keyring initialized
[    0.481349] integrity: Machine keyring initialized
[    0.501199] Key type asymmetric registered
[    0.501531] Asymmetric key parser 'x509' registered
[    1.066620] Freeing initrd memory: 82584K
[    1.072486] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246)
[    1.072593] io scheduler mq-deadline registered
[    1.074616] ledtrig-cpu: registered to indicate activity on CPUs
[    1.074808] shpchp 0000:00:05.0: Requesting control of SHPC hotplug via OSHP (\_SB_.PCI0.S28_)
[    1.074821] shpchp 0000:00:05.0: Requesting control of SHPC hotplug via OSHP (\_SB_.PCI0)
[    1.074830] shpchp 0000:00:05.0: Cannot get control of SHPC hotplug
[    1.074909] shpchp 0000:00:1e.0: Requesting control of SHPC hotplug via OSHP (\_SB_.PCI0.SF0_)
[    1.074920] shpchp 0000:00:1e.0: Requesting control of SHPC hotplug via OSHP (\_SB_.PCI0)
[    1.074924] shpchp 0000:00:1e.0: Cannot get control of SHPC hotplug
[    1.075005] shpchp 0000:00:1f.0: Requesting control of SHPC hotplug via OSHP (\_SB_.PCI0.SF8_)
[    1.075015] shpchp 0000:00:1f.0: Requesting control of SHPC hotplug via OSHP (\_SB_.PCI0)
[    1.075019] shpchp 0000:00:1f.0: Cannot get control of SHPC hotplug
[    1.075039] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    1.076825] ACPI: \_SB_.LNKC: Enabled at IRQ 10
[    1.079741] ACPI: \_SB_.LNKB: Enabled at IRQ 10
[    1.082588] ACPI: \_SB_.LNKA: Enabled at IRQ 11
[    1.089537] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    1.090424] Linux agpgart interface v0.103
[    1.091173] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[    1.092132] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.092142] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.092336] mousedev: PS/2 mouse device common for all mice
[    1.092735] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[    1.092776] rtc_cmos 00:03: RTC can wake from S4
[    1.093753] rtc_cmos 00:03: registered as rtc0
[    1.093856] rtc_cmos 00:03: setting system clock to 2026-03-10T23:58:05 UTC (1773187085)
[    1.093974] rtc_cmos 00:03: alarms up to one day, y3k, 242 bytes nvram
[    1.093989] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled
[    1.094796] NET: Registered PF_INET6 protocol family
[    1.100055] Segment Routing with IPv6
[    1.100068] In-situ OAM (IOAM) with IPv6
[    1.100093] mip6: Mobile IPv6
[    1.100097] NET: Registered PF_PACKET protocol family
[    1.100164] mpls_gso: MPLS GSO support
[    1.100639] IPI shorthand broadcast: enabled
[    1.103455] sched_clock: Marking stable (1080007108, 21939639)->(1104955578, -3008831)
[    1.103631] registered taskstats version 1
[    1.103778] Loading compiled-in X.509 certificates
[    1.121104] Loaded X.509 cert 'Build time autogenerated kernel key: c3384ccfe51b608e872d4e99dfc78fb9e4c0d67d'
[    1.121831] Loaded X.509 cert 'Debian Secure Boot CA: 6ccece7e4c6c0d1f6149f3dd27dfcc5cbb419ea1'
[    1.122382] Loaded X.509 cert 'Debian Secure Boot Signer 2020: 00b55eb3b9'
[    1.125060] Demotion targets for Node 0: null
[    1.125173] Key type .fscrypt registered
[    1.125488] Key type fscrypt-provisioning registered
[    1.144434] Key type encrypted registered
[    1.144793] AppArmor: AppArmor sha256 policy hashing enabled
[    1.144806] ima: No TPM chip found, activating TPM-bypass!
[    1.144809] ima: Allocated hash algorithm: sha256
[    1.144823] ima: No architecture policies found
[    1.144851] evm: Initialising EVM extended attributes:
[    1.144853] evm: security.selinux
[    1.144855] evm: security.SMACK64 (disabled)
[    1.144857] evm: security.SMACK64EXEC (disabled)
[    1.144859] evm: security.SMACK64TRANSMUTE (disabled)
[    1.144861] evm: security.SMACK64MMAP (disabled)
[    1.144862] evm: security.apparmor
[    1.144864] evm: security.ima
[    1.144866] evm: security.capability
[    1.144867] evm: HMAC attrs: 0x1
[    1.147228] RAS: Correctable Errors collector initialized.
[    1.159963] clk: Disabling unused clocks
[    1.159966] PM: genpd: Disabling unused power domains
[    1.162040] Freeing unused decrypted memory: 2028K
[    1.162762] Freeing unused kernel image (initmem) memory: 4232K
[    1.162782] Write protecting the kernel read-only data: 28672k
[    1.163335] Freeing unused kernel image (rodata/data gap) memory: 696K
[    1.233398] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    1.233434] Run /init as init process
[    1.233438]   with arguments:
[    1.233441]     /init
[    1.233443]   with environment:
[    1.233445]     HOME=/
[    1.233447]     TERM=linux
[    1.233449]     BOOT_IMAGE=/ROOT/25.10.1@/boot/vmlinuz-6.12.33-production+truenas
[    1.233451]     zfsforce=1
[    1.397616] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0
[    1.397658] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD
[    1.400521] FDC 0 is a S82078B
[    1.405024] SCSI subsystem initialized
[    1.409392] ACPI: bus type USB registered
[    1.409436] usbcore: registered new interface driver usbfs
[    1.409449] usbcore: registered new interface driver hub
[    1.409466] usbcore: registered new device driver usb
[    1.423558] uhci_hcd 0000:00:01.2: UHCI Host Controller
[    1.423569] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
[    1.423595] uhci_hcd 0000:00:01.2: detected 2 ports
[    1.423762] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000f180
[    1.423899] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.12
[    1.423904] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.423907] usb usb1: Product: UHCI Host Controller
[    1.423909] usb usb1: Manufacturer: Linux 6.12.33-production+truenas uhci_hcd
[    1.423912] usb usb1: SerialNumber: 0000:00:01.2
[    1.424074] hub 1-0:1.0: USB hub found
[    1.424082] hub 1-0:1.0: 2 ports detected
[    1.430776] virtio_scsi virtio2: 4/0/0 default/read/poll queues
[    1.431614] libata version 3.00 loaded.
[    1.432170] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3
[    1.432585] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input2
[    1.433538] ata_piix 0000:00:01.1: version 2.13
[    1.434664] scsi host0: Virtio SCSI HBA
[    1.435298] virtio_net virtio1 ens18: renamed from eth0
[    1.436507] scsi host1: ata_piix
[    1.436731] scsi host2: ata_piix
[    1.436795] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xf1a0 irq 14 lpm-pol 0
[    1.436798] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xf1a8 irq 15 lpm-pol 0
[    1.455784] scsi 0:0:0:0: Direct-Access     QEMU     QEMU HARDDISK    2.5+ PQ: 0 ANSI: 5
[    1.455880] virtio_scsi virtio3: 4/0/0 default/read/poll queues
[    1.457427] mpt3sas version 48.100.00.00 loaded
[    1.459505] mpt3sas_cm0: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (16383552 kB)
[    1.459957] scsi host3: Virtio SCSI HBA
[    1.461505] scsi 3:0:0:1: Direct-Access     QEMU     QEMU HARDDISK    2.5+ PQ: 0 ANSI: 5
[    1.515818] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[    1.515928] mpt3sas_cm0: MSI-X vectors supported: 16
[    1.515932]   no of cores: 4, max_msix_vectors: -1
[    1.515934] mpt3sas_cm0:  0 4 4
[    1.517611] mpt3sas_cm0: High IOPs queues : disabled
[    1.517614] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 41
[    1.517617] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 42
[    1.517619] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 43
[    1.517621] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 44
[    1.517623] mpt3sas_cm0: iomem(0x000000c0a0000000), mapped(0x00000000374db845), size(1048576)
[    1.517627] mpt3sas_cm0: ioport(0x000000000000f000), size(256)
[    1.576055] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[    1.603945] mpt3sas_cm0: scatter gather: sge_in_main_msg(1), sge_per_chain(7), sge_per_io(128), chains_per_io(19)
[    1.604506] mpt3sas_cm0: request pool(0x00000000d1b56efe) - dma(0x100300000): depth(6756), frame_size(128), pool_size(844 kB)
[    1.610183] ata2: found unknown device (class 0)
[    1.611117] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100
[    1.612198] mpt3sas_cm0: sense pool(0x000000004bf300f8) - dma(0x100400000): depth(6551), element_size(96), pool_size (614 kB)
[    1.612634] scsi 2:0:0:0: CD-ROM            QEMU     QEMU DVD-ROM     2.5+ PQ: 0 ANSI: 5
[    1.612640] mpt3sas_cm0: reply pool(0x0000000019a4168f) - dma(0x100500000): depth(6820), frame_size(128), pool_size(852 kB)
[    1.613597] mpt3sas_cm0: config page(0x00000000a23f4eb1) - dma(0x140517000): size(512)
[    1.613602] mpt3sas_cm0: Allocated physical memory: size(28966 kB)
[    1.613604] mpt3sas_cm0: Current Controller Queue Depth(6548),Max Controller Queue Depth(6656)
[    1.613606] mpt3sas_cm0: Scatter Gather Elements per IO(128)
[    1.653970] usb 1-1: new full-speed USB device number 2 using uhci_hcd
[    1.662622] sd 3:0:0:1: Power-on or device reset occurred
[    1.662630] sd 0:0:0:0: Power-on or device reset occurred
[    1.663495] sd 0:0:0:0: [sdb] 67108864 512-byte logical blocks: (34.4 GB/32.0 GiB)
[    1.663507] sd 3:0:0:1: [sda] 67108864 512-byte logical blocks: (34.4 GB/32.0 GiB)
[    1.664080] sd 0:0:0:0: [sdb] Write Protect is off
[    1.664579] sd 3:0:0:1: [sda] Write Protect is off
[    1.664890] sd 0:0:0:0: [sdb] Mode Sense: 63 00 10 08
[    1.665235] sd 3:0:0:1: [sda] Mode Sense: 63 00 10 08
[    1.665325] sd 3:0:0:1: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    1.665328] sd 0:0:0:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    1.687173]  sdb: sdb1 sdb2 sdb3
[    1.687441]  sda: sda1 sda2 sda3
[    1.687444] sd 0:0:0:0: [sdb] Attached SCSI disk
[    1.687665] sd 3:0:0:1: [sda] Attached SCSI disk
[    1.745895] mpt3sas_cm0: _base_display_fwpkg_version: complete
[    1.745902] mpt3sas_cm0: FW Package Ver(24.00.00.00)
[    1.746113] mpt3sas_cm0: TimeSync Interval in Manuf page-11 is not enabled. Periodic Time-Sync will be disabled
[    1.747216] mpt3sas_cm0: SAS3416: FWVersion(24.00.00.00), ChipRevision(0x01)
[    1.747221] NVMe
[    1.747223] mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ)
[    1.747374] mpt3sas 0000:00:10.0: Max SCSIIO MPT commands: 6548 shared with nr_hw_queues = 4
[    1.747378] scsi host4: Fusion MPT SAS Host
[    1.748463] mpt3sas_cm0: sending port enable !!
[    1.755148] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[    1.755153] cdrom: Uniform CD-ROM driver Revision: 3.20
[    1.794654] sr 2:0:0:0: Attached scsi CD-ROM sr0
[    1.830929] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00
[    1.830934] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10
[    1.830938] usb 1-1: Product: QEMU USB Tablet
[    1.830940] usb 1-1: Manufacturer: QEMU
[    1.830943] usb 1-1: SerialNumber: 28754-0000:00:01.2-1
[    1.841361] hid: raw HID events driver (C) Jiri Kosina
[    3.834955] mpt3sas_cm0: hba_port entry: 00000000a53f2910, port: 0 is added to hba_port list
[    3.837265] mpt3sas_cm0: hba_port entry: 000000008dc80426, port: 8 is added to hba_port list
[    3.840301] mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b00f3212d0), phys(21)
[    3.844124] mpt3sas_cm0: expander_add: handle(0x0017), parent(0x0001), sas_addr(0x3474f4f58496a31f), phys(25)
[    3.844478]  expander-4:0: add: handle(0x0017), sas_addr(0x3474f4f58496a31f)
[    3.850423] mpt3sas_cm0: handle(0x21) sas_address(0x3474f4f58496a31e) port_type(0x1)
[    3.851416] mpt3sas_cm0: expander_add: handle(0x0018), parent(0x0009), sas_addr(0x3474f4f584a11c3f), phys(37)
[    3.851725]  expander-4:1: add: handle(0x0018), sas_addr(0x3474f4f584a11c3f)
[    3.859332] mpt3sas_cm0: handle(0x19) sas_address(0x3474f4f584a11c08) port_type(0x1)
[    3.859512] mpt3sas_cm0: handle(0x1a) sas_address(0x3474f4f584a11c09) port_type(0x1)
[    3.859689] mpt3sas_cm0: handle(0x1b) sas_address(0x3474f4f584a11c0a) port_type(0x1)
[    3.859866] mpt3sas_cm0: handle(0x1c) sas_address(0x3474f4f584a11c0b) port_type(0x1)
[    3.860047] mpt3sas_cm0: handle(0x1d) sas_address(0x3474f4f584a11c0c) port_type(0x1)
[    3.860225] mpt3sas_cm0: handle(0x1e) sas_address(0x3474f4f584a11c0d) port_type(0x1)
[    3.860403] mpt3sas_cm0: handle(0x1f) sas_address(0x3474f4f584a11c0e) port_type(0x1)
[    3.860581] mpt3sas_cm0: handle(0x20) sas_address(0x3474f4f584a11c0f) port_type(0x1)
[    3.862488] mpt3sas_cm0: handle(0x22) sas_address(0x3474f4f584a11c3e) port_type(0x1)
[    9.589991] mpt3sas_cm0: port enable: SUCCESS
[    9.804949] scsi 4:0:0:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[    9.805654] scsi 4:0:0:0: SATA: handle(0x0019), sas_addr(0x3474f4f584a11c08), phy(8), device_name(0x0000000000000000)
[    9.805660] scsi 4:0:0:0: enclosure logical id (0x3474f4f584a11c3e), slot(8)
[    9.805663] scsi 4:0:0:0: enclosure level(0x0000), connector name( C0  )
[    9.805769] scsi 4:0:0:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[    9.805774] scsi 4:0:0:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[    9.819054]  end_device-4:1:0: add: handle(0x0019), sas_addr(0x3474f4f584a11c08)
[    9.820055] scsi 4:0:1:0: Enclosure         GOOXIBM  2U12SXP 24Sx12G  B134 PQ: 0 ANSI: 6
[    9.820722] scsi 4:0:1:0: set ignore_delay_remove for handle(0x0021)
[    9.821211] scsi 4:0:1:0: SES: handle(0x0021), sas_addr(0x3474f4f58496a31e), phy(24), device_name(0x0000000000000000)
[    9.821216] scsi 4:0:1:0: enclosure logical id (0x3474f4f58496a300), slot(39)
[    9.821219] scsi 4:0:1:0: enclosure level(0x0000), connector name( C3  )
[    9.821224] scsi 4:0:1:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1)
[    9.824886]  end_device-4:0:0: add: handle(0x0021), sas_addr(0x3474f4f58496a31e)
[    9.932302] scsi 4:0:2:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[    9.933005] scsi 4:0:2:0: SATA: handle(0x001a), sas_addr(0x3474f4f584a11c09), phy(9), device_name(0x0000000000000000)
[    9.933010] scsi 4:0:2:0: enclosure logical id (0x3474f4f584a11c3e), slot(9)
[    9.933014] scsi 4:0:2:0: enclosure level(0x0000), connector name( C0  )
[    9.933131] scsi 4:0:2:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[    9.933137] scsi 4:0:2:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[    9.946654]  end_device-4:1:1: add: handle(0x001a), sas_addr(0x3474f4f584a11c09)
[   10.062918] scsi 4:0:3:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   10.063605] scsi 4:0:3:0: SATA: handle(0x001b), sas_addr(0x3474f4f584a11c0a), phy(10), device_name(0x0000000000000000)
[   10.063610] scsi 4:0:3:0: enclosure logical id (0x3474f4f584a11c3e), slot(10)
[   10.063613] scsi 4:0:3:0: enclosure level(0x0000), connector name( C0  )
[   10.063692] scsi 4:0:3:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   10.063696] scsi 4:0:3:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   10.076982]  end_device-4:1:2: add: handle(0x001b), sas_addr(0x3474f4f584a11c0a)
[   10.182331] scsi 4:0:4:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   10.182916] scsi 4:0:4:0: SATA: handle(0x001c), sas_addr(0x3474f4f584a11c0b), phy(11), device_name(0x0000000000000000)
[   10.182920] scsi 4:0:4:0: enclosure logical id (0x3474f4f584a11c3e), slot(11)
[   10.182923] scsi 4:0:4:0: enclosure level(0x0000), connector name( C0  )
[   10.183013] scsi 4:0:4:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   10.183018] scsi 4:0:4:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   10.196290]  end_device-4:1:3: add: handle(0x001c), sas_addr(0x3474f4f584a11c0b)
[   10.329550] scsi 4:0:5:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   10.330134] scsi 4:0:5:0: SATA: handle(0x001d), sas_addr(0x3474f4f584a11c0c), phy(12), device_name(0x0000000000000000)
[   10.330138] scsi 4:0:5:0: enclosure logical id (0x3474f4f584a11c3e), slot(12)
[   10.330142] scsi 4:0:5:0: enclosure level(0x0000), connector name( C0  )
[   10.330226] scsi 4:0:5:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   10.330230] scsi 4:0:5:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   10.343584]  end_device-4:1:4: add: handle(0x001d), sas_addr(0x3474f4f584a11c0c)
[   10.561882] scsi 4:0:6:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   10.562480] scsi 4:0:6:0: SATA: handle(0x001e), sas_addr(0x3474f4f584a11c0d), phy(13), device_name(0x0000000000000000)
[   10.562484] scsi 4:0:6:0: enclosure logical id (0x3474f4f584a11c3e), slot(13)
[   10.562487] scsi 4:0:6:0: enclosure level(0x0000), connector name( C0  )
[   10.562570] scsi 4:0:6:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   10.562574] scsi 4:0:6:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   10.575855]  end_device-4:1:5: add: handle(0x001e), sas_addr(0x3474f4f584a11c0d)
[   10.689964] scsi 4:0:7:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   10.690556] scsi 4:0:7:0: SATA: handle(0x001f), sas_addr(0x3474f4f584a11c0e), phy(14), device_name(0x0000000000000000)
[   10.690561] scsi 4:0:7:0: enclosure logical id (0x3474f4f584a11c3e), slot(14)
[   10.690564] scsi 4:0:7:0: enclosure level(0x0000), connector name( C0  )
[   10.690644] scsi 4:0:7:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   10.690648] scsi 4:0:7:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   10.703982]  end_device-4:1:6: add: handle(0x001f), sas_addr(0x3474f4f584a11c0e)
[   10.812439] scsi 4:0:8:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   10.813102] scsi 4:0:8:0: SATA: handle(0x0020), sas_addr(0x3474f4f584a11c0f), phy(15), device_name(0x0000000000000000)
[   10.813107] scsi 4:0:8:0: enclosure logical id (0x3474f4f584a11c3e), slot(15)
[   10.813110] scsi 4:0:8:0: enclosure level(0x0000), connector name( C0  )
[   10.813197] scsi 4:0:8:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   10.813203] scsi 4:0:8:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   10.826706]  end_device-4:1:7: add: handle(0x0020), sas_addr(0x3474f4f584a11c0f)
[   10.827772] scsi 4:0:9:0: Enclosure         GOOXIBM  4U24SXP 36Sx12G  B134 PQ: 0 ANSI: 6
[   10.828433] scsi 4:0:9:0: set ignore_delay_remove for handle(0x0022)
[   10.828893] scsi 4:0:9:0: SES: handle(0x0022), sas_addr(0x3474f4f584a11c3e), phy(36), device_name(0x0000000000000000)
[   10.828897] scsi 4:0:9:0: enclosure logical id (0x3474f4f584a11c3e), slot(24)
[   10.828901] scsi 4:0:9:0: enclosure level(0x0000), connector name( C0  )
[   10.828905] scsi 4:0:9:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1)
[   10.832014]  end_device-4:1:8: add: handle(0x0022), sas_addr(0x3474f4f584a11c3e)
[   10.832477] sd 4:0:0:0: Power-on or device reset occurred
[   10.832794] sd 4:0:2:0: Power-on or device reset occurred
[   10.833491] sd 4:0:3:0: Power-on or device reset occurred
[   10.833514] sd 4:0:4:0: Power-on or device reset occurred
[   10.833993] sd 4:0:0:0: [sdc] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   10.834510] sd 4:0:5:0: Power-on or device reset occurred
[   10.834906] sd 4:0:0:0: [sdc] 4096-byte physical blocks
[   10.834937] sd 4:0:2:0: [sdd] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   10.834941] sd 4:0:2:0: [sdd] 4096-byte physical blocks
[   10.834946] sd 4:0:3:0: [sde] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   10.834950] sd 4:0:3:0: [sde] 4096-byte physical blocks
[   10.835677] sd 4:0:6:0: Power-on or device reset occurred
[   10.835988] sd 4:0:4:0: [sdf] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   10.835992] sd 4:0:4:0: [sdf] 4096-byte physical blocks
[   10.837413] sd 4:0:0:0: [sdc] Write Protect is off
[   10.837466] sd 4:0:5:0: [sdg] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   10.837775] sd 4:0:2:0: [sdd] Write Protect is off
[   10.837778] sd 4:0:2:0: [sdd] Mode Sense: 6b 00 10 08
[   10.837794] sd 4:0:0:0: [sdc] Mode Sense: 6b 00 10 08
[   10.838338] sd 4:0:5:0: [sdg] 4096-byte physical blocks
[   10.838370] sd 4:0:6:0: [sdh] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   10.838498] sd 4:0:3:0: [sde] Write Protect is off
[   10.838502] sd 4:0:3:0: [sde] Mode Sense: 6b 00 10 08
[   10.838581] sd 4:0:7:0: Power-on or device reset occurred
[   10.838762] sd 4:0:4:0: [sdf] Write Protect is off
[   10.839131] sd 4:0:6:0: [sdh] 4096-byte physical blocks
[   10.839378] sd 4:0:2:0: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   10.839704] sd 4:0:4:0: [sdf] Mode Sense: 6b 00 10 08
[   10.839780] sd 4:0:3:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   10.839912] sd 4:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   10.840134] sd 4:0:7:0: [sdi] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   10.840742] sd 4:0:5:0: [sdg] Write Protect is off
[   10.841010] sd 4:0:7:0: [sdi] 4096-byte physical blocks
[   10.841426] sd 4:0:5:0: [sdg] Mode Sense: 6b 00 10 08
[   10.842006] sd 4:0:4:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   10.842721] sd 4:0:8:0: Power-on or device reset occurred
[   10.842930] sd 4:0:6:0: [sdh] Write Protect is off
[   10.842934] sd 4:0:6:0: [sdh] Mode Sense: 6b 00 10 08
[   10.843356] sd 4:0:5:0: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   10.844126] sd 4:0:6:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   10.844135] sd 4:0:7:0: [sdi] Write Protect is off
[   10.844139] sd 4:0:7:0: [sdi] Mode Sense: 6b 00 10 08
[   10.845327] sd 4:0:7:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   10.863736] sd 4:0:8:0: [sdj] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   10.864262] sd 4:0:8:0: [sdj] 4096-byte physical blocks
[   10.866804] sd 4:0:8:0: [sdj] Write Protect is off
[   10.867205] sd 4:0:8:0: [sdj] Mode Sense: 6b 00 10 08
[   10.868361] sd 4:0:8:0: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   10.910461]  sdd: sdd1
[   10.910584] sd 4:0:2:0: [sdd] Attached SCSI disk
[   10.911780]  sdf: sdf1
[   10.911901] sd 4:0:4:0: [sdf] Attached SCSI disk
[   10.914280]  sdg: sdg1
[   10.914384] sd 4:0:5:0: [sdg] Attached SCSI disk
[   10.921989]  sde: sde1
[   10.922092] sd 4:0:3:0: [sde] Attached SCSI disk
[   10.922965]  sdh: sdh1
[   10.923110] sd 4:0:6:0: [sdh] Attached SCSI disk
[   10.923337]  sdc: sdc1
[   10.923567] sd 4:0:0:0: [sdc] Attached SCSI disk
[   10.925351]  sdi: sdi1
[   10.925463] sd 4:0:7:0: [sdi] Attached SCSI disk
[   10.952658]  sdj: sdj1
[   10.952775] sd 4:0:8:0: [sdj] Attached SCSI disk
[   10.964153] usbcore: registered new interface driver usbhid
[   10.964157] usbhid: USB HID core driver
[   10.970575] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input4
[   10.970695] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0
[   10.991247] ses 4:0:1:0: Attached Enclosure device
[   10.991664] ses 4:0:9:0: Attached Enclosure device
[   11.449280] spl: loading out-of-tree module taints kernel.
[   11.449688] spl: module verification failed: signature and/or required key missing - tainting kernel
[   11.473305] zfs: module license 'CDDL' taints kernel.
[   11.473695] Disabling lock debugging due to kernel taint
[   11.474115] zfs: module license taints kernel.
[   12.709759] ZFS: Loaded module v2.3.4-1, ZFS pool version 5000, ZFS filesystem version 5
[   29.414041] Not activating Mandatory Access Control as /sbin/tomoyo-init does not exist.
[   29.717007] systemd[1]: Inserted module 'autofs4'
[   29.761697] systemd[1]: systemd 254.26-1~bpo12+1 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[   29.761713] systemd[1]: Detected virtualization kvm.
[   29.761741] systemd[1]: Detected architecture x86-64.
[   29.765554] systemd[1]: Hostname set to <vault>.
[   30.033603] systemd[1]: Queued start job for default target truenas.target.
[   30.072151] systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe.
[   30.073164] systemd[1]: Created slice user.slice - User and Session Slice.
[   30.073815] systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch.
[   30.074527] systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch.
[   30.075371] systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point.
[   30.076042] systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes.
[   30.081731] systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes.
[   30.082378] systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups.
[   30.082982] systemd[1]: Reached target paths.target - Path Units.
[   30.083550] systemd[1]: Reached target slices.target - Slice Units.
[   30.084104] systemd[1]: Reached target swap.target - Swaps.
[   30.084660] systemd[1]: Reached target time-set.target - System Time Set.
[   30.085254] systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes.
[   30.085856] systemd[1]: Reached target zfs-import.target - ZFS pool import target.
[   30.088026] systemd[1]: Listening on dbus.socket - D-Bus System Message Bus Socket.
[   30.094598] systemd[1]: Listening on rpcbind.socket - RPCbind Server Activation Socket.
[   30.096609] systemd[1]: Listening on systemd-coredump.socket - Process Core Dump Socket.
[   30.097270] systemd[1]: Listening on systemd-initctl.socket - initctl Compatibility Named Pipe.
[   30.098698] systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log).
[   30.099448] systemd[1]: Listening on systemd-journald.socket - Journal Socket.
[   30.101623] systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket.
[   30.102375] systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket.
[   30.104169] systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System...
[   30.105873] systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System...
[   30.107764] systemd[1]: Mounting proc-fs-nfsd.mount - NFSD configuration filesystem...
[   30.109665] systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System...
[   30.111618] systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System...
[   30.113685] systemd[1]: Mounting tmp.mount - Temporary Directory (/tmp)...
[   30.114434] systemd[1]: auth-rpcgss-module.service - Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab).
[   30.115701] systemd[1]: Starting dbus.service - D-Bus System Message Bus...
[   30.116373] systemd[1]: ix-boot-core.service - Reboot to TrueNAS core was skipped because of an unmet condition check (ConditionEnvironment=_BOOT_TRUENAS_CORE=1).
[   30.117565] systemd[1]: Starting ix-wait-on-disks.service - Wait on Disk Enumeration...
[   30.120918] systemd[1]: Starting keyboard-setup.service - Set the console keyboard layout...
[   30.123065] systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes...
[   30.124846] systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs...
[   30.128590] systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod...
[   30.130588] systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm...
[   30.132770] systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore...
[   30.135293] systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse...
[   30.137577] systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop...
[   30.143801] systemd[1]: Starting systemd-journald.service - Journal Service...
[   30.144552] systemd[1]: systemd-pcrmachine.service - TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f).
[   30.145652] systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems...
[   30.147713] systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices...
[   30.151927] systemd[1]: Starting zfs-volume-wait.service - Wait for ZFS Volume (zvol) links in /dev...
[   30.158256] systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System.
[   30.159113] systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System.
[   30.159941] systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System.
[   30.160774] systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System.
[   30.161603] systemd[1]: Mounted tmp.mount - Temporary Directory (/tmp).
[   30.164420] systemd[1]: Finished keyboard-setup.service - Set the console keyboard layout.
[   30.166028] systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes.
[   30.167107] systemd[1]: modprobe@configfs.service: Deactivated successfully.
[   30.167333] systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs.
[   30.168539] systemd[1]: modprobe@dm_mod.service: Deactivated successfully.
[   30.168763] systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod.
[   30.169844] systemd[1]: modprobe@efi_pstore.service: Deactivated successfully.
[   30.170057] systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore.
[   30.171168] systemd[1]: modprobe@fuse.service: Deactivated successfully.
[   30.171373] systemd[1]: Finished modprobe@fuse.service - Load Kernel Module fuse.
[   30.174169] systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System...
[   30.175003] systemd-journald[688]: Collecting audit messages is disabled.
[   30.178996] systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System...
[   30.183715] systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully...
[   30.186875] systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System.
[   30.187867] loop: module loaded
[   30.188234] systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System.
[   30.190958] systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems.
[   30.193910] systemd[1]: systemd-hwdb-update.service - Rebuild Hardware Database was skipped because of an unmet condition check (ConditionNeedsUpdate=/etc).
[   30.193990] systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore).
[   30.195469] systemd[1]: Starting systemd-random-seed.service - Load/Save OS Random Seed...
[   30.204462] systemd[1]: modprobe@loop.service: Deactivated successfully.
[   30.204655] systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop.
[   30.205484] systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met.
[   30.205993] RPC: Registered named UNIX socket transport module.
[   30.205999] RPC: Registered udp transport module.
[   30.206001] RPC: Registered tcp transport module.
[   30.206003] RPC: Registered tcp-with-tls transport module.
[   30.206004] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   30.212466] systemd[1]: Started dbus.service - D-Bus System Message Bus.
[   30.236975] ACPI: bus type drm_connector registered
[   30.238187] systemd[1]: modprobe@drm.service: Deactivated successfully.
[   30.238389] systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm.
[   30.255189] systemd[1]: Finished zfs-volume-wait.service - Wait for ZFS Volume (zvol) links in /dev.
[   30.256118] systemd[1]: Reached target zfs-volumes.target - ZFS volumes are ready.
[   30.261358] systemd[1]: Finished systemd-random-seed.service - Load/Save OS Random Seed.
[   30.265640] systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully.
[   30.266567] systemd[1]: systemd-sysusers.service - Create System Users was skipped because no trigger condition checks were met.
[   30.282305] systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev...
[   30.283640] systemd[1]: Started systemd-journald.service - Journal Service.
[   30.319234] systemd-journald[688]: Received client request to flush runtime journal.
[   30.338195] systemd-journald[688]: /var/log/journal/44e4f537dae94ab69e91a2cb7a24c054/system.journal: Journal file uses a different sequence number ID, rotating.
[   30.338204] systemd-journald[688]: Rotating system journal.
[   30.545298] sd 0:0:0:0: Attached scsi generic sg0 type 0
[   30.547056] sd 3:0:0:1: Attached scsi generic sg1 type 0
[   30.550022] sr 2:0:0:0: Attached scsi generic sg2 type 5
[   30.553078] sd 4:0:0:0: Attached scsi generic sg3 type 0
[   30.554299] ses 4:0:1:0: Attached scsi generic sg4 type 13
[   30.556078] sd 4:0:2:0: Attached scsi generic sg5 type 0
[   30.557255] sd 4:0:3:0: Attached scsi generic sg6 type 0
[   30.557689] sd 4:0:4:0: Attached scsi generic sg7 type 0
[   30.561047] sd 4:0:5:0: Attached scsi generic sg8 type 0
[   30.563832] sd 4:0:6:0: Attached scsi generic sg9 type 0
[   30.563871] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input5
[   30.564297] sd 4:0:7:0: Attached scsi generic sg10 type 0
[   30.566054] sd 4:0:8:0: Attached scsi generic sg11 type 0
[   30.573192] ses 4:0:9:0: Attached scsi generic sg12 type 13
[   30.624526] ACPI: button: Power Button [PWRF]
[   30.655267] Free page reporting enabled
[   30.694106] input: PC Speaker as /devices/platform/pcspkr/input/input6
[   30.705662] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console
[   30.712069] Console: switching to colour dummy device 80x25
[   30.712285] [drm] Found bochs VGA, ID 0xb0c5.
[   30.712289] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfeb50000.
[   30.714706] [drm] Found EDID data blob.
[   30.732172] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0
[   30.746275] fbcon: bochs-drmdrmfb (fb0) is primary device
[   30.817083] Console: switching to colour frame buffer device 160x50
[   30.827195] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device
[   30.943468] Error: Driver 'pcspkr' is already registered, aborting...
[   30.969799] cryptd: max_cpu_qlen set to 1000
[   31.022226] AES CTR mode by8 optimization enabled
[  115.917308] dca service started, version 1.12.1
[  115.921539] ioatdma: Intel(R) QuickData Technology Driver 5.00
[  115.927185] NTB Resource Split driver, version 1
[  115.929920] Software Queue-Pair Transport over NTB, version 4
[  119.077986] audit: type=1400 audit(1773187203.460:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=2537 comm="apparmor_parser"
[  119.079448] audit: type=1400 audit(1773187203.460:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=2537 comm="apparmor_parser"
[  119.080499] audit: type=1400 audit(1773187203.460:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=2535 comm="apparmor_parser"
[  119.081528] audit: type=1400 audit(1773187203.464:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/lxc-start" pid=2545 comm="apparmor_parser"
[  119.082585] audit: type=1400 audit(1773187203.468:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=2546 comm="apparmor_parser"
[  119.083648] audit: type=1400 audit(1773187203.468:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=2546 comm="apparmor_parser"
[  119.084751] audit: type=1400 audit(1773187203.468:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=2546 comm="apparmor_parser"
[  119.084754] audit: type=1400 audit(1773187203.472:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default" pid=2536 comm="apparmor_parser"
[  119.084757] audit: type=1400 audit(1773187203.472:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-cgns" pid=2536 comm="apparmor_parser"
[  119.084760] audit: type=1400 audit(1773187203.472:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-with-mounting" pid=2536 comm="apparmor_parser"
[  119.850510] NFSD: Using nfsdcld client tracking operations.
[  119.850516] NFSD: no clients to reclaim, skipping NFSv4 grace period (net f0000000)
[  154.116112] sd 4:0:8:0: attempting task abort!scmd(0x000000009cb0e775), outstanding for 31004 ms & timeout 30000 ms
[  154.116127] sd 4:0:8:0: [sdj] tag#2671 CDB: Read(16) 88 00 00 00 00 00 a2 c8 a5 80 00 00 00 08 00 00
[  154.116132] scsi target4:0:8: handle(0x0020), sas_address(0x3474f4f584a11c0f), phy(15)
[  154.116139] scsi target4:0:8: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[  154.116144] scsi target4:0:8: enclosure level(0x0000), connector name( C0  )
[  154.576777] sd 4:0:8:0: task abort: SUCCESS scmd(0x000000009cb0e775)
[  154.927693] sd 4:0:8:0: Power-on or device reset occurred
[  186.882955] sd 4:0:8:0: attempting task abort!scmd(0x00000000b2a491b0), outstanding for 31816 ms & timeout 30000 ms
[  186.882966] sd 4:0:8:0: [sdj] tag#6512 CDB: Read(16) 88 00 00 00 00 05 cb 80 2b 00 00 00 00 08 00 00
[  186.882972] scsi target4:0:8: handle(0x0020), sas_address(0x3474f4f584a11c0f), phy(15)
[  186.882979] scsi target4:0:8: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[  186.882984] scsi target4:0:8: enclosure level(0x0000), connector name( C0  )
[  187.324856] sd 4:0:8:0: task abort: SUCCESS scmd(0x00000000b2a491b0)
[  187.324874] sd 4:0:8:0: attempting task abort!scmd(0x0000000011b84ad5), outstanding for 32220 ms & timeout 30000 ms
[  187.324881] sd 4:0:8:0: [sdj] tag#6511 CDB: Read(16) 88 00 00 00 00 09 18 5f ff f8 00 00 00 08 00 00
[  187.324885] scsi target4:0:8: handle(0x0020), sas_address(0x3474f4f584a11c0f), phy(15)
[  187.324892] scsi target4:0:8: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[  187.324897] scsi target4:0:8: enclosure level(0x0000), connector name( C0  )
[  187.324903] sd 4:0:8:0: No reference found at driver, assuming scmd(0x0000000011b84ad5) might have completed
[  187.324908] sd 4:0:8:0: task abort: SUCCESS scmd(0x0000000011b84ad5)
[  187.324918] sd 4:0:8:0: [sdj] tag#6511 FAILED Result: hostbyte=DID_TIME_OUT driverbyte=DRIVER_OK cmd_age=32s
[  187.324923] sd 4:0:8:0: [sdj] tag#6511 CDB: Read(16) 88 00 00 00 00 09 18 5f ff f8 00 00 00 08 00 00
[  187.324927] I/O error, dev sdj, sector 39063650296 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
[  187.324995] sd 4:0:8:0: attempting task abort!scmd(0x0000000059899401), outstanding for 32220 ms & timeout 30000 ms
[  187.325000] sd 4:0:8:0: [sdj] tag#6510 CDB: Read(16) 88 00 00 00 00 05 cb 80 2e 90 00 00 00 08 00 00
[  187.325004] scsi target4:0:8: handle(0x0020), sas_address(0x3474f4f584a11c0f), phy(15)
[  187.325010] scsi target4:0:8: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[  187.325014] scsi target4:0:8: enclosure level(0x0000), connector name( C0  )
[  187.325019] sd 4:0:8:0: No reference found at driver, assuming scmd(0x0000000059899401) might have completed
[  187.325024] sd 4:0:8:0: task abort: SUCCESS scmd(0x0000000059899401)
[  187.325031] sd 4:0:8:0: attempting task abort!scmd(0x000000008c844526), outstanding for 32240 ms & timeout 30000 ms
[  187.325037] sd 4:0:8:0: [sdj] tag#2648 CDB: Write(16) 8a 00 00 00 00 04 79 00 2b 18 00 00 00 08 00 00
[  187.325041] scsi target4:0:8: handle(0x0020), sas_address(0x3474f4f584a11c0f), phy(15)
[  187.325046] scsi target4:0:8: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[  187.325050] scsi target4:0:8: enclosure level(0x0000), connector name( C0  )
[  187.325055] sd 4:0:8:0: No reference found at driver, assuming scmd(0x000000008c844526) might have completed
[  187.325059] sd 4:0:8:0: task abort: SUCCESS scmd(0x000000008c844526)
[  187.325066] sd 4:0:8:0: attempting task abort!scmd(0x0000000010ecd3a4), outstanding for 32256 ms & timeout 30000 ms
[  187.325071] sd 4:0:8:0: [sdj] tag#2647 CDB: Write(16) 8a 00 00 00 00 02 d9 c0 2b 98 00 00 00 08 00 00
[  187.325075] scsi target4:0:8: handle(0x0020), sas_address(0x3474f4f584a11c0f), phy(15)
[  187.325080] scsi target4:0:8: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[  187.325085] scsi target4:0:8: enclosure level(0x0000), connector name( C0  )
[  187.325089] sd 4:0:8:0: No reference found at driver, assuming scmd(0x0000000010ecd3a4) might have completed
[  187.325094] sd 4:0:8:0: task abort: SUCCESS scmd(0x0000000010ecd3a4)
[  187.325100] sd 4:0:8:0: attempting task abort!scmd(0x000000000940211a), outstanding for 32280 ms & timeout 30000 ms
[  187.325106] sd 4:0:8:0: [sdj] tag#2646 CDB: Read(16) 88 00 00 00 00 05 09 05 4f e8 00 00 00 08 00 00
[  187.325109] scsi target4:0:8: handle(0x0020), sas_address(0x3474f4f584a11c0f), phy(15)
[  187.325114] scsi target4:0:8: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[  187.325119] scsi target4:0:8: enclosure level(0x0000), connector name( C0  )
[  187.325123] sd 4:0:8:0: No reference found at driver, assuming scmd(0x000000000940211a) might have completed
[  187.325128] sd 4:0:8:0: task abort: SUCCESS scmd(0x000000000940211a)
[  187.797659] sd 4:0:8:0: Power-on or device reset occurred
[  219.652531] sd 4:0:7:0: attempting task abort!scmd(0x000000001a5e736b), outstanding for 30876 ms & timeout 30000 ms
[  219.652543] sd 4:0:7:0: [sdi] tag#2628 CDB: Read(16) 88 00 00 00 00 06 81 00 47 48 00 00 00 08 00 00
[  219.652549] scsi target4:0:7: handle(0x001f), sas_address(0x3474f4f584a11c0e), phy(14)
[  219.652556] scsi target4:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(14)
[  219.652561] scsi target4:0:7: enclosure level(0x0000), connector name( C0  )
[  220.072950] sd 4:0:7:0: task abort: SUCCESS scmd(0x000000001a5e736b)
[  220.072977] sd 4:0:7:0: attempting task abort!scmd(0x0000000053ebfcf5), outstanding for 31372 ms & timeout 30000 ms
[  220.072982] sd 4:0:7:0: [sdi] tag#2627 CDB: Write(16) 8a 00 00 00 00 04 79 00 2b f0 00 00 00 08 00 00
[  220.072985] scsi target4:0:7: handle(0x001f), sas_address(0x3474f4f584a11c0e), phy(14)
[  220.072989] scsi target4:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(14)
[  220.072992] scsi target4:0:7: enclosure level(0x0000), connector name( C0  )
[  220.072995] sd 4:0:7:0: No reference found at driver, assuming scmd(0x0000000053ebfcf5) might have completed
[  220.072998] sd 4:0:7:0: task abort: SUCCESS scmd(0x0000000053ebfcf5)
[  220.073013] sd 4:0:7:0: attempting task abort!scmd(0x00000000fe2e2fff), outstanding for 31296 ms & timeout 30000 ms
[  220.073016] sd 4:0:7:0: [sdi] tag#2626 CDB: Read(16) 88 00 00 00 00 06 81 00 40 38 00 00 00 08 00 00
[  220.073018] scsi target4:0:7: handle(0x001f), sas_address(0x3474f4f584a11c0e), phy(14)
[  220.073021] scsi target4:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(14)
[  220.073024] scsi target4:0:7: enclosure level(0x0000), connector name( C0  )
[  220.073026] sd 4:0:7:0: No reference found at driver, assuming scmd(0x00000000fe2e2fff) might have completed
[  220.073029] sd 4:0:7:0: task abort: SUCCESS scmd(0x00000000fe2e2fff)
[  220.073044] sd 4:0:7:0: attempting task abort!scmd(0x00000000486c4dc9), outstanding for 31296 ms & timeout 30000 ms
[  220.073047] sd 4:0:7:0: [sdi] tag#2625 CDB: Read(16) 88 00 00 00 00 06 81 07 67 30 00 00 00 08 00 00
[  220.073049] scsi target4:0:7: handle(0x001f), sas_address(0x3474f4f584a11c0e), phy(14)
[  220.073052] scsi target4:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(14)
[  220.073055] scsi target4:0:7: enclosure level(0x0000), connector name( C0  )
[  220.073057] sd 4:0:7:0: No reference found at driver, assuming scmd(0x00000000486c4dc9) might have completed
[  220.073060] sd 4:0:7:0: task abort: SUCCESS scmd(0x00000000486c4dc9)
[  220.073076] sd 4:0:7:0: attempting task abort!scmd(0x00000000b7ebd2de), outstanding for 31336 ms & timeout 30000 ms
[  220.073079] sd 4:0:7:0: [sdi] tag#2624 CDB: Write(16) 8a 00 00 00 00 02 d9 c0 2c 90 00 00 00 20 00 00
[  220.073081] scsi target4:0:7: handle(0x001f), sas_address(0x3474f4f584a11c0e), phy(14)
[  220.073084] scsi target4:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(14)
[  220.073086] scsi target4:0:7: enclosure level(0x0000), connector name( C0  )
[  220.073089] sd 4:0:7:0: No reference found at driver, assuming scmd(0x00000000b7ebd2de) might have completed
[  220.073091] sd 4:0:7:0: task abort: SUCCESS scmd(0x00000000b7ebd2de)
[  220.422931] sd 4:0:7:0: Power-on or device reset occurred
[  252.419068] sd 4:0:6:0: attempting task abort!scmd(0x0000000014c2e94a), outstanding for 31056 ms & timeout 30000 ms
[  252.419082] sd 4:0:6:0: [sdh] tag#2633 CDB: Write(16) 8a 00 00 00 00 04 79 00 2c 98 00 00 00 08 00 00
[  252.419088] scsi target4:0:6: handle(0x001e), sas_address(0x3474f4f584a11c0d), phy(13)
[  252.419096] scsi target4:0:6: enclosure logical id(0x3474f4f584a11c3e), slot(13)
[  252.419102] scsi target4:0:6: enclosure level(0x0000), connector name( C0  )
[  252.821081] sd 4:0:6:0: task abort: SUCCESS scmd(0x0000000014c2e94a)
[  253.295142] sd 4:0:6:0: Power-on or device reset occurred
[  285.184722] sd 4:0:5:0: attempting task abort!scmd(0x00000000b0b5ce56), outstanding for 30952 ms & timeout 30000 ms
[  285.184734] sd 4:0:5:0: [sdg] tag#2675 CDB: Read(16) 88 00 00 00 00 05 3b 4d 06 c8 00 00 00 08 00 00
[  285.184740] scsi target4:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0c), phy(12)
[  285.184747] scsi target4:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(12)
[  285.184752] scsi target4:0:5: enclosure level(0x0000), connector name( C0  )
[  285.569121] sd 4:0:5:0: task abort: SUCCESS scmd(0x00000000b0b5ce56)
[  285.569138] sd 4:0:5:0: attempting task abort!scmd(0x00000000f10da551), outstanding for 31336 ms & timeout 30000 ms
[  285.569146] sd 4:0:5:0: [sdg] tag#2674 CDB: Write(16) 8a 00 00 00 00 04 79 00 2d 60 00 00 00 08 00 00
[  285.569152] scsi target4:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0c), phy(12)
[  285.569159] scsi target4:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(12)
[  285.569165] scsi target4:0:5: enclosure level(0x0000), connector name( C0  )
[  285.569172] sd 4:0:5:0: No reference found at driver, assuming scmd(0x00000000f10da551) might have completed
[  285.569178] sd 4:0:5:0: task abort: SUCCESS scmd(0x00000000f10da551)
[  285.569187] sd 4:0:5:0: attempting task abort!scmd(0x000000004a1aee33), outstanding for 31356 ms & timeout 30000 ms
[  285.569193] sd 4:0:5:0: [sdg] tag#2673 CDB: Write(16) 8a 00 00 00 00 02 d9 c0 2e 28 00 00 00 08 00 00
[  285.569198] scsi target4:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0c), phy(12)
[  285.569204] scsi target4:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(12)
[  285.569209] scsi target4:0:5: enclosure level(0x0000), connector name( C0  )
[  285.569215] sd 4:0:5:0: No reference found at driver, assuming scmd(0x000000004a1aee33) might have completed
[  285.569221] sd 4:0:5:0: task abort: SUCCESS scmd(0x000000004a1aee33)
[  285.919882] sd 4:0:5:0: Power-on or device reset occurred
[  289.691670] systemd-journald[688]: /var/log/journal/44e4f537dae94ab69e91a2cb7a24c054/user-3000.journal: Journal file uses a different sequence number ID, rotating.
[  317.954561] sd 4:0:5:0: attempting task abort!scmd(0x00000000c45d9902), outstanding for 32004 ms & timeout 30000 ms
[  317.954575] sd 4:0:5:0: [sdg] tag#2646 CDB: ATA command pass through(12)/Blank a1 08 2e 00 01 00 00 00 00 ec 00 00
[  317.954581] scsi target4:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0c), phy(12)
[  317.954589] scsi target4:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(12)
[  317.954595] scsi target4:0:5: enclosure level(0x0000), connector name( C0  )
[  318.317185] sd 4:0:5:0: task abort: SUCCESS scmd(0x00000000c45d9902)
[  318.317208] sd 4:0:5:0: attempting task abort!scmd(0x00000000515541b6), outstanding for 32364 ms & timeout 30000 ms
[  318.317213] sd 4:0:5:0: [sdg] tag#2645 CDB: Read(16) 88 00 00 00 00 05 65 82 fe 10 00 00 00 28 00 00
[  318.317216] scsi target4:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0c), phy(12)
[  318.317219] scsi target4:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(12)
[  318.317222] scsi target4:0:5: enclosure level(0x0000), connector name( C0  )
[  318.317225] sd 4:0:5:0: No reference found at driver, assuming scmd(0x00000000515541b6) might have completed
[  318.317228] sd 4:0:5:0: task abort: SUCCESS scmd(0x00000000515541b6)
[  318.673588] sd 4:0:5:0: Power-on or device reset occurred
[  350.708838] sd 4:0:4:0: attempting task abort!scmd(0x00000000160823b7), outstanding for 31192 ms & timeout 30000 ms
[  350.708852] sd 4:0:4:0: [sdf] tag#2682 CDB: Write(16) 8a 00 00 00 00 02 d9 c0 2f 00 00 00 00 08 00 00
[  350.708858] scsi target4:0:4: handle(0x001c), sas_address(0x3474f4f584a11c0b), phy(11)
[  350.708866] scsi target4:0:4: enclosure logical id(0x3474f4f584a11c3e), slot(11)
[  350.708872] scsi target4:0:4: enclosure level(0x0000), connector name( C0  )
[  351.065068] sd 4:0:4:0: task abort: SUCCESS scmd(0x00000000160823b7)
[  351.065078] sd 4:0:4:0: attempting task abort!scmd(0x00000000a206df50), outstanding for 31532 ms & timeout 30000 ms
[  351.065081] sd 4:0:4:0: [sdf] tag#2681 CDB: Write(16) 8a 00 00 00 00 04 79 00 2e 28 00 00 00 08 00 00
[  351.065084] scsi target4:0:4: handle(0x001c), sas_address(0x3474f4f584a11c0b), phy(11)
[  351.065087] scsi target4:0:4: enclosure logical id(0x3474f4f584a11c3e), slot(11)
[  351.065090] scsi target4:0:4: enclosure level(0x0000), connector name( C0  )
[  351.065093] sd 4:0:4:0: No reference found at driver, assuming scmd(0x00000000a206df50) might have completed
[  351.065096] sd 4:0:4:0: task abort: SUCCESS scmd(0x00000000a206df50)
[  351.100235] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.211611] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.213837] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.214724] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.229691] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.232316] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.233316] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.235353] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.236447] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.237416] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.238448] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.239579] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.240650] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.241589] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.243378] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.244623] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.245977] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.261586] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.265356] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.268294] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.271619] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.276465] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.290496] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.303746] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.305406] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.310404] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.325598] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.338787] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.340640] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.345478] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.359470] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.375000] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.376788] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.381767] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.396462] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.410148] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.411916] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.416734] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.418208] sd 4:0:4:0: Power-on or device reset occurred
[  351.430942] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.444666] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.446258] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.451095] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.465291] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.479330] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.481534] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.486364] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.514353] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  351.528010] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[  383.475090] sd 4:0:4:0: attempting task abort!scmd(0x00000000d7400ae6), outstanding for 31920 ms & timeout 30000 ms
[  383.475103] sd 4:0:4:0: [sdf] tag#2642 CDB: Read(16) 88 00 00 00 00 09 18 5f ff f8 00 00 00 08 00 00
[  383.475108] scsi target4:0:4: handle(0x001c), sas_address(0x3474f4f584a11c0b), phy(11)
[  383.475115] scsi target4:0:4: enclosure logical id(0x3474f4f584a11c3e), slot(11)
[  383.475120] scsi target4:0:4: enclosure level(0x0000), connector name( C0  )
[  383.813420] sd 4:0:4:0: task abort: SUCCESS scmd(0x00000000d7400ae6)
[  383.813436] sd 4:0:4:0: [sdf] tag#2642 FAILED Result: hostbyte=DID_TIME_OUT driverbyte=DRIVER_OK cmd_age=32s
[  383.813444] sd 4:0:4:0: [sdf] tag#2642 CDB: Read(16) 88 00 00 00 00 09 18 5f ff f8 00 00 00 08 00 00
[  383.813449] I/O error, dev sdf, sector 39063650296 op 0x0:(READ) flags 0x80700 phys_seg 1 prio class 0
[  384.167343] sd 4:0:4:0: Power-on or device reset occurred
[  416.249503] sd 4:0:0:0: attempting task abort!scmd(0x00000000aefc4c47), outstanding for 31008 ms & timeout 30000 ms
[  416.249519] sd 4:0:0:0: [sdc] tag#2660 CDB: Write(16) 8a 00 00 00 00 02 d9 c0 2c 00 00 00 00 18 00 00
[  416.249525] scsi target4:0:0: handle(0x0019), sas_address(0x3474f4f584a11c08), phy(8)
[  416.249532] scsi target4:0:0: enclosure logical id(0x3474f4f584a11c3e), slot(8)
[  416.249538] scsi target4:0:0: enclosure level(0x0000), connector name( C0  )
[  416.561327] sd 4:0:0:0: task abort: SUCCESS scmd(0x00000000aefc4c47)
[  416.561369] sd 4:0:0:0: attempting task abort!scmd(0x00000000e0311331), outstanding for 31320 ms & timeout 30000 ms
[  416.561377] sd 4:0:0:0: [sdc] tag#2659 CDB: Write(16) 8a 00 00 00 00 02 d9 c0 2b a8 00 00 00 20 00 00
[  416.561382] scsi target4:0:0: handle(0x0019), sas_address(0x3474f4f584a11c08), phy(8)
[  416.561389] scsi target4:0:0: enclosure logical id(0x3474f4f584a11c3e), slot(8)
[  416.561394] scsi target4:0:0: enclosure level(0x0000), connector name( C0  )
[  416.561400] sd 4:0:0:0: No reference found at driver, assuming scmd(0x00000000e0311331) might have completed
[  416.561405] sd 4:0:0:0: task abort: SUCCESS scmd(0x00000000e0311331)
[  417.162903] sd 4:0:0:0: Power-on or device reset occurred
[  449.011800] sd 4:0:2:0: attempting task abort!scmd(0x0000000078cf935e), outstanding for 30240 ms & timeout 30000 ms
[  449.011810] sd 4:0:2:0: [sdd] tag#2673 CDB: Write(16) 8a 00 00 00 00 04 79 00 2f 70 00 00 00 18 00 00
[  449.011813] scsi target4:0:2: handle(0x001a), sas_address(0x3474f4f584a11c09), phy(9)
[  449.011817] scsi target4:0:2: enclosure logical id(0x3474f4f584a11c3e), slot(9)
[  449.011820] scsi target4:0:2: enclosure level(0x0000), connector name( C0  )
[  449.309331] sd 4:0:2:0: task abort: SUCCESS scmd(0x0000000078cf935e)
[  449.662310] sd 4:0:2:0: Power-on or device reset occurred
[ 8627.100926] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.215058] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.216690] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.217647] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.219956] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.221168] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.223316] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.230269] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.235753] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.241433] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.246888] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.252341] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.257951] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.263408] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
[ 8627.268871] mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
20260310_173743.jpg20260310_173755.jpg
 
D

Darkwing314

New Member
Oct 30, 2025
29
8
3
BLinux said:
As for other potential causes:

1) power instability. Had a customer that had inadequate power supply and under load, voltage dropped on 12v and some drives would drop out.

2) Seagate EPC issue. Search online for workaround.

3) defective cabling that is intermittently disconnecting. Although, this also often results in UDMA CRC errors increasing. Not sure if you see that?
Click to expand...
Thanks for the help so far.

I do have a second power supply so maybe I'll try swapping that in and see if that makes any difference.

EPC seems to be an issue for EXOS drives on non-server hardware. This is all server hardware so I would hope it would be fine? I'll read up a bit more on that though.

The cabling seems a possible thing but I keep thinking back to how this was happening at exactly the same time each day - there's no way something like that would be cabling related.
 
D

Darkwing314

New Member
Oct 30, 2025
29
8
3
I was able to do some more testing last night. It seems the most reliable way to reproduce the issue is to just reboot TrueNAS. It will reliably show the issue a couple of minutes into the boot process. I assume anyways that the device on/power resets are not normal boot-up behavior?
  1. I had 2x cables from HBA to my front backplane and 1x cable to the rear one (no drives there so we'll ignore that one for now). I disconnected the second cable to front backplane so that it only has 1 cable going to C0 on HBA -> No change
  2. I disconnected the first cable and used the second cable to C1 on HBA -> No change. Therefore it is not a cable problem or individual port on HBA problem. Could be both cables or ports, but cable seems unlikely to me given the periodicity of the error (every day at 10:26pm)
  3. This server chassis has dual redundant 1300W power supplies but I was only using one of them (second PSU bay empty). I installed the second PSU, powered it, and rebooted -> No change
  4. I have also enabled debug logging for the mpt3sas driver so we'll see if that shows anything new.
  5. In proxmox, for TrueNAS VM, I changed the machine type to q35 so that I could enable the PCI-Express passthrough option for the HBA -> No change.
  6. I also disabled EPC on these drives -> No change that I can tell so far
Tonight I plan to try a few more things:
  1. Remove PSU #1 - I'm not entirely sure how these redundant supplies work - it's possible that adding the second one did nothing as it is the spare? Also worth noting, on PSU #1 I replaced the fan (to be quieter) but it is noticeably hotter than the other one. Perhaps it is getting too warm under sustained loads? That said, peak power draw (reported from IPMI for the mobo) is on the order of 300W so this seems unlikely to be the issue, especially when considering it happening at the same time each day and not randomly or based on load.
  2. Move the HBA to a different PCIe slot. I'm doubting this will do anything either but I guess you never know.
  3. I've also ordered another HBA (9300-8i this time which seems more supported) for helping figure this out.
Last DMESG output from last night is below.

Code: 
[    0.555405] pci 0000:05:04.0: PCI bridge to [bus 09]
[    0.555449] pci 0000:05:04.0:   bridge window [io  0x1000-0x1fff]
[    0.555479] pci 0000:05:04.0:   bridge window [mem 0xfd800000-0xfd9fffff]
[    0.556776] pci 0000:05:04.0:   bridge window [mem 0xc000000000-0xc01fffffff 64bit pref]
[    0.557934] pci 0000:00:1e.0: PCI bridge to [bus 05-09] (subtractive decode)
[    0.558408] pci 0000:00:1e.0:   bridge window [io  0x0000-0x0cf7 window] (subtractive decode)
[    0.558412] pci 0000:00:1e.0:   bridge window [io  0x0d00-0xffff window] (subtractive decode)
[    0.558415] pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    0.558418] pci 0000:00:1e.0:   bridge window [mem 0x80000000-0xafffffff window] (subtractive decode)
[    0.558421] pci 0000:00:1e.0:   bridge window [mem 0xc0000000-0xfebfffff window] (subtractive decode)
[    0.558423] pci 0000:00:1e.0:   bridge window [mem 0xc000000000-0xc7ffffffff window] (subtractive decode)
[    0.559102] pci_bus 0000:06: extended config space not accessible
[    0.559446] acpiphp: Slot [3] registered
[    0.559484] acpiphp: Slot [18-2] registered
[    0.559521] acpiphp: Slot [0-6] registered
[    0.559552] acpiphp: Slot [1] registered
[    0.559589] acpiphp: Slot [2] registered
[    0.559619] acpiphp: Slot [4] registered
[    0.559656] acpiphp: Slot [5-2] registered
[    0.559691] acpiphp: Slot [6-2] registered
[    0.559726] acpiphp: Slot [7-2] registered
[    0.559762] acpiphp: Slot [8-2] registered
[    0.559797] acpiphp: Slot [9-2] registered
[    0.559833] acpiphp: Slot [10-2] registered
[    0.559868] acpiphp: Slot [11-2] registered
[    0.559907] acpiphp: Slot [12-2] registered
[    0.559943] acpiphp: Slot [13-2] registered
[    0.559978] acpiphp: Slot [14-2] registered
[    0.560014] acpiphp: Slot [15-2] registered
[    0.560049] acpiphp: Slot [16-2] registered
[    0.560085] acpiphp: Slot [17-2] registered
[    0.560123] acpiphp: Slot [19-2] registered
[    0.560158] acpiphp: Slot [20-2] registered
[    0.560196] acpiphp: Slot [21-2] registered
[    0.560231] acpiphp: Slot [22-2] registered
[    0.560267] acpiphp: Slot [23-2] registered
[    0.560303] acpiphp: Slot [24-2] registered
[    0.560341] acpiphp: Slot [25-2] registered
[    0.560376] acpiphp: Slot [26-2] registered
[    0.560415] acpiphp: Slot [27-2] registered
[    0.562198] acpiphp: Slot [28-2] registered
[    0.562235] acpiphp: Slot [29-2] registered
[    0.562271] acpiphp: Slot [30-2] registered
[    0.562307] acpiphp: Slot [31-2] registered
[    0.562526] pci 0000:06:03.0: [1af4:1002] type 00 class 0x00ff00 conventional PCI endpoint
[    0.564883] pci 0000:06:03.0: BAR 0 [io  0x4000-0x403f]
[    0.566371] pci 0000:06:03.0: BAR 1 [mem 0xfde40000-0xfde40fff]
[    0.575712] pci 0000:06:03.0: BAR 4 [mem 0xc060000000-0xc060003fff 64bit pref]
[    0.582413] pci 0000:06:12.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint
[    0.584651] pci 0000:06:12.0: BAR 0 [io  0x4040-0x407f]
[    0.586368] pci 0000:06:12.0: BAR 1 [mem 0xfde41000-0xfde41fff]
[    0.596521] pci 0000:06:12.0: BAR 4 [mem 0xc060004000-0xc060007fff 64bit pref]
[    0.598368] pci 0000:06:12.0: ROM [mem 0xfde00000-0xfde3ffff pref]
[    0.600198] pci 0000:05:01.0: PCI bridge to [bus 06]
[    0.603145] pci_bus 0000:07: extended config space not accessible
[    0.603522] acpiphp: Slot [0-7] registered
[    0.603559] acpiphp: Slot [1-2] registered
[    0.603596] acpiphp: Slot [2-2] registered
[    0.603633] acpiphp: Slot [3-2] registered
[    0.603669] acpiphp: Slot [4-2] registered
[    0.603705] acpiphp: Slot [5-3] registered
[    0.603741] acpiphp: Slot [6-3] registered
[    0.603785] acpiphp: Slot [7-3] registered
[    0.603824] acpiphp: Slot [8-3] registered
[    0.603861] acpiphp: Slot [9-3] registered
[    0.603898] acpiphp: Slot [10-3] registered
[    0.603935] acpiphp: Slot [11-3] registered
[    0.603972] acpiphp: Slot [12-3] registered
[    0.604009] acpiphp: Slot [13-3] registered
[    0.604046] acpiphp: Slot [14-3] registered
[    0.604092] acpiphp: Slot [15-3] registered
[    0.604131] acpiphp: Slot [16-3] registered
[    0.604169] acpiphp: Slot [17-3] registered
[    0.604206] acpiphp: Slot [18-3] registered
[    0.604243] acpiphp: Slot [19-3] registered
[    0.604280] acpiphp: Slot [20-3] registered
[    0.604318] acpiphp: Slot [21-3] registered
[    0.604355] acpiphp: Slot [22-3] registered
[    0.604394] acpiphp: Slot [23-3] registered
[    0.604431] acpiphp: Slot [24-3] registered
[    0.604471] acpiphp: Slot [25-3] registered
[    0.604508] acpiphp: Slot [26-3] registered
[    0.604548] acpiphp: Slot [27-3] registered
[    0.604586] acpiphp: Slot [28-3] registered
[    0.604623] acpiphp: Slot [29-3] registered
[    0.604663] acpiphp: Slot [30-3] registered
[    0.604701] acpiphp: Slot [31-3] registered
[    0.605147] pci 0000:05:02.0: PCI bridge to [bus 07]
[    0.606998] pci_bus 0000:08: extended config space not accessible
[    0.607371] acpiphp: Slot [0-8] registered
[    0.607410] acpiphp: Slot [1-3] registered
[    0.607455] acpiphp: Slot [2-3] registered
[    0.607493] acpiphp: Slot [3-3] registered
[    0.607531] acpiphp: Slot [4-3] registered
[    0.607569] acpiphp: Slot [5-4] registered
[    0.607607] acpiphp: Slot [6-4] registered
[    0.607646] acpiphp: Slot [7-4] registered
[    0.607686] acpiphp: Slot [8-4] registered
[    0.607724] acpiphp: Slot [9-4] registered
[    0.607763] acpiphp: Slot [10-4] registered
[    0.607802] acpiphp: Slot [11-4] registered
[    0.607840] acpiphp: Slot [12-4] registered
[    0.607879] acpiphp: Slot [13-4] registered
[    0.607917] acpiphp: Slot [14-4] registered
[    0.607958] acpiphp: Slot [15-4] registered
[    0.607997] acpiphp: Slot [16-4] registered
[    0.608036] acpiphp: Slot [17-4] registered
[    0.608075] acpiphp: Slot [18-4] registered
[    0.608114] acpiphp: Slot [19-4] registered
[    0.608153] acpiphp: Slot [20-4] registered
[    0.608192] acpiphp: Slot [21-4] registered
[    0.608232] acpiphp: Slot [22-4] registered
[    0.608273] acpiphp: Slot [23-4] registered
[    0.608313] acpiphp: Slot [24-4] registered
[    0.608352] acpiphp: Slot [25-4] registered
[    0.608391] acpiphp: Slot [26-4] registered
[    0.608432] acpiphp: Slot [27-4] registered
[    0.608477] acpiphp: Slot [28-4] registered
[    0.608516] acpiphp: Slot [29-4] registered
[    0.608557] acpiphp: Slot [30-4] registered
[    0.608596] acpiphp: Slot [31-4] registered
[    0.609039] pci 0000:05:03.0: PCI bridge to [bus 08]
[    0.610154] pci_bus 0000:09: extended config space not accessible
[    0.610674] acpiphp: Slot [1-4] registered
[    0.610716] acpiphp: Slot [2-4] registered
[    0.610758] acpiphp: Slot [0-9] registered
[    0.610798] acpiphp: Slot [3-4] registered
[    0.610837] acpiphp: Slot [4-4] registered
[    0.610877] acpiphp: Slot [5-5] registered
[    0.610917] acpiphp: Slot [6-5] registered
[    0.610958] acpiphp: Slot [7-5] registered
[    0.610999] acpiphp: Slot [8-5] registered
[    0.611039] acpiphp: Slot [9-5] registered
[    0.611079] acpiphp: Slot [10-5] registered
[    0.611120] acpiphp: Slot [11-5] registered
[    0.611161] acpiphp: Slot [12-5] registered
[    0.611202] acpiphp: Slot [13-5] registered
[    0.611242] acpiphp: Slot [14-5] registered
[    0.611285] acpiphp: Slot [15-5] registered
[    0.611326] acpiphp: Slot [16-5] registered
[    0.611367] acpiphp: Slot [17-5] registered
[    0.611408] acpiphp: Slot [18-5] registered
[    0.611448] acpiphp: Slot [19-5] registered
[    0.611490] acpiphp: Slot [20-5] registered
[    0.611531] acpiphp: Slot [21-5] registered
[    0.611581] acpiphp: Slot [22-5] registered
[    0.611622] acpiphp: Slot [23-5] registered
[    0.611664] acpiphp: Slot [24-5] registered
[    0.611705] acpiphp: Slot [25-5] registered
[    0.611746] acpiphp: Slot [26-5] registered
[    0.611790] acpiphp: Slot [27-5] registered
[    0.611831] acpiphp: Slot [28-5] registered
[    0.611873] acpiphp: Slot [29-5] registered
[    0.611915] acpiphp: Slot [30-5] registered
[    0.611957] acpiphp: Slot [31-5] registered
[    0.612145] pci 0000:09:01.0: [1af4:1004] type 00 class 0x010000 conventional PCI endpoint
[    0.616340] pci 0000:09:01.0: BAR 0 [io  0x1000-0x103f]
[    0.619728] pci 0000:09:01.0: BAR 1 [mem 0xfd800000-0xfd800fff]
[    0.630369] pci 0000:09:01.0: BAR 4 [mem 0xc000000000-0xc000003fff 64bit pref]
[    0.636197] pci 0000:09:02.0: [1af4:1004] type 00 class 0x010000 conventional PCI endpoint
[    0.638367] pci 0000:09:02.0: BAR 0 [io  0x1040-0x107f]
[    0.640466] pci 0000:09:02.0: BAR 1 [mem 0xfd801000-0xfd801fff]
[    0.649553] pci 0000:09:02.0: BAR 4 [mem 0xc000004000-0xc000007fff 64bit pref]
[    0.654971] pci 0000:05:04.0: PCI bridge to [bus 09]
[    0.665080] ACPI: PCI: Interrupt link LNKA configured for IRQ 10
[    0.666452] ACPI: PCI: Interrupt link LNKB configured for IRQ 10
[    0.666587] ACPI: PCI: Interrupt link LNKC configured for IRQ 11
[    0.666720] ACPI: PCI: Interrupt link LNKD configured for IRQ 11
[    0.666859] ACPI: PCI: Interrupt link LNKE configured for IRQ 10
[    0.666992] ACPI: PCI: Interrupt link LNKF configured for IRQ 10
[    0.667133] ACPI: PCI: Interrupt link LNKG configured for IRQ 11
[    0.667270] ACPI: PCI: Interrupt link LNKH configured for IRQ 11
[    0.667325] ACPI: PCI: Interrupt link GSIA configured for IRQ 16
[    0.667340] ACPI: PCI: Interrupt link GSIB configured for IRQ 17
[    0.667353] ACPI: PCI: Interrupt link GSIC configured for IRQ 18
[    0.667365] ACPI: PCI: Interrupt link GSID configured for IRQ 19
[    0.667378] ACPI: PCI: Interrupt link GSIE configured for IRQ 20
[    0.667389] ACPI: PCI: Interrupt link GSIF configured for IRQ 21
[    0.667401] ACPI: PCI: Interrupt link GSIG configured for IRQ 22
[    0.667413] ACPI: PCI: Interrupt link GSIH configured for IRQ 23
[    0.668001] iommu: Default domain type: Passthrough (set via kernel command line)
[    0.668001] pps_core: LinuxPPS API ver. 1 registered
[    0.668001] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.668001] PTP clock support registered
[    0.668001] EDAC MC: Ver: 3.0.0
[    0.671120] NetLabel: Initializing
[    0.671120] NetLabel:  domain hash size = 128
[    0.671120] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.671120] NetLabel:  unlabeled traffic allowed by default
[    0.671120] PCI: Using ACPI for IRQ routing
[    0.774564] PCI: pci_cache_line_size set to 64 bytes
[    0.775329] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
[    0.775333] e820: reserve RAM buffer [mem 0x7ffd3000-0x7fffffff]
[    0.775364] pci 0000:00:01.0: vgaarb: setting as boot VGA device
[    0.775364] pci 0000:00:01.0: vgaarb: bridge control possible
[    0.775364] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.775364] vgaarb: loaded
[    0.775364] clocksource: Switched to clocksource kvm-clock
[    0.775364] VFS: Disk quotas dquot_6.6.0
[    0.775364] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.775423] AppArmor: AppArmor Filesystem Enabled
[    0.775462] pnp: PnP ACPI init
[    0.775920] system 00:03: [mem 0xb0000000-0xbfffffff window] has been reserved
[    0.776267] pnp: PnP ACPI: found 4 devices
[    0.784505] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.784580] NET: Registered PF_INET protocol family
[    0.784750] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.800765] tcp_listen_portaddr_hash hash table entries: 8192 (order: 5, 131072 bytes, linear)
[    0.800782] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.800787] TCP established hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.800944] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)
[    0.801071] TCP: Hash tables configured (established 131072 bind 65536)
[    0.801128] MPTCP token hash table entries: 16384 (order: 6, 393216 bytes, linear)
[    0.801161] UDP hash table entries: 8192 (order: 6, 262144 bytes, linear)
[    0.801185] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes, linear)
[    0.801255] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.801265] NET: Registered PF_XDP protocol family
[    0.801277] pci 0000:00:1c.1: bridge window [io  0x1000-0x0fff] to [bus 02] add_size 1000
[    0.801282] pci 0000:00:1c.2: bridge window [io  0x1000-0x0fff] to [bus 03] add_size 1000
[    0.801285] pci 0000:00:1c.3: bridge window [io  0x1000-0x0fff] to [bus 04] add_size 1000
[    0.801296] pci 0000:00:1c.1: bridge window [io  0x7000-0x7fff]: assigned
[    0.801300] pci 0000:00:1c.2: bridge window [io  0x8000-0x8fff]: assigned
[    0.801304] pci 0000:00:1c.3: bridge window [io  0x9000-0x9fff]: assigned
[    0.801308] pci 0000:00:1c.0: PCI bridge to [bus 01]
[    0.801330] pci 0000:00:1c.0:   bridge window [io  0x5000-0x5fff]
[    0.803855] pci 0000:00:1c.0:   bridge window [mem 0xfe800000-0xfe9fffff]
[    0.806581] pci 0000:00:1c.0:   bridge window [mem 0xc0e0000000-0xc0ffffffff 64bit pref]
[    0.810334] pci 0000:00:1c.1: PCI bridge to [bus 02]
[    0.810354] pci 0000:00:1c.1:   bridge window [io  0x7000-0x7fff]
[    0.812791] pci 0000:00:1c.1:   bridge window [mem 0xfe600000-0xfe7fffff]
[    0.814500] pci 0000:00:1c.1:   bridge window [mem 0xc0c0000000-0xc0dfffffff 64bit pref]
[    0.818316] pci 0000:00:1c.2: PCI bridge to [bus 03]
[    0.818334] pci 0000:00:1c.2:   bridge window [io  0x8000-0x8fff]
[    0.819600] pci 0000:00:1c.2:   bridge window [mem 0xfe400000-0xfe5fffff]
[    0.820463] pci 0000:00:1c.2:   bridge window [mem 0xc0a0000000-0xc0bfffffff 64bit pref]
[    0.822154] pci 0000:00:1c.3: PCI bridge to [bus 04]
[    0.822172] pci 0000:00:1c.3:   bridge window [io  0x9000-0x9fff]
[    0.823946] pci 0000:00:1c.3:   bridge window [mem 0xfe200000-0xfe3fffff]
[    0.825662] pci 0000:00:1c.3:   bridge window [mem 0xc080000000-0xc09fffffff 64bit pref]
[    0.830867] pci 0000:05:01.0: PCI bridge to [bus 06]
[    0.830887] pci 0000:05:01.0:   bridge window [io  0x4000-0x4fff]
[    0.832171] pci 0000:05:01.0:   bridge window [mem 0xfde00000-0xfdffffff]
[    0.833019] pci 0000:05:01.0:   bridge window [mem 0xc060000000-0xc07fffffff 64bit pref]
[    0.834689] pci 0000:05:02.0: PCI bridge to [bus 07]
[    0.834708] pci 0000:05:02.0:   bridge window [io  0x3000-0x3fff]
[    0.835994] pci 0000:05:02.0:   bridge window [mem 0xfdc00000-0xfddfffff]
[    0.836831] pci 0000:05:02.0:   bridge window [mem 0xc040000000-0xc05fffffff 64bit pref]
[    0.838871] pci 0000:05:03.0: PCI bridge to [bus 08]
[    0.838890] pci 0000:05:03.0:   bridge window [io  0x2000-0x2fff]
[    0.841004] pci 0000:05:03.0:   bridge window [mem 0xfda00000-0xfdbfffff]
[    0.844907] pci 0000:05:03.0:   bridge window [mem 0xc020000000-0xc03fffffff 64bit pref]
[    0.846530] pci 0000:05:04.0: PCI bridge to [bus 09]
[    0.846549] pci 0000:05:04.0:   bridge window [io  0x1000-0x1fff]
[    0.847735] pci 0000:05:04.0:   bridge window [mem 0xfd800000-0xfd9fffff]
[    0.848812] pci 0000:05:04.0:   bridge window [mem 0xc000000000-0xc01fffffff 64bit pref]
[    0.850854] pci 0000:00:1e.0: PCI bridge to [bus 05-09]
[    0.850873] pci 0000:00:1e.0:   bridge window [io  0x1000-0x4fff]
[    0.852182] pci 0000:00:1e.0:   bridge window [mem 0xfd800000-0xfe1fffff]
[    0.853146] pci 0000:00:1e.0:   bridge window [mem 0xc000000000-0xc07fffffff 64bit pref]
[    0.858273] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.858278] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.858281] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.858283] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window]
[    0.858286] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]
[    0.858289] pci_bus 0000:00: resource 9 [mem 0xc000000000-0xc7ffffffff window]
[    0.858293] pci_bus 0000:01: resource 0 [io  0x5000-0x5fff]
[    0.858296] pci_bus 0000:01: resource 1 [mem 0xfe800000-0xfe9fffff]
[    0.858298] pci_bus 0000:01: resource 2 [mem 0xc0e0000000-0xc0ffffffff 64bit pref]
[    0.858302] pci_bus 0000:02: resource 0 [io  0x7000-0x7fff]
[    0.858304] pci_bus 0000:02: resource 1 [mem 0xfe600000-0xfe7fffff]
[    0.858307] pci_bus 0000:02: resource 2 [mem 0xc0c0000000-0xc0dfffffff 64bit pref]
[    0.858310] pci_bus 0000:03: resource 0 [io  0x8000-0x8fff]
[    0.858313] pci_bus 0000:03: resource 1 [mem 0xfe400000-0xfe5fffff]
[    0.858315] pci_bus 0000:03: resource 2 [mem 0xc0a0000000-0xc0bfffffff 64bit pref]
[    0.858319] pci_bus 0000:04: resource 0 [io  0x9000-0x9fff]
[    0.858321] pci_bus 0000:04: resource 1 [mem 0xfe200000-0xfe3fffff]
[    0.858324] pci_bus 0000:04: resource 2 [mem 0xc080000000-0xc09fffffff 64bit pref]
[    0.858327] pci_bus 0000:05: resource 0 [io  0x1000-0x4fff]
[    0.858330] pci_bus 0000:05: resource 1 [mem 0xfd800000-0xfe1fffff]
[    0.858332] pci_bus 0000:05: resource 2 [mem 0xc000000000-0xc07fffffff 64bit pref]
[    0.858335] pci_bus 0000:05: resource 4 [io  0x0000-0x0cf7 window]
[    0.858338] pci_bus 0000:05: resource 5 [io  0x0d00-0xffff window]
[    0.858341] pci_bus 0000:05: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.858343] pci_bus 0000:05: resource 7 [mem 0x80000000-0xafffffff window]
[    0.858346] pci_bus 0000:05: resource 8 [mem 0xc0000000-0xfebfffff window]
[    0.858349] pci_bus 0000:05: resource 9 [mem 0xc000000000-0xc7ffffffff window]
[    0.858352] pci_bus 0000:06: resource 0 [io  0x4000-0x4fff]
[    0.858354] pci_bus 0000:06: resource 1 [mem 0xfde00000-0xfdffffff]
[    0.858357] pci_bus 0000:06: resource 2 [mem 0xc060000000-0xc07fffffff 64bit pref]
[    0.858360] pci_bus 0000:07: resource 0 [io  0x3000-0x3fff]
[    0.858363] pci_bus 0000:07: resource 1 [mem 0xfdc00000-0xfddfffff]
[    0.858365] pci_bus 0000:07: resource 2 [mem 0xc040000000-0xc05fffffff 64bit pref]
[    0.858368] pci_bus 0000:08: resource 0 [io  0x2000-0x2fff]
[    0.858371] pci_bus 0000:08: resource 1 [mem 0xfda00000-0xfdbfffff]
[    0.858373] pci_bus 0000:08: resource 2 [mem 0xc020000000-0xc03fffffff 64bit pref]
[    0.858377] pci_bus 0000:09: resource 0 [io  0x1000-0x1fff]
[    0.858379] pci_bus 0000:09: resource 1 [mem 0xfd800000-0xfd9fffff]
[    0.858382] pci_bus 0000:09: resource 2 [mem 0xc000000000-0xc01fffffff 64bit pref]
[    0.859066] ACPI: \_SB_.GSIA: Enabled at IRQ 16
[    0.860353] ACPI: \_SB_.GSIB: Enabled at IRQ 17
[    0.861598] ACPI: \_SB_.GSIC: Enabled at IRQ 18
[    0.862873] ACPI: \_SB_.GSID: Enabled at IRQ 19
[    0.869837] PCI: CLS 64 bytes, default 64
[    0.869925] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.869928] software IO TLB: mapped [mem 0x000000007bfd3000-0x000000007ffd3000] (64MB)
[    0.870039] Trying to unpack rootfs image as initramfs...
[    0.873954] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2b3e43c8763, max_idle_ns: 440795360101 ns
[    0.874495] Initialise system trusted keyrings
[    0.874863] Key type blacklist registered
[    0.875307] workingset: timestamp_bits=36 max_order=22 bucket_order=0
[    0.875315] zbud: loaded
[    0.875439] fuse: init (API version 7.41)
[    0.875683] integrity: Platform Keyring initialized
[    0.876033] integrity: Machine keyring initialized
[    0.896106] Key type asymmetric registered
[    0.896466] Asymmetric key parser 'x509' registered
[    1.458712] Freeing initrd memory: 82584K
[    1.465828] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 246)
[    1.465939] io scheduler mq-deadline registered
[    1.467769] ledtrig-cpu: registered to indicate activity on CPUs
[    1.471290] pcieport 0000:00:1c.0: PME: Signaling with IRQ 24
[    1.471589] pcieport 0000:00:1c.0: AER: enabled with IRQ 24
[    1.475312] pcieport 0000:00:1c.1: PME: Signaling with IRQ 25
[    1.475600] pcieport 0000:00:1c.1: AER: enabled with IRQ 25
[    1.480927] pcieport 0000:00:1c.2: PME: Signaling with IRQ 26
[    1.481219] pcieport 0000:00:1c.2: AER: enabled with IRQ 26
[    1.483996] pcieport 0000:00:1c.3: PME: Signaling with IRQ 27
[    1.484292] pcieport 0000:00:1c.3: AER: enabled with IRQ 27
[    1.486191] shpchp 0000:05:01.0: HPC vendor_id 1b36 device_id 1 ss_vid 0 ss_did 0
[    1.487781] ACPI: \_SB_.GSIF: Enabled at IRQ 21
[    1.492852] shpchp 0000:05:01.0: pci_hp_register failed with error -16
[    1.493262] shpchp 0000:05:01.0: Slot initialization failed
[    1.496038] shpchp 0000:05:02.0: HPC vendor_id 1b36 device_id 1 ss_vid 0 ss_did 0
[    1.496424] ACPI: \_SB_.GSIG: Enabled at IRQ 22
[    1.499222] shpchp 0000:05:02.0: pci_hp_register failed with error -16
[    1.499612] shpchp 0000:05:02.0: Slot initialization failed
[    1.503152] shpchp 0000:05:03.0: HPC vendor_id 1b36 device_id 1 ss_vid 0 ss_did 0
[    1.503539] ACPI: \_SB_.GSIH: Enabled at IRQ 23
[    1.506303] shpchp 0000:05:03.0: pci_hp_register failed with error -16
[    1.506690] shpchp 0000:05:03.0: Slot initialization failed
[    1.509332] shpchp 0000:05:04.0: HPC vendor_id 1b36 device_id 1 ss_vid 0 ss_did 0
[    1.509719] ACPI: \_SB_.GSIE: Enabled at IRQ 20
[    1.512819] shpchp 0000:05:04.0: pci_hp_register failed with error -16
[    1.514037] shpchp 0000:05:04.0: Slot initialization failed
[    1.515526] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    1.525663] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    1.526667] Linux agpgart interface v0.103
[    1.527455] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[    1.528395] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.528405] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.528568] mousedev: PS/2 mouse device common for all mice
[    1.528597] rtc_cmos 00:02: RTC can wake from S4
[    1.529282] rtc_cmos 00:02: registered as rtc0
[    1.529432] rtc_cmos 00:02: setting system clock to 2026-03-11T15:42:17 UTC (1773243737)
[    1.529552] rtc_cmos 00:02: alarms up to one day, y3k, 242 bytes nvram
[    1.529592] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled
[    1.530328] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[    1.530906] NET: Registered PF_INET6 protocol family
[    1.535240] Segment Routing with IPv6
[    1.535255] In-situ OAM (IOAM) with IPv6
[    1.535281] mip6: Mobile IPv6
[    1.535286] NET: Registered PF_PACKET protocol family
[    1.535359] mpls_gso: MPLS GSO support
[    1.535803] IPI shorthand broadcast: enabled
[    1.538665] sched_clock: Marking stable (1516007881, 21796549)->(1540671614, -2867184)
[    1.538843] registered taskstats version 1
[    1.538994] Loading compiled-in X.509 certificates
[    1.556227] Loaded X.509 cert 'Build time autogenerated kernel key: c3384ccfe51b608e872d4e99dfc78fb9e4c0d67d'
[    1.556934] Loaded X.509 cert 'Debian Secure Boot CA: 6ccece7e4c6c0d1f6149f3dd27dfcc5cbb419ea1'
[    1.557472] Loaded X.509 cert 'Debian Secure Boot Signer 2020: 00b55eb3b9'
[    1.560293] Demotion targets for Node 0: null
[    1.560400] Key type .fscrypt registered
[    1.560717] Key type fscrypt-provisioning registered
[    1.578743] Key type encrypted registered
[    1.579064] AppArmor: AppArmor sha256 policy hashing enabled
[    1.579075] ima: No TPM chip found, activating TPM-bypass!
[    1.579078] ima: Allocated hash algorithm: sha256
[    1.579090] ima: No architecture policies found
[    1.579110] evm: Initialising EVM extended attributes:
[    1.579112] evm: security.selinux
[    1.579114] evm: security.SMACK64 (disabled)
[    1.579116] evm: security.SMACK64EXEC (disabled)
[    1.579118] evm: security.SMACK64TRANSMUTE (disabled)
[    1.579119] evm: security.SMACK64MMAP (disabled)
[    1.579121] evm: security.apparmor
[    1.579123] evm: security.ima
[    1.579124] evm: security.capability
[    1.579126] evm: HMAC attrs: 0x1
[    1.584747] RAS: Correctable Errors collector initialized.
[    1.601288] clk: Disabling unused clocks
[    1.601292] PM: genpd: Disabling unused power domains
[    1.617772] Freeing unused decrypted memory: 2028K
[    1.618527] Freeing unused kernel image (initmem) memory: 4232K
[    1.618545] Write protecting the kernel read-only data: 28672k
[    1.619104] Freeing unused kernel image (rodata/data gap) memory: 696K
[    1.688659] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    1.688667] Run /init as init process
[    1.688669]   with arguments:
[    1.688671]     /init
[    1.688673]   with environment:
[    1.688675]     HOME=/
[    1.688676]     TERM=linux
[    1.688678]     BOOT_IMAGE=/ROOT/25.10.1@/boot/vmlinuz-6.12.33-production+truenas
[    1.688680]     zfsforce=1
[    1.880425] SCSI subsystem initialized
[    1.882344] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[    1.883082] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD
[    1.886042] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3
[    1.886446] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input2
[    1.894096] ACPI: bus type USB registered
[    1.894154] usbcore: registered new interface driver usbfs
[    1.894172] usbcore: registered new interface driver hub
[    1.894192] usbcore: registered new device driver usb
[    1.903540] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized
[    1.904686] virtio_scsi virtio2: 4/0/0 default/read/poll queues
[    1.905726] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    1.905735] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    1.905760] uhci_hcd 0000:00:1a.0: detected 2 ports
[    1.905873] uhci_hcd 0000:00:1a.0: irq 16, io port 0x00006040
[    1.906011] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.12
[    1.906016] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.906019] usb usb1: Product: UHCI Host Controller
[    1.906021] usb usb1: Manufacturer: Linux 6.12.33-production+truenas uhci_hcd
[    1.906024] usb usb1: SerialNumber: 0000:00:1a.0
[    1.906181] hub 1-0:1.0: USB hub found
[    1.906189] hub 1-0:1.0: 2 ports detected
[    1.907061] libata version 3.00 loaded.
[    1.908020] ehci-pci 0000:00:1d.7: EHCI Host Controller
[    1.908032] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2
[    1.908329] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfea1a000
[    1.912481] scsi host0: Virtio SCSI HBA
[    1.913773] virtio_net virtio1 enp6s18: renamed from eth0
[    1.914926] scsi 0:0:0:0: Direct-Access     QEMU     QEMU HARDDISK    2.5+ PQ: 0 ANSI: 5
[    1.919351] mpt3sas version 48.100.00.00 loaded
[    1.919888] virtio_scsi virtio3: 4/0/0 default/read/poll queues
[    1.921854] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[    1.921926] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.12
[    1.921931] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.921934] usb usb2: Product: EHCI Host Controller
[    1.921936] usb usb2: Manufacturer: Linux 6.12.33-production+truenas ehci_hcd
[    1.921939] usb usb2: SerialNumber: 0000:00:1d.7
[    1.922078] hub 2-0:1.0: USB hub found
[    1.922087] hub 2-0:1.0: 6 ports detected
[    1.922217] scsi host1: Virtio SCSI HBA
[    1.922451] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    1.922459] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 3
[    1.923502] uhci_hcd 0000:00:1a.1: detected 2 ports
[    1.923655] uhci_hcd 0000:00:1a.1: irq 17, io port 0x00006060
[    1.923771] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.12
[    1.923775] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.923778] usb usb3: Product: UHCI Host Controller
[    1.923780] usb usb3: Manufacturer: Linux 6.12.33-production+truenas uhci_hcd
[    1.923783] usb usb3: SerialNumber: 0000:00:1a.1
[    1.923885] scsi 1:0:0:1: Direct-Access     QEMU     QEMU HARDDISK    2.5+ PQ: 0 ANSI: 5
[    1.923994] hub 3-0:1.0: USB hub found
[    1.924493] hub 3-0:1.0: 2 ports detected
[    1.924917] mpt3sas_cm0: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (16383524 kB)
[    1.970099] ehci-pci 0000:00:1a.7: EHCI Host Controller
[    1.970109] ehci-pci 0000:00:1a.7: new USB bus registered, assigned bus number 4
[    1.970361] ehci-pci 0000:00:1a.7: irq 19, io mem 0xfea15000
[    1.981182] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[    1.981292] mpt3sas_cm0: MSI-X vectors supported: 16
[    1.981296]   no of cores: 4, max_msix_vectors: -1
[    1.981298] mpt3sas_cm0:  0 4 4
[    1.981844] ehci-pci 0000:00:1a.7: USB 2.0 started, EHCI 1.00
[    1.981911] usb usb4: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.12
[    1.981915] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.981918] usb usb4: Product: EHCI Host Controller
[    1.981921] usb usb4: Manufacturer: Linux 6.12.33-production+truenas ehci_hcd
[    1.981923] usb usb4: SerialNumber: 0000:00:1a.7
[    1.982093] hub 4-0:1.0: USB hub found
[    1.982101] hub 4-0:1.0: 6 ports detected
[    1.983222] mpt3sas_cm0: High IOPs queues : disabled
[    1.983226] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 45
[    1.983228] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 46
[    1.983230] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 47
[    1.983232] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 48
[    1.983234] mpt3sas_cm0: iomem(0x000000c0e0000000), mapped(0x000000009521d53d), size(1048576)
[    1.983238] mpt3sas_cm0: ioport(0x0000000000005000), size(256)
[    2.005922] hub 1-0:1.0: USB hub found
[    2.005934] hub 1-0:1.0: 2 ports detected
[    2.029918] hub 3-0:1.0: USB hub found
[    2.029927] hub 3-0:1.0: 2 ports detected
[    2.030032] uhci_hcd 0000:00:1a.2: UHCI Host Controller
[    2.030042] uhci_hcd 0000:00:1a.2: new USB bus registered, assigned bus number 5
[    2.030069] uhci_hcd 0000:00:1a.2: detected 2 ports
[    2.030258] uhci_hcd 0000:00:1a.2: irq 18, io port 0x00006080
[    2.030371] usb usb5: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.12
[    2.030376] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.030379] usb usb5: Product: UHCI Host Controller
[    2.030381] usb usb5: Manufacturer: Linux 6.12.33-production+truenas uhci_hcd
[    2.030383] usb usb5: SerialNumber: 0000:00:1a.2
[    2.031073] hub 5-0:1.0: USB hub found
[    2.031098] hub 5-0:1.0: 2 ports detected
[    2.032631] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    2.032639] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 6
[    2.032663] uhci_hcd 0000:00:1d.0: detected 2 ports
[    2.032766] uhci_hcd 0000:00:1d.0: irq 16, io port 0x000060a0
[    2.032926] usb usb6: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.12
[    2.032930] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.032933] usb usb6: Product: UHCI Host Controller
[    2.032935] usb usb6: Manufacturer: Linux 6.12.33-production+truenas uhci_hcd
[    2.032938] usb usb6: SerialNumber: 0000:00:1d.0
[    2.033328] hub 6-0:1.0: USB hub found
[    2.033336] hub 6-0:1.0: 2 ports detected
[    2.034327] sd 0:0:0:0: Power-on or device reset occurred
[    2.034787] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    2.035130] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 7
[    2.035170] uhci_hcd 0000:00:1d.1: detected 2 ports
[    2.035227] sd 0:0:0:0: [sda] 67108864 512-byte logical blocks: (34.4 GB/32.0 GiB)
[    2.035291] uhci_hcd 0000:00:1d.1: irq 17, io port 0x000060c0
[    2.035414] sd 1:0:0:1: Power-on or device reset occurred
[    2.035482] sd 1:0:0:1: [sdb] 67108864 512-byte logical blocks: (34.4 GB/32.0 GiB)
[    2.035512] sd 1:0:0:1: [sdb] Write Protect is off
[    2.035514] sd 1:0:0:1: [sdb] Mode Sense: 63 00 10 08
[    2.035562] sd 1:0:0:1: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    2.035797] sd 0:0:0:0: [sda] Write Protect is off
[    2.036247] usb usb7: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.12
[    2.036640] sd 0:0:0:0: [sda] Mode Sense: 63 00 10 08
[    2.036981] usb usb7: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.037580] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA
[    2.037885] usb usb7: Product: UHCI Host Controller
[    2.038426] usb usb7: Manufacturer: Linux 6.12.33-production+truenas uhci_hcd
[    2.038429] usb usb7: SerialNumber: 0000:00:1d.1
[    2.038654] hub 7-0:1.0: USB hub found
[    2.038664] hub 7-0:1.0: 2 ports detected
[    2.040351] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    2.040359] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 8
[    2.040384] uhci_hcd 0000:00:1d.2: detected 2 ports
[    2.040491] uhci_hcd 0000:00:1d.2: irq 18, io port 0x000060e0
[    2.040613] usb usb8: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.12
[    2.040618] usb usb8: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.040621] usb usb8: Product: UHCI Host Controller
[    2.040623] usb usb8: Manufacturer: Linux 6.12.33-production+truenas uhci_hcd
[    2.040626] usb usb8: SerialNumber: 0000:00:1d.2
[    2.040768] hub 8-0:1.0: USB hub found
[    2.040776] hub 8-0:1.0: 2 ports detected
[    2.041824] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[    2.059493]  sda: sda1 sda2 sda3
[    2.059684] sd 0:0:0:0: [sda] Attached SCSI disk
[    2.059857]  sdb: sdb1 sdb2 sdb3
[    2.060285] sd 1:0:0:1: [sdb] Attached SCSI disk
[    2.064610] ahci 0000:00:1f.2: version 3.0
[    2.067320] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode
[    2.067326] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f)
[    2.067329] ahci 0000:00:1f.2: flags: 64bit ncq only
[    2.070515] mpt3sas_cm0: scatter gather: sge_in_main_msg(1), sge_per_chain(7), sge_per_io(128), chains_per_io(19)
[    2.071174] scsi host3: ahci
[    2.071882] scsi host4: ahci
[    2.072232] mpt3sas_cm0: request pool(0x000000007cb76b6a) - dma(0x100400000): depth(6756), frame_size(128), pool_size(844 kB)
[    2.073590] scsi host5: ahci
[    2.076507] scsi host6: ahci
[    2.076729] scsi host7: ahci
[    2.081729] mpt3sas_cm0: sense pool(0x00000000fb114d60) - dma(0x100500000): depth(6551), element_size(96), pool_size (614 kB)
[    2.082059] scsi host8: ahci
[    2.082148] ata1: SATA max UDMA/133 abar m4096@0xfea1b000 port 0xfea1b100 irq 49 lpm-pol 0
[    2.082162] ata2: SATA max UDMA/133 abar m4096@0xfea1b000 port 0xfea1b180 irq 49 lpm-pol 0
[    2.082174] ata3: SATA max UDMA/133 abar m4096@0xfea1b000 port 0xfea1b200 irq 49 lpm-pol 0
[    2.082186] ata4: SATA max UDMA/133 abar m4096@0xfea1b000 port 0xfea1b280 irq 49 lpm-pol 0
[    2.082198] ata5: SATA max UDMA/133 abar m4096@0xfea1b000 port 0xfea1b300 irq 49 lpm-pol 0
[    2.082210] ata6: SATA max UDMA/133 abar m4096@0xfea1b000 port 0xfea1b380 irq 49 lpm-pol 0
[    2.082970] mpt3sas_cm0: reply pool(0x000000008ef88a1d) - dma(0x100600000): depth(6820), frame_size(128), pool_size(852 kB)
[    2.083379] mpt3sas_cm0: config page(0x0000000029503471) - dma(0x133a09000): size(512)
[    2.083384] mpt3sas_cm0: Allocated physical memory: size(28966 kB)
[    2.083386] mpt3sas_cm0: Current Controller Queue Depth(6548),Max Controller Queue Depth(6656)
[    2.083388] mpt3sas_cm0: Scatter Gather Elements per IO(128)
[    2.177885] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    2.215661] mpt3sas_cm0: _base_display_fwpkg_version: complete
[    2.215665] mpt3sas_cm0: FW Package Ver(24.00.00.00)
[    2.215827] mpt3sas_cm0: TimeSync Interval in Manuf page-11 is not enabled. Periodic Time-Sync will be disabled
[    2.217032] mpt3sas_cm0: SAS3416: FWVersion(24.00.00.00), ChipRevision(0x01)
[    2.217037] NVMe
[    2.217038] mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ)
[    2.217233] mpt3sas 0000:01:00.0: Max SCSIIO MPT commands: 6548 shared with nr_hw_queues = 4
[    2.217238] scsi host2: Fusion MPT SAS Host
[    2.218439] mpt3sas_cm0: sending port enable !!
[    2.325726] usb 2-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00
[    2.325732] usb 2-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10
[    2.325735] usb 2-1: Product: QEMU USB Tablet
[    2.325737] usb 2-1: Manufacturer: QEMU
[    2.325740] usb 2-1: SerialNumber: 28754-0000:00:1d.7-1
[    2.335281] hid: raw HID events driver (C) Jiri Kosina
[    2.393135] ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    2.393504] ata3: SATA link down (SStatus 0 SControl 300)
[    2.393619] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100
[    2.393626] ata2.00: applying bridge limits
[    2.394014] ata4: SATA link down (SStatus 0 SControl 300)
[    2.394300] ata5: SATA link down (SStatus 0 SControl 300)
[    2.394542] ata1: SATA link down (SStatus 0 SControl 300)
[    2.394608] ata2.00: configured for UDMA/100
[    2.423187] ata6: SATA link down (SStatus 0 SControl 300)
[    2.423594] scsi: waiting for bus probes to complete ...
[    4.231212] mpt3sas_cm0: hba_port entry: 00000000873fb813, port: 0 is added to hba_port list
[    4.233668] mpt3sas_cm0: hba_port entry: 00000000fe09ed3d, port: 8 is added to hba_port list
[    4.236301] mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b00f3212d0), phys(21)
[    4.239263] mpt3sas_cm0: expander_add: handle(0x0017), parent(0x0001), sas_addr(0x3474f4f58496a31f), phys(25)
[    4.239534]  expander-2:0: add: handle(0x0017), sas_addr(0x3474f4f58496a31f)
[    4.245510] mpt3sas_cm0: handle(0x21) sas_address(0x3474f4f58496a31e) port_type(0x1)
[    4.246272] mpt3sas_cm0: expander_add: handle(0x0018), parent(0x0009), sas_addr(0x3474f4f584a11c3f), phys(37)
[    4.246508]  expander-2:1: add: handle(0x0018), sas_addr(0x3474f4f584a11c3f)
[    4.253966] mpt3sas_cm0: handle(0x19) sas_address(0x3474f4f584a11c08) port_type(0x1)
[    4.254161] mpt3sas_cm0: handle(0x1a) sas_address(0x3474f4f584a11c09) port_type(0x1)
[    4.254347] mpt3sas_cm0: handle(0x1b) sas_address(0x3474f4f584a11c0a) port_type(0x1)
[    4.254533] mpt3sas_cm0: handle(0x1c) sas_address(0x3474f4f584a11c0b) port_type(0x1)
[    4.254718] mpt3sas_cm0: handle(0x1d) sas_address(0x3474f4f584a11c0c) port_type(0x1)
[    4.254904] mpt3sas_cm0: handle(0x1e) sas_address(0x3474f4f584a11c0d) port_type(0x1)
[    4.255095] mpt3sas_cm0: handle(0x1f) sas_address(0x3474f4f584a11c0e) port_type(0x1)
[    4.255280] mpt3sas_cm0: handle(0x20) sas_address(0x3474f4f584a11c0f) port_type(0x1)
[    4.256510] mpt3sas_cm0: handle(0x22) sas_address(0x3474f4f584a11c3e) port_type(0x1)
[    9.989880] mpt3sas_cm0: port enable: SUCCESS
[   10.189615] scsi 2:0:0:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   10.190232] scsi 2:0:0:0: SATA: handle(0x0019), sas_addr(0x3474f4f584a11c08), phy(8), device_name(0x0000000000000000)
[   10.190236] scsi 2:0:0:0: enclosure logical id (0x3474f4f584a11c3e), slot(8)
[   10.190239] scsi 2:0:0:0: enclosure level(0x0000), connector name( C1  )
[   10.190347] scsi 2:0:0:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   10.190351] scsi 2:0:0:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   10.203959]  end_device-2:1:0: add: handle(0x0019), sas_addr(0x3474f4f584a11c08)
[   10.204872] scsi 2:0:1:0: Enclosure         GOOXIBM  2U12SXP 24Sx12G  B134 PQ: 0 ANSI: 6
[   10.205399] scsi 2:0:1:0: set ignore_delay_remove for handle(0x0021)
[   10.205786] scsi 2:0:1:0: SES: handle(0x0021), sas_addr(0x3474f4f58496a31e), phy(24), device_name(0x0000000000000000)
[   10.205790] scsi 2:0:1:0: enclosure logical id (0x3474f4f58496a300), slot(39)
[   10.205792] scsi 2:0:1:0: enclosure level(0x0000), connector name( C3  )
[   10.205795] scsi 2:0:1:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1)
[   10.209458]  end_device-2:0:0: add: handle(0x0021), sas_addr(0x3474f4f58496a31e)
[   10.357568] scsi 2:0:2:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   10.358184] scsi 2:0:2:0: SATA: handle(0x001a), sas_addr(0x3474f4f584a11c09), phy(9), device_name(0x0000000000000000)
[   10.358188] scsi 2:0:2:0: enclosure logical id (0x3474f4f584a11c3e), slot(9)
[   10.358190] scsi 2:0:2:0: enclosure level(0x0000), connector name( C1  )
[   10.358298] scsi 2:0:2:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   10.358302] scsi 2:0:2:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   10.371959]  end_device-2:1:1: add: handle(0x001a), sas_addr(0x3474f4f584a11c09)
[   10.709092] scsi 2:0:3:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   10.709944] scsi 2:0:3:0: SATA: handle(0x001b), sas_addr(0x3474f4f584a11c0a), phy(10), device_name(0x0000000000000000)
[   10.709948] scsi 2:0:3:0: enclosure logical id (0x3474f4f584a11c3e), slot(10)
[   10.709951] scsi 2:0:3:0: enclosure level(0x0000), connector name( C1  )
[   10.710057] scsi 2:0:3:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   10.710061] scsi 2:0:3:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   10.723621]  end_device-2:1:2: add: handle(0x001b), sas_addr(0x3474f4f584a11c0a)
[   10.819794] scsi 2:0:4:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   10.820313] scsi 2:0:4:0: SATA: handle(0x001c), sas_addr(0x3474f4f584a11c0b), phy(11), device_name(0x0000000000000000)
[   10.820317] scsi 2:0:4:0: enclosure logical id (0x3474f4f584a11c3e), slot(11)
[   10.820319] scsi 2:0:4:0: enclosure level(0x0000), connector name( C1  )
[   10.820425] scsi 2:0:4:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   10.820429] scsi 2:0:4:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   10.834092]  end_device-2:1:3: add: handle(0x001c), sas_addr(0x3474f4f584a11c0b)
[   11.084670] scsi 2:0:5:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   11.085223] scsi 2:0:5:0: SATA: handle(0x001d), sas_addr(0x3474f4f584a11c0c), phy(12), device_name(0x0000000000000000)
[   11.085227] scsi 2:0:5:0: enclosure logical id (0x3474f4f584a11c3e), slot(12)
[   11.085229] scsi 2:0:5:0: enclosure level(0x0000), connector name( C1  )
[   11.085307] scsi 2:0:5:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   11.085310] scsi 2:0:5:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   11.098955]  end_device-2:1:4: add: handle(0x001d), sas_addr(0x3474f4f584a11c0c)
[   11.204871] scsi 2:0:6:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   11.205391] scsi 2:0:6:0: SATA: handle(0x001e), sas_addr(0x3474f4f584a11c0d), phy(13), device_name(0x0000000000000000)
[   11.205395] scsi 2:0:6:0: enclosure logical id (0x3474f4f584a11c3e), slot(13)
[   11.205397] scsi 2:0:6:0: enclosure level(0x0000), connector name( C1  )
[   11.205503] scsi 2:0:6:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   11.205507] scsi 2:0:6:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   11.219235]  end_device-2:1:5: add: handle(0x001e), sas_addr(0x3474f4f584a11c0d)
[   11.333369] scsi 2:0:7:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   11.334097] scsi 2:0:7:0: SATA: handle(0x001f), sas_addr(0x3474f4f584a11c0e), phy(14), device_name(0x0000000000000000)
[   11.334101] scsi 2:0:7:0: enclosure logical id (0x3474f4f584a11c3e), slot(14)
[   11.334104] scsi 2:0:7:0: enclosure level(0x0000), connector name( C1  )
[   11.334263] scsi 2:0:7:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   11.334273] scsi 2:0:7:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   11.347589]  end_device-2:1:6: add: handle(0x001f), sas_addr(0x3474f4f584a11c0e)
[   11.461464] scsi 2:0:8:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
[   11.462162] scsi 2:0:8:0: SATA: handle(0x0020), sas_addr(0x3474f4f584a11c0f), phy(15), device_name(0x0000000000000000)
[   11.462166] scsi 2:0:8:0: enclosure logical id (0x3474f4f584a11c3e), slot(15)
[   11.462169] scsi 2:0:8:0: enclosure level(0x0000), connector name( C1  )
[   11.462247] scsi 2:0:8:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[   11.462250] scsi 2:0:8:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[   11.475475]  end_device-2:1:7: add: handle(0x0020), sas_addr(0x3474f4f584a11c0f)
[   11.476366] scsi 2:0:9:0: Enclosure         GOOXIBM  4U24SXP 36Sx12G  B134 PQ: 0 ANSI: 6
[   11.476897] scsi 2:0:9:0: set ignore_delay_remove for handle(0x0022)
[   11.477277] scsi 2:0:9:0: SES: handle(0x0022), sas_addr(0x3474f4f584a11c3e), phy(36), device_name(0x0000000000000000)
[   11.477281] scsi 2:0:9:0: enclosure logical id (0x3474f4f584a11c3e), slot(24)
[   11.477283] scsi 2:0:9:0: enclosure level(0x0000), connector name( C1  )
[   11.477287] scsi 2:0:9:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1)
[   11.481046]  end_device-2:1:8: add: handle(0x0022), sas_addr(0x3474f4f584a11c3e)
[   11.481504] sd 2:0:0:0: Power-on or device reset occurred
[   11.482390] sd 2:0:2:0: Power-on or device reset occurred
[   11.482976] sd 2:0:0:0: [sdc] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   11.483019] sd 2:0:3:0: Power-on or device reset occurred
[   11.483491] sd 2:0:0:0: [sdc] 4096-byte physical blocks
[   11.483721] sd 2:0:2:0: [sdd] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   11.483725] sd 2:0:2:0: [sdd] 4096-byte physical blocks
[   11.484193] sd 2:0:4:0: Power-on or device reset occurred
[   11.485913] sd 2:0:5:0: Power-on or device reset occurred
[   11.485952] scsi 4:0:0:0: CD-ROM            QEMU     QEMU DVD-ROM     2.5+ PQ: 0 ANSI: 5
[   11.486318] sd 2:0:3:0: [sde] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   11.486529] sd 2:0:4:0: [sdf] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   11.486534] sd 2:0:4:0: [sdf] 4096-byte physical blocks
[   11.486831] sd 2:0:0:0: [sdc] Write Protect is off
[   11.487355] sd 2:0:2:0: [sdd] Write Protect is off
[   11.487360] sd 2:0:2:0: [sdd] Mode Sense: 6b 00 10 08
[   11.487377] sd 2:0:3:0: [sde] 4096-byte physical blocks
[   11.487405] sd 2:0:5:0: [sdg] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   11.488013] sd 2:0:0:0: [sdc] Mode Sense: 6b 00 10 08
[   11.488296] sd 2:0:6:0: Power-on or device reset occurred
[   11.488374] sd 2:0:5:0: [sdg] 4096-byte physical blocks
[   11.488638] sd 2:0:3:0: [sde] Write Protect is off
[   11.488642] sd 2:0:3:0: [sde] Mode Sense: 6b 00 10 08
[   11.488814] sd 2:0:2:0: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   11.488828] sd 2:0:8:0: Power-on or device reset occurred
[   11.489073] sd 2:0:7:0: Power-on or device reset occurred
[   11.489280] sd 2:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   11.490004] sd 2:0:7:0: [sdi] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   11.490122] sd 2:0:6:0: [sdh] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   11.490125] sd 2:0:4:0: [sdf] Write Protect is off
[   11.490129] sd 2:0:4:0: [sdf] Mode Sense: 6b 00 10 08
[   11.490132] sd 2:0:3:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   11.490440] sd 2:0:7:0: [sdi] 4096-byte physical blocks
[   11.490694] sd 2:0:5:0: [sdg] Write Protect is off
[   11.490697] sd 2:0:5:0: [sdg] Mode Sense: 6b 00 10 08
[   11.490819] sd 2:0:6:0: [sdh] 4096-byte physical blocks
[   11.491513] sd 2:0:4:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   11.491946] sd 2:0:5:0: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   11.493165] sd 2:0:6:0: [sdh] Write Protect is off
[   11.493500] sd 2:0:7:0: [sdi] Write Protect is off
[   11.493503] sd 2:0:7:0: [sdi] Mode Sense: 6b 00 10 08
[   11.494658] sd 2:0:7:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   11.494958] sd 2:0:6:0: [sdh] Mode Sense: 6b 00 10 08
[   11.499506] sd 2:0:6:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   11.512725] sd 2:0:8:0: [sdj] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
[   11.513241] sd 2:0:8:0: [sdj] 4096-byte physical blocks
[   11.514794] sd 2:0:8:0: [sdj] Write Protect is off
[   11.515141] sd 2:0:8:0: [sdj] Mode Sense: 6b 00 10 08
[   11.516296] sd 2:0:8:0: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
[   11.561305]  sdg: sdg1
[   11.561473]  sdd: sdd1
[   11.561523] sd 2:0:5:0: [sdg] Attached SCSI disk
[   11.561617] sd 2:0:2:0: [sdd] Attached SCSI disk
[   11.565912]  sdf: sdf1
[   11.566026] sd 2:0:4:0: [sdf] Attached SCSI disk
[   11.566169]  sdc: sdc1
[   11.566461] sd 2:0:0:0: [sdc] Attached SCSI disk
[   11.568128]  sde: sde1
[   11.568269] sd 2:0:3:0: [sde] Attached SCSI disk
[   11.568817]  sdi: sdi1
[   11.568929] sd 2:0:7:0: [sdi] Attached SCSI disk
[   11.574311]  sdh: sdh1
[   11.574417] sd 2:0:6:0: [sdh] Attached SCSI disk
[   11.593460]  sdj: sdj1
[   11.593643] sd 2:0:8:0: [sdj] Attached SCSI disk
[   11.598869] usbcore: registered new interface driver usbhid
[   11.598873] usbhid: USB HID core driver
[   11.602241] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb2/2-1/2-1:1.0/0003:0627:0001.0001/input/input4
[   11.603389] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0
[   11.627358] ses 2:0:1:0: Attached Enclosure device
[   11.627765] ses 2:0:9:0: Attached Enclosure device
[   11.646168] sr 4:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[   11.646173] cdrom: Uniform CD-ROM driver Revision: 3.20
[   11.690288] sr 4:0:0:0: Attached scsi CD-ROM sr0
[   12.056340] spl: loading out-of-tree module taints kernel.
[   12.056749] spl: module verification failed: signature and/or required key missing - tainting kernel
[   12.079045] zfs: module license 'CDDL' taints kernel.
[   12.079438] Disabling lock debugging due to kernel taint
[   12.079828] zfs: module license taints kernel.
[   13.283270] ZFS: Loaded module v2.3.4-1, ZFS pool version 5000, ZFS filesystem version 5
[   29.823494] Not activating Mandatory Access Control as /sbin/tomoyo-init does not exist.
[   29.931238] systemd[1]: Inserted module 'autofs4'
[   29.964319] systemd[1]: systemd 254.26-1~bpo12+1 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[   29.964335] systemd[1]: Detected virtualization kvm.
[   29.964365] systemd[1]: Detected architecture x86-64.
[   29.967155] systemd[1]: Hostname set to <vault>.
[   30.225191] systemd[1]: Queued start job for default target truenas.target.
[   30.248006] systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe.
[   30.249054] systemd[1]: Created slice user.slice - User and Session Slice.
[   30.249699] systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch.
[   30.250423] systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch.
[   30.251283] systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point.
[   30.251923] systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes.
[   30.252535] systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes.
[   30.253187] systemd[1]: Reached target nss-lookup.target - Host and Network Name Lookups.
[   30.253824] systemd[1]: Reached target paths.target - Path Units.
[   30.254420] systemd[1]: Reached target slices.target - Slice Units.
[   30.255011] systemd[1]: Reached target swap.target - Swaps.
[   30.255567] systemd[1]: Reached target time-set.target - System Time Set.
[   30.256184] systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes.
[   30.256808] systemd[1]: Reached target zfs-import.target - ZFS pool import target.
[   30.258404] systemd[1]: Listening on dbus.socket - D-Bus System Message Bus Socket.
[   30.264447] systemd[1]: Listening on rpcbind.socket - RPCbind Server Activation Socket.
[   30.266638] systemd[1]: Listening on systemd-coredump.socket - Process Core Dump Socket.
[   30.267319] systemd[1]: Listening on systemd-initctl.socket - initctl Compatibility Named Pipe.
[   30.268820] systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log).
[   30.269589] systemd[1]: Listening on systemd-journald.socket - Journal Socket.
[   30.271409] systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket.
[   30.272148] systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket.
[   30.273986] systemd[1]: Mounting dev-hugepages.mount - Huge Pages File System...
[   30.275678] systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System...
[   30.277535] systemd[1]: Mounting proc-fs-nfsd.mount - NFSD configuration filesystem...
[   30.279463] systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System...
[   30.281481] systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System...
[   30.283442] systemd[1]: Mounting tmp.mount - Temporary Directory (/tmp)...
[   30.284195] systemd[1]: auth-rpcgss-module.service - Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab).
[   30.285535] systemd[1]: Starting dbus.service - D-Bus System Message Bus...
[   30.286353] systemd[1]: ix-boot-core.service - Reboot to TrueNAS core was skipped because of an unmet condition check (ConditionEnvironment=_BOOT_TRUENAS_CORE=1).
[   30.287784] systemd[1]: Starting ix-wait-on-disks.service - Wait on Disk Enumeration...
[   30.290436] systemd[1]: Starting keyboard-setup.service - Set the console keyboard layout...
[   30.292851] systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes...
[   30.295195] systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs...
[   30.298198] systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod...
[   30.300038] systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm...
[   30.301836] systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore...
[   30.303953] systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse...
[   30.309565] systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop...
[   30.312461] systemd[1]: Starting systemd-journald.service - Journal Service...
[   30.313109] systemd[1]: systemd-pcrmachine.service - TPM2 PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/StubPcrKernelImage-4a67b082-0a4c-41cf-b6c7-440b29bb8c4f).
[   30.316120] systemd[1]: Starting systemd-remount-fs.service - Remount Root and Kernel File Systems...
[   30.318589] systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices...
[   30.323478] systemd[1]: Starting zfs-volume-wait.service - Wait for ZFS Volume (zvol) links in /dev...
[   30.329600] systemd[1]: Mounted dev-hugepages.mount - Huge Pages File System.
[   30.332143] systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System.
[   30.332870] systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System.
[   30.333583] systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System.
[   30.334387] systemd[1]: Mounted tmp.mount - Temporary Directory (/tmp).
[   30.335339] systemd[1]: Finished keyboard-setup.service - Set the console keyboard layout.
[   30.336650] systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes.
[   30.338067] systemd[1]: modprobe@configfs.service: Deactivated successfully.
[   30.338255] systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs.
[   30.339295] systemd-journald[701]: Collecting audit messages is disabled.
[   30.339692] systemd[1]: modprobe@dm_mod.service: Deactivated successfully.
[   30.340420] systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod.
[   30.341346] systemd[1]: modprobe@fuse.service: Deactivated successfully.
[   30.341506] systemd[1]: Finished modprobe@fuse.service - Load Kernel Module fuse.
[   30.343581] systemd[1]: Mounting sys-fs-fuse-connections.mount - FUSE Control File System...
[   30.350012] systemd[1]: Mounting sys-kernel-config.mount - Kernel Configuration File System...
[   30.352554] systemd[1]: Starting systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully...
[   30.354964] systemd[1]: Started dbus.service - D-Bus System Message Bus.
[   30.361134] systemd[1]: Mounted sys-fs-fuse-connections.mount - FUSE Control File System.
[   30.362778] systemd[1]: Mounted sys-kernel-config.mount - Kernel Configuration File System.
[   30.366973] systemd[1]: modprobe@efi_pstore.service: Deactivated successfully.
[   30.367357] systemd[1]: Finished modprobe@efi_pstore.service - Load Kernel Module efi_pstore.
[   30.389187] systemd[1]: Finished systemd-remount-fs.service - Remount Root and Kernel File Systems.
[   30.392100] systemd[1]: systemd-hwdb-update.service - Rebuild Hardware Database was skipped because of an unmet condition check (ConditionNeedsUpdate=/etc).
[   30.392156] systemd[1]: systemd-pstore.service - Platform Persistent Storage Archival was skipped because of an unmet condition check (ConditionDirectoryNotEmpty=/sys/fs/pstore).
[   30.392527] loop: module loaded
[   30.393422] ACPI: bus type drm_connector registered
[   30.397960] systemd[1]: Starting systemd-random-seed.service - Load/Save OS Random Seed...
[   30.399042] systemd[1]: modprobe@drm.service: Deactivated successfully.
[   30.399232] systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm.
[   30.400144] systemd[1]: modprobe@loop.service: Deactivated successfully.
[   30.400310] systemd[1]: Finished modprobe@loop.service - Load Kernel Module loop.
[   30.401139] systemd[1]: systemd-repart.service - Repartition Root Disk was skipped because no trigger condition checks were met.
[   30.401959] RPC: Registered named UNIX socket transport module.
[   30.401963] RPC: Registered udp transport module.
[   30.401965] RPC: Registered tcp transport module.
[   30.401967] RPC: Registered tcp-with-tls transport module.
[   30.401969] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   30.410253] systemd[1]: Finished zfs-volume-wait.service - Wait for ZFS Volume (zvol) links in /dev.
[   30.410963] systemd[1]: Reached target zfs-volumes.target - ZFS volumes are ready.
[   30.445169] systemd[1]: Finished systemd-tmpfiles-setup-dev-early.service - Create Static Device Nodes in /dev gracefully.
[   30.447716] systemd[1]: Finished systemd-random-seed.service - Load/Save OS Random Seed.
[   30.448548] systemd[1]: systemd-sysusers.service - Create System Users was skipped because no trigger condition checks were met.
[   30.466105] systemd[1]: Starting systemd-tmpfiles-setup-dev.service - Create Static Device Nodes in /dev...
[   30.471885] systemd[1]: Started systemd-journald.service - Journal Service.
[   30.534082] systemd-journald[701]: Received client request to flush runtime journal.
[   30.550189] systemd-journald[701]: /var/log/journal/44e4f537dae94ab69e91a2cb7a24c054/system.journal: Journal file uses a different sequence number ID, rotating.
[   30.550197] systemd-journald[701]: Rotating system journal.
[   30.713468] sd 0:0:0:0: Attached scsi generic sg0 type 0
[   30.715230] sd 1:0:0:1: Attached scsi generic sg1 type 0
[   30.719243] sd 2:0:0:0: Attached scsi generic sg2 type 0
[   30.719971] ses 2:0:1:0: Attached scsi generic sg3 type 13
[   30.720681] sd 2:0:2:0: Attached scsi generic sg4 type 0
[   30.721435] sd 2:0:3:0: Attached scsi generic sg5 type 0
[   30.722452] sd 2:0:4:0: Attached scsi generic sg6 type 0
[   30.723794] sd 2:0:5:0: Attached scsi generic sg7 type 0
[   30.724504] sd 2:0:6:0: Attached scsi generic sg8 type 0
[   30.725888] sd 2:0:7:0: Attached scsi generic sg9 type 0
[   30.726317] sd 2:0:8:0: Attached scsi generic sg10 type 0
[   30.764488] ses 2:0:9:0: Attached scsi generic sg11 type 13
[   30.766540] sr 4:0:0:0: Attached scsi generic sg12 type 5
[   30.800862] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input5
[   30.868662] ACPI: button: Power Button [PWRF]
[   30.960658] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console
[   30.963284] Free page reporting enabled
[   30.965818] Console: switching to colour dummy device 80x25
[   30.966041] [drm] Found bochs VGA, ID 0xb0c5.
[   30.966045] [drm] Framebuffer size 16384 kB @ 0xfc000000, mmio @ 0xfea14000.
[   30.970167] input: PC Speaker as /devices/platform/pcspkr/input/input6
[   30.972065] iTCO_vendor_support: vendor-support=0
[   30.974580] [drm] Found EDID data blob.
[   30.974768] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0
[   30.976414] fbcon: bochs-drmdrmfb (fb0) is primary device
[   30.995344] snd_hda_intel 0000:00:1b.0: no codecs found!
[   31.023515] cryptd: max_cpu_qlen set to 1000
[   31.033151] Console: switching to colour frame buffer device 160x50
[   31.035292] Error: Driver 'pcspkr' is already registered, aborting...
[   31.036198] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device
[   31.037990] AES CTR mode by8 optimization enabled
[   31.130967] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)
[   31.131214] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)
[  115.831452] dca service started, version 1.12.1
[  115.835011] ioatdma: Intel(R) QuickData Technology Driver 5.00
[  115.839631] NTB Resource Split driver, version 1
[  115.842244] Software Queue-Pair Transport over NTB, version 4
[  118.827230] audit: type=1400 audit(1773243854.796:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=2517 comm="apparmor_parser"
[  118.829068] audit: type=1400 audit(1773243854.796:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=2519 comm="apparmor_parser"
[  118.829997] audit: type=1400 audit(1773243854.796:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=2519 comm="apparmor_parser"
[  118.836554] audit: type=1400 audit(1773243854.804:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default" pid=2518 comm="apparmor_parser"
[  118.837881] audit: type=1400 audit(1773243854.804:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-cgns" pid=2518 comm="apparmor_parser"
[  118.838938] audit: type=1400 audit(1773243854.804:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-with-mounting" pid=2518 comm="apparmor_parser"
[  118.840014] audit: type=1400 audit(1773243854.804:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxc-container-default-with-nesting" pid=2518 comm="apparmor_parser"
[  118.841166] audit: type=1400 audit(1773243854.808:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/lxc-start" pid=2524 comm="apparmor_parser"
[  118.854055] audit: type=1400 audit(1773243854.824:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=2520 comm="apparmor_parser"
[  118.855421] audit: type=1400 audit(1773243854.824:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-helper" pid=2520 comm="apparmor_parser"
[  125.488057] NFSD: Using nfsdcld client tracking operations.
[  125.488063] NFSD: no clients to reclaim, skipping NFSv4 grace period (net f0000000)
[  157.463727] sd 2:0:4:0: attempting task abort!scmd(0x000000005b082dad), outstanding for 30976 ms & timeout 30000 ms
[  157.463744] sd 2:0:4:0: [sdf] tag#963 CDB: Write(16) 8a 00 00 00 00 06 a6 c0 2b 18 00 00 00 10 00 00
[  157.463750] scsi target2:0:4: handle(0x001c), sas_address(0x3474f4f584a11c0b), phy(11)
[  157.463759] scsi target2:0:4: enclosure logical id(0x3474f4f584a11c3e), slot(11)
[  157.463765] scsi target2:0:4: enclosure level(0x0000), connector name( C1  )
[  157.722211] sd 2:0:4:0: task abort: SUCCESS scmd(0x000000005b082dad)
[  157.722254] sd 2:0:4:0: attempting task abort!scmd(0x00000000ea1ee723), outstanding for 31248 ms & timeout 30000 ms
[  157.722261] sd 2:0:4:0: [sdf] tag#962 CDB: Write(16) 8a 00 00 00 00 06 a6 c0 2b 00 00 00 00 10 00 00
[  157.722266] scsi target2:0:4: handle(0x001c), sas_address(0x3474f4f584a11c0b), phy(11)
[  157.722272] scsi target2:0:4: enclosure logical id(0x3474f4f584a11c3e), slot(11)
[  157.722278] scsi target2:0:4: enclosure level(0x0000), connector name( C1  )
[  157.722283] sd 2:0:4:0: No reference found at driver, assuming scmd(0x00000000ea1ee723) might have completed
[  157.722288] sd 2:0:4:0: task abort: SUCCESS scmd(0x00000000ea1ee723)
[  158.301723] sd 2:0:4:0: Power-on or device reset occurred
[  192.286060] sd 2:0:0:0: attempting task abort!scmd(0x00000000fb6bab3d), outstanding for 31908 ms & timeout 30000 ms
[  192.286072] sd 2:0:0:0: [sdc] tag#1018 CDB: Read(16) 88 00 00 00 00 02 78 40 44 60 00 00 00 08 00 00
[  192.286076] scsi target2:0:0: handle(0x0019), sas_address(0x3474f4f584a11c08), phy(8)
[  192.286081] scsi target2:0:0: enclosure logical id(0x3474f4f584a11c3e), slot(8)
[  192.286085] scsi target2:0:0: enclosure level(0x0000), connector name( C1  )
[  192.720190] sd 2:0:0:0: task abort: SUCCESS scmd(0x00000000fb6bab3d)
[  192.720202] sd 2:0:0:0: attempting task abort!scmd(0x00000000aff574bd), outstanding for 32332 ms & timeout 30000 ms
[  192.720206] sd 2:0:0:0: [sdc] tag#1017 CDB: Read(16) 88 00 00 00 00 05 55 b2 9c d8 00 00 00 08 00 00
[  192.720208] scsi target2:0:0: handle(0x0019), sas_address(0x3474f4f584a11c08), phy(8)
[  192.720212] scsi target2:0:0: enclosure logical id(0x3474f4f584a11c3e), slot(8)
[  192.720215] scsi target2:0:0: enclosure level(0x0000), connector name( C1  )
[  192.720218] sd 2:0:0:0: No reference found at driver, assuming scmd(0x00000000aff574bd) might have completed
[  192.720220] sd 2:0:0:0: task abort: SUCCESS scmd(0x00000000aff574bd)
[  192.720225] sd 2:0:0:0: attempting task abort!scmd(0x0000000026df23c6), outstanding for 32332 ms & timeout 30000 ms
[  192.720228] sd 2:0:0:0: [sdc] tag#1016 CDB: Read(16) 88 00 00 00 00 02 78 40 56 78 00 00 00 08 00 00
[  192.720230] scsi target2:0:0: handle(0x0019), sas_address(0x3474f4f584a11c08), phy(8)
[  192.720233] scsi target2:0:0: enclosure logical id(0x3474f4f584a11c3e), slot(8)
[  192.720235] scsi target2:0:0: enclosure level(0x0000), connector name( C1  )
[  192.720238] sd 2:0:0:0: No reference found at driver, assuming scmd(0x0000000026df23c6) might have completed
[  192.720241] sd 2:0:0:0: task abort: SUCCESS scmd(0x0000000026df23c6)
[  192.720245] sd 2:0:0:0: attempting task abort!scmd(0x00000000d0c84583), outstanding for 32332 ms & timeout 30000 ms
[  192.720247] sd 2:0:0:0: [sdc] tag#1015 CDB: Read(16) 88 00 00 00 00 02 78 40 52 48 00 00 00 08 00 00
[  192.720249] scsi target2:0:0: handle(0x0019), sas_address(0x3474f4f584a11c08), phy(8)
[  192.720252] scsi target2:0:0: enclosure logical id(0x3474f4f584a11c3e), slot(8)
[  192.720254] scsi target2:0:0: enclosure level(0x0000), connector name( C1  )
[  192.720257] sd 2:0:0:0: No reference found at driver, assuming scmd(0x00000000d0c84583) might have completed
[  192.720260] sd 2:0:0:0: task abort: SUCCESS scmd(0x00000000d0c84583)
[  193.059043] sd 2:0:0:0: Power-on or device reset occurred
[  225.052567] sd 2:0:2:0: attempting task abort!scmd(0x00000000688d5320), outstanding for 30588 ms & timeout 30000 ms
[  225.052578] sd 2:0:2:0: [sdd] tag#980 CDB: Read(16) 88 00 00 00 00 06 b3 4c 30 e0 00 00 00 08 00 00
[  225.052584] scsi target2:0:2: handle(0x001a), sas_address(0x3474f4f584a11c09), phy(9)
[  225.052591] scsi target2:0:2: enclosure logical id(0x3474f4f584a11c3e), slot(9)
[  225.052596] scsi target2:0:2: enclosure level(0x0000), connector name( C1  )
[  225.468263] sd 2:0:2:0: task abort: SUCCESS scmd(0x00000000688d5320)
[  225.468281] sd 2:0:2:0: attempting task abort!scmd(0x00000000872a0053), outstanding for 31000 ms & timeout 30000 ms
[  225.468288] sd 2:0:2:0: [sdd] tag#979 CDB: Read(16) 88 00 00 00 00 04 fa 82 b1 70 00 00 00 28 00 00
[  225.468293] scsi target2:0:2: handle(0x001a), sas_address(0x3474f4f584a11c09), phy(9)
[  225.468300] scsi target2:0:2: enclosure logical id(0x3474f4f584a11c3e), slot(9)
[  225.468306] scsi target2:0:2: enclosure level(0x0000), connector name( C1  )
[  225.468312] sd 2:0:2:0: No reference found at driver, assuming scmd(0x00000000872a0053) might have completed
[  225.468317] sd 2:0:2:0: task abort: SUCCESS scmd(0x00000000872a0053)
[  225.468325] sd 2:0:2:0: attempting task abort!scmd(0x00000000759c16dc), outstanding for 31040 ms & timeout 30000 ms
[  225.468331] sd 2:0:2:0: [sdd] tag#978 CDB: Write(16) 8a 00 00 00 00 06 a2 40 2d f8 00 00 00 48 00 00
[  225.468335] scsi target2:0:2: handle(0x001a), sas_address(0x3474f4f584a11c09), phy(9)
[  225.468341] scsi target2:0:2: enclosure logical id(0x3474f4f584a11c3e), slot(9)
[  225.468346] scsi target2:0:2: enclosure level(0x0000), connector name( C1  )
[  225.468351] sd 2:0:2:0: No reference found at driver, assuming scmd(0x00000000759c16dc) might have completed
[  225.468356] sd 2:0:2:0: task abort: SUCCESS scmd(0x00000000759c16dc)
[  225.969173] sd 2:0:2:0: Power-on or device reset occurred
[  256.043137] sd 2:0:2:0: attempting task abort!scmd(0x00000000719bcde2), outstanding for 30068 ms & timeout 30000 ms
[  256.043151] sd 2:0:2:0: [sdd] tag#1002 CDB: Inquiry 12 00 00 00 24 00
[  256.043157] scsi target2:0:2: handle(0x001a), sas_address(0x3474f4f584a11c09), phy(9)
[  256.043164] scsi target2:0:2: enclosure logical id(0x3474f4f584a11c3e), slot(9)
[  256.043170] scsi target2:0:2: enclosure level(0x0000), connector name( C1  )
[  256.466303] sd 2:0:2:0: task abort: SUCCESS scmd(0x00000000719bcde2)
[  256.466361] sd 2:0:2:0: attempting device reset! scmd(0x00000000759c16dc)
[  256.466370] sd 2:0:2:0: [sdd] tag#992 CDB: Write(16) 8a 00 00 00 00 06 a2 40 2d f8 00 00 00 48 00 00
[  256.466375] scsi target2:0:2: handle(0x001a), sas_address(0x3474f4f584a11c09), phy(9)
[  256.466379] scsi target2:0:2: enclosure logical id(0x3474f4f584a11c3e), slot(9)
[  256.466383] scsi target2:0:2: enclosure level(0x0000), connector name( C1  )
[  256.468502] sd 2:0:2:0: device_block, handle(0x001a)
[  256.716446] sd 2:0:2:0: device reset: FAILED scmd(0x00000000759c16dc)
[  256.716456] scsi target2:0:2: attempting target reset! scmd(0x00000000759c16dc)
[  256.716465] sd 2:0:2:0: [sdd] tag#992 CDB: Write(16) 8a 00 00 00 00 06 a2 40 2d f8 00 00 00 48 00 00
[  256.716493] scsi target2:0:2: handle(0x001a), sas_address(0x3474f4f584a11c09), phy(9)
[  256.716500] scsi target2:0:2: enclosure logical id(0x3474f4f584a11c3e), slot(9)
[  256.716505] scsi target2:0:2: enclosure level(0x0000), connector name( C1  )
[  256.717324] scsi target2:0:2: target reset: SUCCESS scmd(0x00000000759c16dc)
[  256.718685] sd 2:0:2:0: device_unblock and setting to running, handle(0x001a)
[  257.466131] mpt3sas_cm0: log_info(0x31110e05): originator(PL), code(0x11), sub_code(0x0e05)
[  257.466162] mpt3sas_cm0: attempting host reset! scmd(0x00000000759c16dc)
[  257.466228] sd 2:0:2:0: [sdd] tag#992 CDB: Write(16) 8a 00 00 00 00 06 a2 40 2d f8 00 00 00 48 00 00
[  267.510776] mpt3sas_cm0: sending diag reset !!
[  268.183000] mpt3sas_cm0: diag reset: SUCCESS
[  268.434808] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
[  268.567434] mpt3sas_cm0: _base_display_fwpkg_version: complete
[  268.567438] mpt3sas_cm0: FW Package Ver(24.00.00.00)
[  268.567567] mpt3sas_cm0: TimeSync Interval in Manuf page-11 is not enabled. Periodic Time-Sync will be disabled
[  268.571319] mpt3sas_cm0: SAS3416: FWVersion(24.00.00.00), ChipRevision(0x01)
[  268.571329] NVMe
[  268.571332] mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ)
[  268.571501] mpt3sas_cm0: sending port enable !!
[  276.374953] mpt3sas_cm0: port enable: SUCCESS
[  276.375849] mpt3sas_cm0: search for end-devices: start
[  276.376968] scsi target2:0:0: handle(0x0019), sas_addr(0x3474f4f584a11c08)
[  276.376973] scsi target2:0:0: enclosure logical id(0x3474f4f584a11c3e), slot(8)
[  276.377034] scsi target2:0:2: handle(0x001a), sas_addr(0x3474f4f584a11c09)
[  276.377037] scsi target2:0:2: enclosure logical id(0x3474f4f584a11c3e), slot(9)
[  276.377096] scsi target2:0:3: handle(0x001b), sas_addr(0x3474f4f584a11c0a)
[  276.377099] scsi target2:0:3: enclosure logical id(0x3474f4f584a11c3e), slot(10)
[  276.377158] scsi target2:0:4: handle(0x001c), sas_addr(0x3474f4f584a11c0b)
[  276.377162] scsi target2:0:4: enclosure logical id(0x3474f4f584a11c3e), slot(11)
[  276.377220] scsi target2:0:5: handle(0x001d), sas_addr(0x3474f4f584a11c0c)
[  276.377224] scsi target2:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(12)
[  276.377282] scsi target2:0:6: handle(0x001e), sas_addr(0x3474f4f584a11c0d)
[  276.377285] scsi target2:0:6: enclosure logical id(0x3474f4f584a11c3e), slot(13)
[  276.377345] scsi target2:0:7: handle(0x001f), sas_addr(0x3474f4f584a11c0e)
[  276.377348] scsi target2:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(14)
[  276.377407] scsi target2:0:8: handle(0x0020), sas_addr(0x3474f4f584a11c0f)
[  276.377410] scsi target2:0:8: enclosure logical id(0x3474f4f584a11c3e), slot(15)
[  276.377469] scsi target2:0:9: handle(0x0021), sas_addr(0x3474f4f584a11c3e)
[  276.377472] scsi target2:0:9: enclosure logical id(0x3474f4f584a11c3e), slot(24)
[  276.377475]  handle changed from(0x0022)!!!
[  276.377533] scsi target2:0:1: handle(0x0022), sas_addr(0x3474f4f58496a31e)
[  276.377536] scsi target2:0:1: enclosure logical id(0x3474f4f58496a300), slot(39)
[  276.377539]  handle changed from(0x0021)!!!
[  276.377612] mpt3sas_cm0: search for end-devices: complete
[  276.377615] mpt3sas_cm0: search for end-devices: start
[  276.377617] mpt3sas_cm0: search for PCIe end-devices: complete
[  276.377619] mpt3sas_cm0: search for expanders: start
[  276.377677]  expander present: handle(0x0017), sas_addr(0x3474f4f58496a31f), port:0
[  276.377735]  expander present: handle(0x0018), sas_addr(0x3474f4f584a11c3f), port:8
[  276.377795] mpt3sas_cm0: search for expanders: complete
[  276.377805] mpt3sas_cm0: mpt3sas_base_hard_reset_handler: SUCCESS
[  276.377808] mpt3sas_cm0: host reset: SUCCESS scmd(0x00000000759c16dc)
[  286.628024] sd 2:0:2:0: Power-on or device reset occurred
[  286.839236] sd 2:0:0:0: Power-on or device reset occurred
[  286.840137] sd 2:0:4:0: Power-on or device reset occurred
[  286.847626] sd 2:0:8:0: Power-on or device reset occurred
[  286.847919] sd 2:0:3:0: Power-on or device reset occurred
[  286.848287] sd 2:0:7:0: Power-on or device reset occurred
[  286.849239] sd 2:0:6:0: Power-on or device reset occurred
[  286.849484] sd 2:0:5:0: Power-on or device reset occurred
[  287.641706] mpt3sas_cm0: removing unresponding devices: start
[  287.641716] mpt3sas_cm0: removing unresponding devices: end-devices
[  287.641721] mpt3sas_cm0: Removing unresponding devices: pcie end-devices
[  287.641724] mpt3sas_cm0: removing unresponding devices: expanders
[  287.641728] mpt3sas_cm0: removing unresponding devices: complete
[  287.641736] mpt3sas_cm0: Update devices with firmware reported queue depth
[  287.641744] sd 2:0:0:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[  287.641753] ses 2:0:1:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1)
[  287.641759] sd 2:0:2:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[  287.641765] sd 2:0:3:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[  287.641771] sd 2:0:4:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[  287.641777] sd 2:0:5:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[  287.641783] sd 2:0:6:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[  287.641789] sd 2:0:7:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[  287.641795] sd 2:0:8:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[  287.641801] ses 2:0:9:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1)
[  287.641805] mpt3sas_cm0: scan devices: start
[  287.642588] mpt3sas_cm0:     scan devices: expanders start
[  287.646879] mpt3sas_cm0:     break from expander scan: ioc_status(0x0022), loginfo(0x310f0400)
[  287.646886] mpt3sas_cm0:     scan devices: expanders complete
[  287.646888] mpt3sas_cm0:     scan devices: end devices start
[  287.648415] mpt3sas_cm0:     break from end device scan: ioc_status(0x0022), loginfo(0x310f0400)
[  287.648419] mpt3sas_cm0:     scan devices: end devices complete
[  287.648421] mpt3sas_cm0:     scan devices: pcie end devices start
[  287.648472] mpt3sas_cm0:     break from pcie end device scan: ioc_status(0x0022), loginfo(0x310f0400)
[  287.648475] mpt3sas_cm0:     pcie devices: pcie end devices complete
[  287.648477] mpt3sas_cm0: scan devices: complete
[  375.888752] systemd-journald[701]: /var/log/journal/44e4f537dae94ab69e91a2cb7a24c054/user-3000.journal: Journal file uses a different sequence number ID, rotating.
 
M

MBastian

Active Member
Jul 17, 2016
339
100
43
Germany
Did you switch the connectors on the HBA? If the issue wanders from C0 to C1 it's either the cable or the backplane(SAS connection or power delivery).
EDIT: If I interpret your last post right you already tried something like that. How about using C2 and C3 and see what happens?
 
Last edited:
D

Darkwing314

New Member
Oct 30, 2025
29
8
3
MBastian said:
Did you switch the connectors on the HBA? If the issue wanders from C0 to C1 it's either the cable or the backplane(SAS connection or power delivery).
EDIT: If I interpret your last post right you already tried something like that. How about using C2 and C3 and see what happens?
Click to expand...
Yeah, the issue followed from C0 to C1 and using a different cable at the same time and also different port on the backplane (it has 3 ports, to be honest I'm not entirely sure if there's a difference between them either - I think they are for redundancy and/or putting multiple backplanes in parallel/series arrangements?)

Haven't tried with C2/C3 - will do that tonight. I also have the second backplane that I could move the drives to and see if that makes a difference.

Thanks for the ideas though.
 
M

MBastian

Active Member
Jul 17, 2016
339
100
43
Germany
Darkwing314 said:
Haven't tried with C2/C3 - will do that tonight. I also have the second backplane that I could move the drives to and see if that makes a difference.
Click to expand...
No need for that. you already ruled out the HBA.

Darkwing314 said:
also different port on the backplane (it has 3 ports, to be honest I'm not entirely sure if there's a difference between them either - I think they are for redundancy and/or putting multiple backplanes in parallel/series arrangements?)
Click to expand...
Hmm, that makes me wonder if it's just wrong cabling. A picture and the chassis/backplane type would help. Is there any documentation regarding the backplane setup?
 
Last edited:
D

Darkwing314

New Member
Oct 30, 2025
29
8
3
MBastian said:
No need for that. you already ruled out the HBA.


Hmm, that makes me wonder if it's just wrong cabling. A picture and the chassis/backplane type would help. Is there any documentation regarding the backplane setup?
Click to expand...
Yeah the chassis/backplane is a bit of a wildcard and I hope it's not the source of my problems. It's a Gooxi RMC4136-670-HSE chassis and contains two backplanes: 24 port RMC4124-BPE-12G and 12 port RMC2112-BPE-12G. I do have the user manual for the chassis, and it provides the following diagrams. I have 4 ports on my HBA so I had connected 2x cables from the 24port one and 1x from the 12x one (mostly because the chassis came with cables connected to the backplanes like that). I'll have to look at the PCBs to see which of the connectors map to the P1/P2/IN1 connections in their diagram. Currently I'm connected to the connectors labelled 11 and 12. I'll try to simplify to a single connection to each and to the SAS_IN1 connector specifically as per the parallel diagram (and SAS_P1 on the 12port I guess).

1773260433887.png

1773260453400.png

1773260465360.png
 
BLinux

BLinux

cat lover server enthusiast
Jul 7, 2016
2,770
1,137
113
artofserver.com
Darkwing314 said:
Okay, I've updated the firmware (used boot to EFI method) and that all completed successfully and I'm on v24 now (see below).

Pics of the card attached, turns out it does say AVAGO on the back, has brass pins on the heatsink and it does say Assembled in Thailand. Does that confirm this is a legit card?

dmesg output from a fresh boot included as well. Problem seems to be the same from what I can tell.

Code: 
vault% sudo storcli /c0 show nolog
CLI Version = 007.2807.0000.0000 Dec 22, 2023
Operating system = Linux 6.12.33-production+truenas
Controller = 0
Status = Success
Description = None

Product Name = HBA 9400-16i
Serial Number = SP92722307
SAS Address =  500605b00f3212d0
PCI Address = 00:00:10:00
System Time = 03/11/2026 02:21:52
FW Package Build = 24.00.00.00
FW Version = 24.00.00.00
BIOS Version = 09.15.00.00_24.00.00.00
NVDATA Version = 24.00.00.22
PSOC FW Version = 0x0001
PSOC Part Number = 05689
Driver Name = mpt3sas
Driver Version = 48.100.00.00
Bus Number = 0
Device Number = 16
Function Number = 0
Domain ID = 0
Vendor Id = 0x1000
Device Id = 0xAC
SubVendor Id = 0x1000
SubDevice Id = 0x3000
Board Name = HBA 9400-16i
Board Assembly = 03-50008-15005
Board Tracer Number = SP92722307
Security Protocol = None
Physical Drives = 8
Click to expand...
Looks like you updated the firmware, but the BIOS ROM is still old. It shouldn't matter too much, but might want to update that as well.

Yes, brass pins and Avago logo is a good sign. I asked about the Thailand part because your serial number has the Thailand code encoded in it. The counterfeiters often mess that part up and put a Thailand (or some other country) serial number on a assembled in China card because they are copying a legit label and just sticking it on the ones they are selling. In any case, I don't see any signs of what you have being counterfeit or "unofficial" in anyway.

power on reset during startup is normal.. you are literally powering on the drives at that point. it's a problem if it keeps happening during normal operations.

EDIT: additional comment, noticed the low profile bracket is not the official one, but sellers might just install whatever they have on it.
 
BLinux

BLinux

cat lover server enthusiast
Jul 7, 2016
2,770
1,137
113
artofserver.com
Ok, I didn't realize you had a SAS expander backplane as well. So, you have a lot of components involved so there are other possibilities too:

1) Could be a firmware or interoperability bug between the SAS expander chip and the HBA. Your post seems to suggest it's a PMC SAS expander chip, so Broadcom never tested their card with that.

2) defective/damage backplane.

Revision about previous comment regarding power. If this is a server chassis with dual redundant PSUs, it's likely not a PSU issue (unless the PDB or both PSUs are defective in a way, but that failure mode is almost always very obvious). The concern about PSUs are usually with people building using consumer PC ATX PSUs, trying to drive 24 HDDs and daisy chaining 6 molex extenders, and other stuff like that. So, knowing you have a server chassis that is probably designed with PSUs that should be adequate to drive that backplane and all the HDDs in it, I probably wouldn't focus too much on power issue at this point.


when many components are involved, the best troubleshooting approach is to :

STEP 1) Simplify the setup as much as possible. Remove all other components except the minimum required to perform STEP 2 below. This means,1 HBA controller, 1 cable from HBA to SAS expander backplane, and 1 known working HDD. Run an OS directly with the hardware, no VMs and PCIe passthrough, etc. If you need, boot an OS off some USB drive temporarily for this testing.

STEP 2) Create a procedure to trigger the problem. For example, you can run a fio benchmark read only test. (read only so it doesn't affect the data on the drives, but if there's no important data yet, then do whatever you want here to trigger the problem) Once you have a procedure to trigger the problem, or confirm the problem doesn't exist, then move the components in STEP 1 one thing at a time and repeat the test. So, this could mean:

move cable to different HBA port
move cable to different SAS expander backplane port
move HDD to different drive bay on the SAS backplane

If you can verify ALL combinations of the above work for the minimal components you have, then start introducing more components one at a time. For example, you might start adding more HDDs, or add a 2nd cable from HBA to SAS expander, etc. But always add only 1 component and repeat your testing process.


The only problem with the above is if your problem is only triggered by the cumulative effect of having all or some subset of the components working together. But it might help you identify the "threshold" when it is triggered. For example, I did a deep dive log analysis in this video to diagnose a potential bad cable between SAS expander and HBA:

 
  • Like
Reactions: MBastian
D

Darkwing314

New Member
Oct 30, 2025
29
8
3
BLinux said:
Looks like you updated the firmware, but the BIOS ROM is still old. It shouldn't matter too much, but might want to update that as well.

Yes, brass pins and Avago logo is a good sign. I asked about the Thailand part because your serial number has the Thailand code encoded in it. The counterfeiters often mess that part up and put a Thailand (or some other country) serial number on a assembled in China card because they are copying a legit label and just sticking it on the ones they are selling. In any case, I don't see any signs of what you have being counterfeit or "unofficial" in anyway.

power on reset during startup is normal.. you are literally powering on the drives at that point. it's a problem if it keeps happening during normal operations.

EDIT: additional comment, noticed the low profile bracket is not the official one, but sellers might just install whatever they have on it.
Click to expand...
Hmm, I thought I updated the BIOS ... will look into that tonight.

The main thing that makes me question the legitimacy of this card is that the Product Name that is reported is just HBA 9400-16i. I thought normally that would show the brand or something else but maybe not.

Also, it turns out I didn't disable EPC last night, not sure what I did but I did that this morning (latest log above is from this morning reboot) and assuming the power-up errors can be considered normal then there haven't been any at all since then. But it's also basically been completely idle since then so I'm fully expecting it to still be an issue.
 
D

Darkwing314

New Member
Oct 30, 2025
29
8
3
BLinux said:
Ok, I didn't realize you had a SAS expander backplane as well. So, you have a lot of components involved so there are other possibilities too:

1) Could be a firmware or interoperability bug between the SAS expander chip and the HBA. Your post seems to suggest it's a PMC SAS expander chip, so Broadcom never tested their card with that.

2) defective/damage backplane.

Revision about previous comment regarding power. If this is a server chassis with dual redundant PSUs, it's likely not a PSU issue (unless the PDB or both PSUs are defective in a way, but that failure mode is almost always very obvious). The concern about PSUs are usually with people building using consumer PC ATX PSUs, trying to drive 24 HDDs and daisy chaining 6 molex extenders, and other stuff like that. So, knowing you have a server chassis that is probably designed with PSUs that should be adequate to drive that backplane and all the HDDs in it, I probably wouldn't focus too much on power issue at this point.


when many components are involved, the best troubleshooting approach is to :

STEP 1) Simplify the setup as much as possible. Remove all other components except the minimum required to perform STEP 2 below. This means,1 HBA controller, 1 cable from HBA to SAS expander backplane, and 1 known working HDD. Run an OS directly with the hardware, no VMs and PCIe passthrough, etc. If you need, boot an OS off some USB drive temporarily for this testing.

STEP 2) Create a procedure to trigger the problem. For example, you can run a fio benchmark read only test. (read only so it doesn't affect the data on the drives, but if there's no important data yet, then do whatever you want here to trigger the problem) Once you have a procedure to trigger the problem, or confirm the problem doesn't exist, then move the components in STEP 1 one thing at a time and repeat the test. So, this could mean:

move cable to different HBA port
move cable to different SAS expander backplane port
move HDD to different drive bay on the SAS backplane

If you can verify ALL combinations of the above work for the minimal components you have, then start introducing more components one at a time. For example, you might start adding more HDDs, or add a 2nd cable from HBA to SAS expander, etc. But always add only 1 component and repeat your testing process.


The only problem with the above is if your problem is only triggered by the cumulative effect of having all or some subset of the components working together. But it might help you identify the "threshold" when it is triggered. For example, I did a deep dive log analysis in this video to diagnose a potential bad cable between SAS expander and HBA:

Click to expand...
Reproducing the problem has been a challenge. To be fair I have never tried a synthetic test, but no amount of reading/writing seems to trigger it. I can hammer it with reads/writes over 10g network all day (okay, I haven't actually tried for that long ...) and whenever the problem happens, it's when usage is very low (streaming a single video file is a pretty low load).

The big thing I keep coming back to is how it kept happening at exactly the same time each day (and also the same minute in other hours of the day): 10:26pm, 1:26pm, 7:26pm. Is there some regular thing that TrueNAS or the HBA driver does that is causing this? Very weird.

This system is sort of in production (as production as my homelab gets). Nothing is mission critical. It would suck to lose the array and I really don't want to deal with that but I do have backups of the important stuff and since I just migrated from an old Synology, the vast majority of my Linux ISOs are still on there and could be copied over again.

I agree that I have a lot of layers though. TrueNAS virtualized in Proxmox, HBA passed through Proxmox, expander backplane. I'll see what I can do to simplify things and try to come up with a reliable way to reproduce the issue.
 
BLinux

BLinux

cat lover server enthusiast
Jul 7, 2016
2,770
1,137
113
artofserver.com
Darkwing314 said:
Hmm, I thought I updated the BIOS ... will look into that tonight.

The main thing that makes me question the legitimacy of this card is that the Product Name that is reported is just HBA 9400-16i. I thought normally that would show the brand or something else but maybe not.

Also, it turns out I didn't disable EPC last night, not sure what I did but I did that this morning (latest log above is from this morning reboot) and assuming the power-up errors can be considered normal then there haven't been any at all since then. But it's also basically been completely idle since then so I'm fully expecting it to still be an issue.
Click to expand...
If you want to see what the output of storcli should look like, checkout the last photo in my store listing which is a screenshot of storcli output:


You'll also see the BIOS and FW version.
 
D

Darkwing314

New Member
Oct 30, 2025
29
8
3
BLinux said:
If you want to see what the output of storcli should look like, checkout the last photo in my store listing which is a screenshot of storcli output:


You'll also see the BIOS and FW version.
Click to expand...
Ah, I see, I think maybe I did the firmware and UEFI firmware update but not the BIOS one. Will do that tonight for the sake of making sure it's all the versions that come with the Phase 24 firmware package.
 
D

Darkwing314

New Member
Oct 30, 2025
29
8
3
Alright, I've updated BIOS now to the latest (see below).

Code: 
FW Package Build = 24.00.00.00
FW Version = 24.00.00.00
BIOS Version = 09.47.00.00_24.00.00.00
NVDATA Version = 24.00.00.22
I also opened up the server to inspect the backplane. The user manual says the 3 ports should be labelled SAS_IN1, SAS_P1, and SAS_P2, but in reality they are labelled on the PCB as SAS1, SAS2, and SAS3. Originally I was plugged into SAS1 and SAS2 (running to C0 and C1 on the HBA) but now for testing's sake I have connected just SAS3 to C3 on the HBA (second backplane is disconnected). Below are the logs from a fresh boot (I used your grep command from your video to filter to only the storage items).

Code: 
Mar 11 22:43:55 vault kernel: scsi host0: Virtio SCSI HBA
Mar 11 22:43:55 vault kernel: mpt3sas version 48.100.00.00 loaded
Mar 11 22:43:55 vault kernel: scsi 0:0:0:0: Direct-Access     QEMU     QEMU HARDDISK    2.5+ PQ: 0 ANSI: 5
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (16383524 kB)
Mar 11 22:43:55 vault kernel: scsi host2: Virtio SCSI HBA
Mar 11 22:43:55 vault kernel: scsi 2:0:0:1: Direct-Access     QEMU     QEMU HARDDISK    2.5+ PQ: 0 ANSI: 5
Mar 11 22:43:55 vault kernel: sd 2:0:0:1: Power-on or device reset occurred
Mar 11 22:43:55 vault kernel: sd 0:0:0:0: Power-on or device reset occurred
Mar 11 22:43:55 vault kernel: sd 2:0:0:1: [sdb] 67108864 512-byte logical blocks: (34.4 GB/32.0 GiB)
Mar 11 22:43:55 vault kernel: sd 0:0:0:0: [sda] 67108864 512-byte logical blocks: (34.4 GB/32.0 GiB)
Mar 11 22:43:55 vault kernel: sd 2:0:0:1: [sdb] Write Protect is off
Mar 11 22:43:55 vault kernel: sd 0:0:0:0: [sda] Write Protect is off
Mar 11 22:43:55 vault kernel: sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA
Mar 11 22:43:55 vault kernel: sd 2:0:0:1: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
Mar 11 22:43:55 vault kernel: scsi host3: ahci
Mar 11 22:43:55 vault kernel: scsi host4: ahci
Mar 11 22:43:55 vault kernel: scsi host5: ahci
Mar 11 22:43:55 vault kernel: scsi host6: ahci
Mar 11 22:43:55 vault kernel: scsi host7: ahci
Mar 11 22:43:55 vault kernel: scsi host8: ahci
Mar 11 22:43:55 vault kernel: sd 0:0:0:0: [sda] Attached SCSI disk
Mar 11 22:43:55 vault kernel: sd 2:0:0:1: [sdb] Attached SCSI disk
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: MSI-X vectors supported: 16
Mar 11 22:43:55 vault kernel: mpt3sas_cm0:  0 4 4
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: High IOPs queues : disabled
Mar 11 22:43:55 vault kernel: mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 46
Mar 11 22:43:55 vault kernel: mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 47
Mar 11 22:43:55 vault kernel: mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 48
Mar 11 22:43:55 vault kernel: mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 49
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: iomem(0x000000c0e0000000), mapped(0x00000000d501b5e6), size(1048576)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: ioport(0x0000000000005000), size(256)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: scatter gather: sge_in_main_msg(1), sge_per_chain(7), sge_per_io(128), chains_per_io(19)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: request pool(0x000000009ff9925c) - dma(0x100400000): depth(6756), frame_size(128), pool_size(844 kB)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: sense pool(0x00000000818ae35a) - dma(0x100500000): depth(6551), element_size(96), pool_size (614 kB)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: reply pool(0x00000000bab12b3b) - dma(0x100600000): depth(6820), frame_size(128), pool_size(852 kB)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: config page(0x00000000d7428b6f) - dma(0x1339c9000): size(512)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: Allocated physical memory: size(28966 kB)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: Current Controller Queue Depth(6548),Max Controller Queue Depth(6656)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: Scatter Gather Elements per IO(128)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: _base_display_fwpkg_version: complete
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: FW Package Ver(24.00.00.00)
Mar 11 22:43:55 vault kernel: scsi 4:0:0:0: CD-ROM            QEMU     QEMU DVD-ROM     2.5+ PQ: 0 ANSI: 5
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: TimeSync Interval in Manuf page-11 is not enabled. Periodic Time-Sync will be disabled
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: SAS3416: FWVersion(24.00.00.00), ChipRevision(0x01)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ)
Mar 11 22:43:55 vault kernel: mpt3sas 0000:01:00.0: Max SCSIIO MPT commands: 6548 shared with nr_hw_queues = 4
Mar 11 22:43:55 vault kernel: scsi host1: Fusion MPT SAS Host
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: sending port enable !!
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: hba_port entry: 000000007423dc66, port: 0 is added to hba_port list
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: hba_port entry: 000000007e9c00c4, port: 8 is added to hba_port list
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b00f3212d0), phys(21)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: expander_add: handle(0x0017), parent(0x0001), sas_addr(0x3474f4f584a11c3f), phys(37)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: handle(0x18) sas_address(0x3474f4f584a11c08) port_type(0x1)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: handle(0x19) sas_address(0x3474f4f584a11c09) port_type(0x1)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: handle(0x1a) sas_address(0x3474f4f584a11c0a) port_type(0x1)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: handle(0x1b) sas_address(0x3474f4f584a11c0b) port_type(0x1)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: handle(0x1c) sas_address(0x3474f4f584a11c0c) port_type(0x1)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: handle(0x1d) sas_address(0x3474f4f584a11c0d) port_type(0x1)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: handle(0x1e) sas_address(0x3474f4f584a11c0e) port_type(0x1)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: handle(0x1f) sas_address(0x3474f4f584a11c0f) port_type(0x1)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: handle(0x20) sas_address(0x3474f4f584a11c3e) port_type(0x1)
Mar 11 22:43:55 vault kernel: mpt3sas_cm0: port enable: SUCCESS
Mar 11 22:43:55 vault kernel: scsi 1:0:0:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
Mar 11 22:43:55 vault kernel: scsi 1:0:0:0: SATA: handle(0x0018), sas_addr(0x3474f4f584a11c08), phy(8), device_name(0x0000000000000000)
Mar 11 22:43:55 vault kernel: scsi 1:0:0:0: enclosure logical id (0x3474f4f584a11c3e), slot(8)
Mar 11 22:43:55 vault kernel: scsi 1:0:0:0: enclosure level(0x0000), connector name( C3  )
Mar 11 22:43:55 vault kernel: scsi 1:0:0:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Mar 11 22:43:55 vault kernel: scsi 1:0:0:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
Mar 11 22:43:55 vault kernel: scsi 1:0:1:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
Mar 11 22:43:55 vault kernel: scsi 1:0:1:0: SATA: handle(0x0019), sas_addr(0x3474f4f584a11c09), phy(9), device_name(0x0000000000000000)
Mar 11 22:43:55 vault kernel: scsi 1:0:1:0: enclosure logical id (0x3474f4f584a11c3e), slot(9)
Mar 11 22:43:55 vault kernel: scsi 1:0:1:0: enclosure level(0x0000), connector name( C3  )
Mar 11 22:43:55 vault kernel: scsi 1:0:1:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Mar 11 22:43:55 vault kernel: scsi 1:0:1:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
Mar 11 22:43:55 vault kernel: scsi 1:0:2:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
Mar 11 22:43:55 vault kernel: scsi 1:0:2:0: SATA: handle(0x001a), sas_addr(0x3474f4f584a11c0a), phy(10), device_name(0x0000000000000000)
Mar 11 22:43:55 vault kernel: scsi 1:0:2:0: enclosure logical id (0x3474f4f584a11c3e), slot(10)
Mar 11 22:43:55 vault kernel: scsi 1:0:2:0: enclosure level(0x0000), connector name( C3  )
Mar 11 22:43:55 vault kernel: scsi 1:0:2:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Mar 11 22:43:55 vault kernel: scsi 1:0:2:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
Mar 11 22:43:55 vault kernel: scsi 1:0:3:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
Mar 11 22:43:55 vault kernel: scsi 1:0:3:0: SATA: handle(0x001b), sas_addr(0x3474f4f584a11c0b), phy(11), device_name(0x0000000000000000)
Mar 11 22:43:55 vault kernel: scsi 1:0:3:0: enclosure logical id (0x3474f4f584a11c3e), slot(11)
Mar 11 22:43:55 vault kernel: scsi 1:0:3:0: enclosure level(0x0000), connector name( C3  )
Mar 11 22:43:55 vault kernel: scsi 1:0:3:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Mar 11 22:43:55 vault kernel: scsi 1:0:3:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
Mar 11 22:43:55 vault kernel: scsi 1:0:4:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
Mar 11 22:43:55 vault kernel: scsi 1:0:4:0: SATA: handle(0x001c), sas_addr(0x3474f4f584a11c0c), phy(12), device_name(0x0000000000000000)
Mar 11 22:43:55 vault kernel: scsi 1:0:4:0: enclosure logical id (0x3474f4f584a11c3e), slot(12)
Mar 11 22:43:55 vault kernel: scsi 1:0:4:0: enclosure level(0x0000), connector name( C3  )
Mar 11 22:43:55 vault kernel: scsi 1:0:4:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Mar 11 22:43:55 vault kernel: scsi 1:0:4:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
Mar 11 22:43:55 vault kernel: scsi 1:0:5:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
Mar 11 22:43:55 vault kernel: scsi 1:0:5:0: SATA: handle(0x001d), sas_addr(0x3474f4f584a11c0d), phy(13), device_name(0x0000000000000000)
Mar 11 22:43:55 vault kernel: scsi 1:0:5:0: enclosure logical id (0x3474f4f584a11c3e), slot(13)
Mar 11 22:43:55 vault kernel: scsi 1:0:5:0: enclosure level(0x0000), connector name( C3  )
Mar 11 22:43:55 vault kernel: scsi 1:0:5:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Mar 11 22:43:55 vault kernel: scsi 1:0:5:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
Mar 11 22:43:55 vault kernel: scsi 1:0:6:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
Mar 11 22:43:55 vault kernel: scsi 1:0:6:0: SATA: handle(0x001e), sas_addr(0x3474f4f584a11c0e), phy(14), device_name(0x0000000000000000)
Mar 11 22:43:55 vault kernel: scsi 1:0:6:0: enclosure logical id (0x3474f4f584a11c3e), slot(14)
Mar 11 22:43:55 vault kernel: scsi 1:0:6:0: enclosure level(0x0000), connector name( C3  )
Mar 11 22:43:55 vault kernel: scsi 1:0:6:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Mar 11 22:43:55 vault kernel: scsi 1:0:6:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
Mar 11 22:43:55 vault kernel: scsi 1:0:7:0: Direct-Access     ATA      ST20000NM007D-3D SN06 PQ: 0 ANSI: 6
Mar 11 22:43:55 vault kernel: scsi 1:0:7:0: SATA: handle(0x001f), sas_addr(0x3474f4f584a11c0f), phy(15), device_name(0x0000000000000000)
Mar 11 22:43:55 vault kernel: scsi 1:0:7:0: enclosure logical id (0x3474f4f584a11c3e), slot(15)
Mar 11 22:43:55 vault kernel: scsi 1:0:7:0: enclosure level(0x0000), connector name( C3  )
Mar 11 22:43:55 vault kernel: scsi 1:0:7:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
Mar 11 22:43:55 vault kernel: scsi 1:0:7:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
Mar 11 22:43:55 vault kernel: scsi 1:0:8:0: Enclosure         GOOXIBM  4U24SXP 36Sx12G  B134 PQ: 0 ANSI: 6
Mar 11 22:43:55 vault kernel: scsi 1:0:8:0: set ignore_delay_remove for handle(0x0020)
Mar 11 22:43:55 vault kernel: scsi 1:0:8:0: SES: handle(0x0020), sas_addr(0x3474f4f584a11c3e), phy(36), device_name(0x0000000000000000)
Mar 11 22:43:55 vault kernel: scsi 1:0:8:0: enclosure logical id (0x3474f4f584a11c3e), slot(24)
Mar 11 22:43:55 vault kernel: scsi 1:0:8:0: enclosure level(0x0000), connector name( C3  )
Mar 11 22:43:55 vault kernel: scsi 1:0:8:0: qdepth(64), tagged(1), scsi_level(7), cmd_que(1)
Mar 11 22:43:55 vault kernel: sd 1:0:0:0: Power-on or device reset occurred
Mar 11 22:43:55 vault kernel: sd 1:0:1:0: Power-on or device reset occurred
Mar 11 22:43:55 vault kernel: sd 1:0:2:0: Power-on or device reset occurred
Mar 11 22:43:55 vault kernel: sd 1:0:3:0: Power-on or device reset occurred
Mar 11 22:43:55 vault kernel: sd 1:0:4:0: Power-on or device reset occurred
Mar 11 22:43:55 vault kernel: sd 1:0:5:0: Power-on or device reset occurred
Mar 11 22:43:55 vault kernel: sd 1:0:0:0: [sdc] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
Mar 11 22:43:55 vault kernel: sd 1:0:0:0: [sdc] 4096-byte physical blocks
Mar 11 22:43:55 vault kernel: sd 1:0:6:0: Power-on or device reset occurred
Mar 11 22:43:55 vault kernel: sd 1:0:2:0: [sde] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
Mar 11 22:43:55 vault kernel: sd 1:0:2:0: [sde] 4096-byte physical blocks
Mar 11 22:43:55 vault kernel: sd 1:0:1:0: [sdd] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
Mar 11 22:43:55 vault kernel: sd 1:0:7:0: Power-on or device reset occurred
Mar 11 22:43:55 vault kernel: sd 1:0:3:0: [sdf] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
Mar 11 22:43:55 vault kernel: sd 1:0:1:0: [sdd] 4096-byte physical blocks
Mar 11 22:43:55 vault kernel: sd 1:0:4:0: [sdg] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
Mar 11 22:43:55 vault kernel: sd 1:0:4:0: [sdg] 4096-byte physical blocks
Mar 11 22:43:55 vault kernel: sd 1:0:3:0: [sdf] 4096-byte physical blocks
Mar 11 22:43:55 vault kernel: sd 1:0:6:0: [sdi] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
Mar 11 22:43:55 vault kernel: sd 1:0:6:0: [sdi] 4096-byte physical blocks
Mar 11 22:43:55 vault kernel: sd 1:0:5:0: [sdh] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
Mar 11 22:43:55 vault kernel: sd 1:0:5:0: [sdh] 4096-byte physical blocks
Mar 11 22:43:55 vault kernel: sd 1:0:0:0: [sdc] Write Protect is off
Mar 11 22:43:55 vault kernel: sd 1:0:1:0: [sdd] Write Protect is off
Mar 11 22:43:55 vault kernel: sd 1:0:2:0: [sde] Write Protect is off
Mar 11 22:43:55 vault kernel: sd 1:0:3:0: [sdf] Write Protect is off
Mar 11 22:43:55 vault kernel: sd 1:0:4:0: [sdg] Write Protect is off
Mar 11 22:43:55 vault kernel: sd 1:0:2:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA
Mar 11 22:43:55 vault kernel: sd 1:0:6:0: [sdi] Write Protect is off
Mar 11 22:43:55 vault kernel: sd 1:0:5:0: [sdh] Write Protect is off
Mar 11 22:43:55 vault kernel: sd 1:0:3:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA
Mar 11 22:43:55 vault kernel: sd 1:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA
Mar 11 22:43:55 vault kernel: sd 1:0:1:0: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA
Mar 11 22:43:55 vault kernel: sd 1:0:5:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA
Mar 11 22:43:55 vault kernel: sd 1:0:4:0: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA
Mar 11 22:43:55 vault kernel: sd 1:0:6:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA
Mar 11 22:43:55 vault kernel: sd 1:0:7:0: [sdj] 39063650304 512-byte logical blocks: (20.0 TB/18.2 TiB)
Mar 11 22:43:55 vault kernel: sd 1:0:7:0: [sdj] 4096-byte physical blocks
Mar 11 22:43:55 vault kernel: sd 1:0:7:0: [sdj] Write Protect is off
Mar 11 22:43:55 vault kernel: sd 1:0:7:0: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA
Mar 11 22:43:55 vault kernel: sd 1:0:3:0: [sdf] Attached SCSI disk
Mar 11 22:43:55 vault kernel: sd 1:0:2:0: [sde] Attached SCSI disk
Mar 11 22:43:55 vault kernel: sd 1:0:5:0: [sdh] Attached SCSI disk
Mar 11 22:43:55 vault kernel: sd 1:0:4:0: [sdg] Attached SCSI disk
Mar 11 22:43:55 vault kernel: sd 1:0:0:0: [sdc] Attached SCSI disk
Mar 11 22:43:55 vault kernel: sd 1:0:1:0: [sdd] Attached SCSI disk
Mar 11 22:43:55 vault kernel: sd 1:0:6:0: [sdi] Attached SCSI disk
Mar 11 22:43:55 vault kernel: sd 1:0:7:0: [sdj] Attached SCSI disk
Mar 11 22:43:56 vault kernel: sd 0:0:0:0: Attached scsi generic sg0 type 0
Mar 11 22:43:56 vault kernel: sd 2:0:0:1: Attached scsi generic sg1 type 0
Mar 11 22:43:56 vault kernel: sr 4:0:0:0: Attached scsi generic sg2 type 5
Mar 11 22:43:56 vault kernel: sd 1:0:0:0: Attached scsi generic sg3 type 0
Mar 11 22:43:56 vault kernel: sd 1:0:1:0: Attached scsi generic sg4 type 0
Mar 11 22:43:56 vault kernel: sd 1:0:2:0: Attached scsi generic sg5 type 0
Mar 11 22:43:56 vault kernel: sd 1:0:3:0: Attached scsi generic sg6 type 0
Mar 11 22:43:56 vault kernel: sd 1:0:4:0: Attached scsi generic sg7 type 0
Mar 11 22:43:56 vault kernel: sd 1:0:5:0: Attached scsi generic sg8 type 0
Mar 11 22:43:56 vault kernel: sd 1:0:6:0: Attached scsi generic sg9 type 0
Mar 11 22:43:56 vault kernel: sd 1:0:7:0: Attached scsi generic sg10 type 0
Mar 11 22:43:56 vault kernel: ses 1:0:8:0: Attached scsi generic sg11 type 13
Mar 11 22:46:01 vault kernel: sd 1:0:7:0: attempting task abort!scmd(0x00000000ccb07330), outstanding for 30292 ms & timeout 30000 ms
Mar 11 22:46:01 vault kernel: sd 1:0:7:0: [sdj] tag#2504 CDB: Read(16) 88 00 00 00 00 05 65 80 29 b0 00 00 00 08 00 00
Mar 11 22:46:01 vault kernel: scsi target1:0:7: handle(0x001f), sas_address(0x3474f4f584a11c0f), phy(15)
Mar 11 22:46:01 vault kernel: scsi target1:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(15)
Mar 11 22:46:01 vault kernel: scsi target1:0:7: enclosure level(0x0000), connector name( C3  )
Mar 11 22:46:02 vault kernel: sd 1:0:7:0: task abort: SUCCESS scmd(0x00000000ccb07330)
Mar 11 22:46:02 vault kernel: sd 1:0:7:0: attempting task abort!scmd(0x00000000fce7f919), outstanding for 30608 ms & timeout 30000 ms
Mar 11 22:46:02 vault kernel: sd 1:0:7:0: [sdj] tag#2392 CDB: Read(16) 88 00 00 00 00 05 5c 07 5b 40 00 00 00 08 00 00
Mar 11 22:46:02 vault kernel: scsi target1:0:7: handle(0x001f), sas_address(0x3474f4f584a11c0f), phy(15)
Mar 11 22:46:02 vault kernel: mpt3sas_cm0: log_info(0x31130000): originator(PL), code(0x13), sub_code(0x0000)
Mar 11 22:46:02 vault kernel: scsi target1:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(15)
Mar 11 22:46:02 vault kernel: scsi target1:0:7: enclosure level(0x0000), connector name( C3  )
Mar 11 22:46:02 vault kernel: sd 1:0:7:0: No reference found at driver, assuming scmd(0x00000000fce7f919) might have completed
Mar 11 22:46:02 vault kernel: sd 1:0:7:0: task abort: SUCCESS scmd(0x00000000fce7f919)
Mar 11 22:46:02 vault kernel: sd 1:0:7:0: attempting task abort!scmd(0x000000004a4352f1), outstanding for 30616 ms & timeout 30000 ms
Mar 11 22:46:02 vault kernel: sd 1:0:7:0: [sdj] tag#2391 CDB: Read(16) 88 00 00 00 00 05 5c 00 31 c0 00 00 00 08 00 00
Mar 11 22:46:02 vault kernel: scsi target1:0:7: handle(0x001f), sas_address(0x3474f4f584a11c0f), phy(15)
Mar 11 22:46:02 vault kernel: scsi target1:0:7: enclosure logical id(0x3474f4f584a11c3e), slot(15)
Mar 11 22:46:02 vault kernel: scsi target1:0:7: enclosure level(0x0000), connector name( C3  )
Mar 11 22:46:02 vault kernel: sd 1:0:7:0: No reference found at driver, assuming scmd(0x000000004a4352f1) might have completed
Mar 11 22:46:02 vault kernel: sd 1:0:7:0: task abort: SUCCESS scmd(0x000000004a4352f1)
Mar 11 22:46:02 vault kernel: sd 1:0:7:0: Power-on or device reset occurred
Mar 11 22:46:34 vault kernel: sd 1:0:6:0: attempting task abort!scmd(0x0000000017d15c00), outstanding for 30896 ms & timeout 30000 ms
Mar 11 22:46:34 vault kernel: sd 1:0:6:0: [sdi] tag#2482 CDB: Read(16) 88 00 00 00 00 02 5d c0 34 b8 00 00 00 08 00 00
Mar 11 22:46:34 vault kernel: scsi target1:0:6: handle(0x001e), sas_address(0x3474f4f584a11c0e), phy(14)
Mar 11 22:46:34 vault kernel: scsi target1:0:6: enclosure logical id(0x3474f4f584a11c3e), slot(14)
Mar 11 22:46:34 vault kernel: scsi target1:0:6: enclosure level(0x0000), connector name( C3  )
Mar 11 22:46:34 vault kernel: sd 1:0:6:0: task abort: SUCCESS scmd(0x0000000017d15c00)
Mar 11 22:46:34 vault kernel: sd 1:0:6:0: attempting task abort!scmd(0x0000000042ec73cb), outstanding for 31192 ms & timeout 30000 ms
Mar 11 22:46:34 vault kernel: sd 1:0:6:0: [sdi] tag#2481 CDB: Read(16) 88 00 00 00 00 02 5d c0 2f 48 00 00 00 08 00 00
Mar 11 22:46:34 vault kernel: scsi target1:0:6: handle(0x001e), sas_address(0x3474f4f584a11c0e), phy(14)
Mar 11 22:46:34 vault kernel: scsi target1:0:6: enclosure logical id(0x3474f4f584a11c3e), slot(14)
Mar 11 22:46:34 vault kernel: scsi target1:0:6: enclosure level(0x0000), connector name( C3  )
Mar 11 22:46:34 vault kernel: sd 1:0:6:0: No reference found at driver, assuming scmd(0x0000000042ec73cb) might have completed
Mar 11 22:46:34 vault kernel: sd 1:0:6:0: task abort: SUCCESS scmd(0x0000000042ec73cb)
Mar 11 22:46:34 vault kernel: sd 1:0:6:0: attempting task abort!scmd(0x00000000fb1f4d22), outstanding for 31252 ms & timeout 30000 ms
Mar 11 22:46:34 vault kernel: sd 1:0:6:0: [sdi] tag#2480 CDB: Read(16) 88 00 00 00 00 00 37 5f 13 e0 00 00 00 08 00 00
Mar 11 22:46:34 vault kernel: scsi target1:0:6: handle(0x001e), sas_address(0x3474f4f584a11c0e), phy(14)
Mar 11 22:46:34 vault kernel: scsi target1:0:6: enclosure logical id(0x3474f4f584a11c3e), slot(14)
Mar 11 22:46:34 vault kernel: scsi target1:0:6: enclosure level(0x0000), connector name( C3  )
Mar 11 22:46:34 vault kernel: sd 1:0:6:0: No reference found at driver, assuming scmd(0x00000000fb1f4d22) might have completed
Mar 11 22:46:34 vault kernel: sd 1:0:6:0: task abort: SUCCESS scmd(0x00000000fb1f4d22)
Mar 11 22:46:35 vault kernel: sd 1:0:6:0: Power-on or device reset occurred
Mar 11 22:47:07 vault kernel: sd 1:0:4:0: attempting task abort!scmd(0x00000000cf5d335d), outstanding for 31040 ms & timeout 30000 ms
Mar 11 22:47:07 vault kernel: sd 1:0:4:0: [sdg] tag#2467 CDB: Read(16) 88 00 00 00 00 02 d7 84 dd 78 00 00 00 08 00 00
Mar 11 22:47:07 vault kernel: scsi target1:0:4: handle(0x001c), sas_address(0x3474f4f584a11c0c), phy(12)
Mar 11 22:47:07 vault kernel: scsi target1:0:4: enclosure logical id(0x3474f4f584a11c3e), slot(12)
Mar 11 22:47:07 vault kernel: scsi target1:0:4: enclosure level(0x0000), connector name( C3  )
Mar 11 22:47:07 vault kernel: sd 1:0:4:0: task abort: SUCCESS scmd(0x00000000cf5d335d)
Mar 11 22:47:07 vault kernel: sd 1:0:4:0: attempting task abort!scmd(0x0000000072a21972), outstanding for 31320 ms & timeout 30000 ms
Mar 11 22:47:07 vault kernel: sd 1:0:4:0: [sdg] tag#2466 CDB: Read(16) 88 00 00 00 00 02 d7 92 06 b8 00 00 00 08 00 00
Mar 11 22:47:07 vault kernel: scsi target1:0:4: handle(0x001c), sas_address(0x3474f4f584a11c0c), phy(12)
Mar 11 22:47:07 vault kernel: scsi target1:0:4: enclosure logical id(0x3474f4f584a11c3e), slot(12)
Mar 11 22:47:07 vault kernel: scsi target1:0:4: enclosure level(0x0000), connector name( C3  )
Mar 11 22:47:07 vault kernel: sd 1:0:4:0: No reference found at driver, assuming scmd(0x0000000072a21972) might have completed
Mar 11 22:47:07 vault kernel: sd 1:0:4:0: task abort: SUCCESS scmd(0x0000000072a21972)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:07 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 22:47:08 vault kernel: sd 1:0:4:0: Power-on or device reset occurred
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: attempting task abort!scmd(0x0000000046aceb20), outstanding for 30328 ms & timeout 30000 ms
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: [sdh] tag#2447 CDB: Write(16) 8a 00 00 00 00 06 c2 40 2c c0 00 00 00 20 00 00
Mar 11 22:47:40 vault kernel: scsi target1:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0d), phy(13)
Mar 11 22:47:40 vault kernel: scsi target1:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(13)
Mar 11 22:47:40 vault kernel: scsi target1:0:5: enclosure level(0x0000), connector name( C3  )
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: task abort: SUCCESS scmd(0x0000000046aceb20)
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: attempting task abort!scmd(0x00000000d9516d72), outstanding for 30588 ms & timeout 30000 ms
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: [sdh] tag#2446 CDB: Write(16) 8a 00 00 00 00 06 c2 40 2c e8 00 00 00 18 00 00
Mar 11 22:47:40 vault kernel: scsi target1:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0d), phy(13)
Mar 11 22:47:40 vault kernel: scsi target1:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(13)
Mar 11 22:47:40 vault kernel: scsi target1:0:5: enclosure level(0x0000), connector name( C3  )
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: No reference found at driver, assuming scmd(0x00000000d9516d72) might have completed
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: task abort: SUCCESS scmd(0x00000000d9516d72)
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: attempting task abort!scmd(0x0000000096d298f6), outstanding for 30552 ms & timeout 30000 ms
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: [sdh] tag#2445 CDB: Read(16) 88 00 00 00 00 06 92 17 80 70 00 00 00 08 00 00
Mar 11 22:47:40 vault kernel: scsi target1:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0d), phy(13)
Mar 11 22:47:40 vault kernel: scsi target1:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(13)
Mar 11 22:47:40 vault kernel: scsi target1:0:5: enclosure level(0x0000), connector name( C3  )
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: No reference found at driver, assuming scmd(0x0000000096d298f6) might have completed
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: task abort: SUCCESS scmd(0x0000000096d298f6)
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: attempting task abort!scmd(0x000000009d1dd1ff), outstanding for 30576 ms & timeout 30000 ms
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: [sdh] tag#2443 CDB: Read(16) 88 00 00 00 00 06 92 05 42 00 00 00 00 08 00 00
Mar 11 22:47:40 vault kernel: scsi target1:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0d), phy(13)
Mar 11 22:47:40 vault kernel: scsi target1:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(13)
Mar 11 22:47:40 vault kernel: scsi target1:0:5: enclosure level(0x0000), connector name( C3  )
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: No reference found at driver, assuming scmd(0x000000009d1dd1ff) might have completed
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: task abort: SUCCESS scmd(0x000000009d1dd1ff)
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: attempting task abort!scmd(0x00000000545480db), outstanding for 30568 ms & timeout 30000 ms
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: [sdh] tag#2442 CDB: Read(16) 88 00 00 00 00 06 92 15 10 98 00 00 00 08 00 00
Mar 11 22:47:40 vault kernel: scsi target1:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0d), phy(13)
Mar 11 22:47:40 vault kernel: scsi target1:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(13)
Mar 11 22:47:40 vault kernel: scsi target1:0:5: enclosure level(0x0000), connector name( C3  )
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: No reference found at driver, assuming scmd(0x00000000545480db) might have completed
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: task abort: SUCCESS scmd(0x00000000545480db)
Mar 11 22:47:40 vault kernel: sd 1:0:5:0: Power-on or device reset occurred
Mar 11 22:48:10 vault kernel: sd 1:0:5:0: attempting task abort!scmd(0x00000000b0ce8836), outstanding for 30108 ms & timeout 30000 ms
Mar 11 22:48:10 vault kernel: sd 1:0:5:0: [sdh] tag#2472 CDB: Write(16) 8a 00 00 00 00 06 c2 80 2b 00 00 00 00 40 00 00
Mar 11 22:48:10 vault kernel: scsi target1:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0d), phy(13)
Mar 11 22:48:10 vault kernel: scsi target1:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(13)
Mar 11 22:48:10 vault kernel: scsi target1:0:5: enclosure level(0x0000), connector name( C3  )
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: task abort: SUCCESS scmd(0x00000000b0ce8836)
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: attempting task abort!scmd(0x000000006ef94463), outstanding for 30384 ms & timeout 30000 ms
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: [sdh] tag#2471 CDB: Read(16) 88 00 00 00 00 06 9a 80 32 f0 00 00 00 08 00 00
Mar 11 22:48:11 vault kernel: scsi target1:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0d), phy(13)
Mar 11 22:48:11 vault kernel: scsi target1:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(13)
Mar 11 22:48:11 vault kernel: scsi target1:0:5: enclosure level(0x0000), connector name( C3  )
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: No reference found at driver, assuming scmd(0x000000006ef94463) might have completed
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: task abort: SUCCESS scmd(0x000000006ef94463)
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: attempting task abort!scmd(0x00000000896b005c), outstanding for 30384 ms & timeout 30000 ms
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: [sdh] tag#2469 CDB: Read(16) 88 00 00 00 00 06 94 d9 e7 28 00 00 00 08 00 00
Mar 11 22:48:11 vault kernel: scsi target1:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0d), phy(13)
Mar 11 22:48:11 vault kernel: scsi target1:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(13)
Mar 11 22:48:11 vault kernel: scsi target1:0:5: enclosure level(0x0000), connector name( C3  )
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: No reference found at driver, assuming scmd(0x00000000896b005c) might have completed
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: task abort: SUCCESS scmd(0x00000000896b005c)
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: attempting task abort!scmd(0x00000000d8f160ff), outstanding for 30396 ms & timeout 30000 ms
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: [sdh] tag#2468 CDB: Read(16) 88 00 00 00 00 06 94 cd be 08 00 00 00 10 00 00
Mar 11 22:48:11 vault kernel: scsi target1:0:5: handle(0x001d), sas_address(0x3474f4f584a11c0d), phy(13)
Mar 11 22:48:11 vault kernel: scsi target1:0:5: enclosure logical id(0x3474f4f584a11c3e), slot(13)
Mar 11 22:48:11 vault kernel: scsi target1:0:5: enclosure level(0x0000), connector name( C3  )
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: No reference found at driver, assuming scmd(0x00000000d8f160ff) might have completed
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: task abort: SUCCESS scmd(0x00000000d8f160ff)
Mar 11 22:48:11 vault kernel: sd 1:0:5:0: Power-on or device reset occurred
Mar 11 23:38:00 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:00 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:00 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:00 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:00 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:00 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:00 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:00 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:01 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:01 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:01 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:01 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:01 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:01 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
Mar 11 23:38:01 vault kernel: mpt3sas_cm0: log_info(0x300301e1): originator(IOP), code(0x03), sub_code(0x01e1)
I've been trying to trigger the problem and so far I am unsuccessful. I have only really tried using fio to do this, but I have tried quite a few different combinations of read/write operations, small and large blocks, etc (to a test dataset with ARC disabled) and it keeps on working fine (was streaming video while doing this). In the past, I have observed TrueNAS System Load spike to about 10 when this problem occurs. Below is the System Load while doing my testing (it's running a 1hour read test now) and it's well over 10 and everything keeps on working great. I guess I've concluded that the high system load is not causing the problem, but just a symptom of it.

1773294302295.png

I will monitor things over the next few days and see what happens. I've ordered new cables and the new HBA (won't be here for a couple weeks though) so I'll test those out once they arrive and report back.

Thanks for the help so far, appreciate it.
 
M

MBastian

Active Member
Jul 17, 2016
339
100
43
Germany
Darkwing314 said:
The user manual says the 3 ports should be labelled SAS_IN1, SAS_P1, and SAS_P2, but in reality they are labelled on the PCB as SAS1, SAS2, and SAS3. Originally I was plugged into SAS1 and SAS2 (running to C0 and C1 on the HBA) but now for testing's sake I have connected just SAS3 to C3 on the HBA
Click to expand...
Pretty sure that was the issue, looking at the dmesg output again your controller saw the same drives on C0 and C1. I never run multipath but afaik only SAS drives can deal with that and you are using SATA drives. So just connect one connector to each backplane and be done with it.
Btw: While much less power hungry than their predecessors LSI 9400-16i cards can get pretty hot without a good airflow. Without a small slow spinning fan strapped to the heatsink mine did idle at 64 °C with 12 drives connected.
 
Last edited:
D

Darkwing314

New Member
Oct 30, 2025
29
8
3
MBastian said:
Pretty sure that was the issue, looking at the dmesg output again your controller saw the same drives on C0 and C1. I never run multipath but afaik only SAS drives can deal with that and you are using SATA drives. So just connect one connector to each backplane and be done with it.
Btw: While much less power hungry than their predecessors LSI 9400-16i cards can get pretty hot without a good airflow. Without a small slow spinning fan strapped to the heatsink mine did idle at 64 °C with 12 drives connected.
Click to expand...
Where do you see them being detected twice? In any individual dmesg I only see them once (C0 originally, then C1 when I tried moving to that connector, now C3 in the latest). I have never even tried the C2 port because it has a broken retaining clip on it (on the HBA).

I've wondered about the temp of the HBA and saw reports of people adding fans. I did replace my jet engine chassis fans with some Noctua's (3000 RPM industrial ones so I still get decent airflow) and I did query the temp at some point and it was only 45C or something like that. But maybe I'll add a fan anyways and see what happens.

I can't stress enough the pattern in the timing of this issue occurring. I knew there was a bit of a pattern, but I just went through and extracted the time that the problem starts since end of Jan and those results are listed below. It is not a bit of a pattern, it's a huge one. This is every instance of the problem kicking off (usually lasts for 5-10 minutes after each time) and this cannot be a coincidence. Something is happening on a regular schedule to trigger it. I made note of when reboots happened which changes the timing. Putting these numbers in excel I can see that the shortest period (time between problem happening) is 90 minutes and in fact literally EVERY instance of the 127 listed here it happens on a multiple of 90 minutes from a few minutes after the last reboot time. it NEVER happens 2 hours after it happened before. Or 4 hours. Or 10 hours. Always 1.5, 3, 4.5, 6, 7.5, 9, etc hours later.

Is it something in TrueNAS or the HBA driver that is running on a 90 minute schedule and causing this? How would I go about figuring that out?

Code: 
Jan 27 07:44:28 <- Previous reboot was @ Jan 25 16:40
Jan 28 15:14:32
Jan 28 21:14:30
Jan 29 00:14:31
Jan 29 04:44:31
Jan 29 07:44:32
Jan 29 13:44:33
Jan 29 15:14:33
Jan 30 09:14:38
Jan 30 18:14:37
Jan 31 13:44:39
Feb  1 22:44:43
Feb  2 10:44:46
Feb  2 15:14:45
Feb  3 19:44:46
Feb  4 22:44:50
Feb  6 18:14:55
Feb  6 22:44:56
Feb  7 00:14:57
Feb  7 16:44:57
Feb  7 19:44:56
Feb  7 21:14:57
Feb  7 22:44:57
Feb  8 00:14:58
Feb  8 01:44:57
Feb  8 03:14:57
Feb  8 04:44:58
Feb  8 06:14:58
Feb  8 07:44:57
Feb  8 09:14:57
Feb  8 10:44:58
Feb  8 12:14:59
Feb  8 13:44:57
Feb  8 22:45:01
Feb  9 15:15:03
Feb  9 22:45:04
Feb 12 06:15:07
Feb 12 19:45:12
Feb 12 21:15:12
Feb 14 15:15:16
Feb 14 19:45:16
Feb 15 12:15:20
Feb 16 07:45:19
Feb 16 10:45:19
Feb 17 06:15:21
Feb 17 09:15:21
Feb 19 01:45:26
Feb 19 04:45:30
Feb 19 06:15:30
Feb 19 15:15:27
Feb 19 19:45:29
Feb 20 09:15:32
Feb 20 10:45:33
Feb 20 12:15:33
Feb 20 13:45:34
Feb 20 19:45:32
Feb 20 22:45:35
Feb 21 01:45:32
Feb 21 03:15:33
Feb 21 06:15:34
Feb 21 07:45:35
Feb 21 09:15:35
Feb 21 10:45:36
Feb 21 16:45:36
Feb 21 18:15:33
Feb 21 21:15:38
Feb 21 22:45:36
Feb 22 00:15:37
Feb 22 03:15:37
Feb 22 04:45:35
Feb 22 06:15:35
Feb 22 12:15:38
Feb 22 13:45:36
Feb 22 19:45:36
Feb 22 23:54:17 <- Reboot @ 23:52
Feb 23 11:56:16
Feb 23 13:26:17
Feb 23 20:56:15
Feb 23 22:26:20
Feb 24 05:56:19
Feb 24 07:26:17
Feb 24 20:56:20
Feb 25 13:26:21
Feb 25 17:56:22
Feb 25 20:56:21
Feb 26 04:26:22
Feb 26 07:26:23
Feb 26 14:56:24
Feb 27 01:26:24
Feb 27 05:56:26
Feb 27 11:56:26
Feb 28 02:56:28
Feb 28 08:56:30
Feb 28 17:56:30
Feb 28 19:26:30
Feb 28 22:26:29
Mar  1 02:56:32
Mar  1 08:56:33
Mar  1 11:56:32
Mar  1 16:26:32
Mar  2 01:26:35
Mar  2 02:56:34
Mar  2 04:26:35
Mar  2 10:26:35
Mar  2 13:26:34
Mar  2 22:26:35
Mar  2 23:04:25 <- Reboot @ 23:02
Mar  3 09:36:23
Mar  3 11:06:24
Mar  4 09:36:29
Mar  5 02:06:31
Mar  5 05:06:30
Mar  7 21:36:34
Mar  8 12:06:37
Mar  8 18:06:38
Mar  9 22:36:40
Mar  9 23:48:04 <- Reboot @ 23:45
Mar 10 18:00:39 <- Reboot @ 17:58
Mar 11 00:38:40
Mar 11 01:08:03
Mar 11 09:44:52 <- Reboot @ 09:42
Mar 11 21:46:49 <- Reboot @ 22:43
Mar 11 22:46:01
Mar 12 00:16:59
Mar 12 03:17:58
Mar 12 06:17:59
Mar 12 07:47:59
 

Attachments

M

MBastian

Active Member
Jul 17, 2016
339
100
43
Germany
I stand corrected, I should not look at logs before my first morning coffee. So the issue was not fixed? Well, if you did not already tried: Move your disks to the second backplane, remove all connections to the first one.
Did you had a look in your journald logs? Maybe it's a periodic cron job that triggers the issue.
 
Last edited:
You must log in or register to reply here.
Top Bottom