Problem between a P2000 G3 and a 9200-8e

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
I am trying to connect an HP P2000 G3 to an HP DL380 G7 server running Ubuntu Bionic through an HP SC08e HBA (LSI 9200-8e). I can see the disks from the server:
charles@hpdl380g72:~$ lsscsi -g -s
[0:0:0:0] cd/dvd TEAC DV-28S-W C.2D /dev/sr0 /dev/sg0 -
[2:0:0:0] disk ATA Kingston SHPM228 L5TM /dev/sde /dev/sg6 240GB
[3:0:0:0] storage HP P410i 5.14 - /dev/sg1 -
[3:1:0:0] disk HP LOGICAL VOLUME 5.14 /dev/sda /dev/sg2 146GB
[3:1:0:1] disk HP LOGICAL VOLUME 5.14 /dev/sdb /dev/sg3 299GB
[3:1:0:2] disk HP LOGICAL VOLUME 5.14 /dev/sdc /dev/sg4 1.00TB
[3:1:0:3] disk HP LOGICAL VOLUME 5.14 /dev/sdd /dev/sg5 600GB
[4:0:0:0] enclosu HP P2000 G3 SAS T252 - /dev/sg7 -
[4:0:0:1] disk HP P2000 G3 SAS T252 /dev/sdf /dev/sg8 298GB
[4:0:0:2] disk HP P2000 G3 SAS T252 /dev/sdg /dev/sg9 3.99TB​
But when I try to write the GPT label with parted, It times out and I get error messages in my logs:
charles@hpdl380g72:~$ sudo parted /dev/sdf
GNU Parted 3.2
Using /dev/sdf
Welcome to GNU Parted! Type 'help' to view a list of commands.
(parted) mklabel gpt
Error: Input/output error during write on /dev/sdf
Retry/Ignore/Cancel? Cancel
(parted) quit

Feb 27 15:17:02 hpdl380g72 kernel: [ 551.603120] scsi 4:0:0:1: Direct-Access HP P2000 G3 SAS T252 PQ: 0 ANSI: 5
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.603135] scsi 4:0:0:1: SSP: handle(0x0009), sas_addr(0x500c0ff133ae4000), phy(0), device_name(0x0000000000000000)
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.603139] scsi 4:0:0:1: enclosure logical id (0x500605b004417760), slot(0)
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.603268] scsi 4:0:0:1: Power-on or device reset occurred
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.603861] scsi 4:0:0:1: alua: supports implicit TPGS
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.603867] scsi 4:0:0:1: alua: device naa.600c0ff000139645bd43755c01000000 port group 0 rel port 1
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.604432] sd 4:0:0:1: Attached scsi generic sg8 type 0
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.604782] sd 4:0:0:1: [sdf] 583984256 512-byte logical blocks: (299 GB/278 GiB)
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.604852] sd 4:0:0:1: [sdf] Write Protect is off
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.604855] sd 4:0:0:1: [sdf] Mode Sense: d7 00 00 08
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.604992] sd 4:0:0:1: [sdf] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.612603] sd 4:0:0:1: alua: transition timeout set to 60 seconds
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.612608] sd 4:0:0:1: alua: port group 00 state A preferred supports tOlusNA
Feb 27 15:17:02 hpdl380g72 kernel: [ 551.645504] sd 4:0:0:1: [sdf] Attached SCSI disk
Feb 27 15:17:02 hpdl380g72 multipathd[1063]: sdf: add path (uevent)
Feb 27 15:17:53 hpdl380g72 kernel: [ 603.112237] sd 4:0:0:1: attempting task abort! scmd(0000000066bff89f)
Feb 27 15:17:53 hpdl380g72 kernel: [ 603.112244] sd 4:0:0:1: [sdf] tag#1 CDB: Write(10) 2a 00 22 ce e4 68 00 00 18 00
Feb 27 15:17:53 hpdl380g72 kernel: [ 603.112248] scsi target4:0:0: handle(0x0009), sas_address(0x500c0ff133ae4000), phy(0)
Feb 27 15:17:53 hpdl380g72 kernel: [ 603.112250] scsi target4:0:0: enclosure logical id(0x500605b004417760), slot(0)
Feb 27 15:17:53 hpdl380g72 kernel: [ 603.113644] sd 4:0:0:1: task abort: SUCCESS scmd(0000000066bff89f)
Feb 27 15:17:53 hpdl380g72 kernel: [ 603.113659] sd 4:0:0:1: attempting task abort! scmd(00000000280ba9db)
Feb 27 15:17:53 hpdl380g72 kernel: [ 603.113664] sd 4:0:0:1: [sdf] tag#0 CDB: Write(10) 2a 00 00 00 00 00 00 00 18 00
Feb 27 15:17:53 hpdl380g72 kernel: [ 603.113667] scsi target4:0:0: handle(0x0009), sas_address(0x500c0ff133ae4000), phy(0)
Feb 27 15:17:53 hpdl380g72 kernel: [ 603.113670] scsi target4:0:0: enclosure logical id(0x500605b004417760), slot(0)
Feb 27 15:17:53 hpdl380g72 kernel: [ 603.114855] sd 4:0:0:1: task abort: SUCCESS scmd(00000000280ba9db)
Feb 27 15:18:24 hpdl380g72 kernel: [ 633.836241] sd 4:0:0:1: attempting device reset! scmd(00000000280ba9db)
Feb 27 15:18:24 hpdl380g72 kernel: [ 633.836247] sd 4:0:0:1: [sdf] tag#0 CDB: Write(10) 2a 00 00 00 00 00 00 00 18 00
Feb 27 15:18:24 hpdl380g72 kernel: [ 633.836250] scsi target4:0:0: handle(0x0009), sas_address(0x500c0ff133ae4000), phy(0)
Feb 27 15:18:24 hpdl380g72 kernel: [ 633.836252] scsi target4:0:0: enclosure logical id(0x500605b004417760), slot(0)
Feb 27 15:18:24 hpdl380g72 kernel: [ 633.838636] sd 4:0:0:1: device reset: SUCCESS scmd(00000000280ba9db)
Feb 27 15:18:24 hpdl380g72 kernel: [ 633.838810] sd 4:0:0:1: Power-on or device reset occurred
Feb 27 15:18:41 hpdl380g72 mpt-statusd: detected non-optimal RAID status
Feb 27 15:18:41 hpdl380g72 mpt-statusd: detected non-optimal RAID status
Feb 27 15:18:41 hpdl380g72 mpt-statusd: detected non-optimal RAID status
Feb 27 15:18:57 hpdl380g72 kernel: [ 666.612075] sd 4:0:0:1: attempting device reset! scmd(0000000066bff89f)
Feb 27 15:18:57 hpdl380g72 kernel: [ 666.612270] sd 4:0:0:1: [sdf] tag#0 CDB: Write(10) 2a 00 22 ce e4 68 00 00 18 00
Feb 27 15:18:57 hpdl380g72 kernel: [ 666.612274] scsi target4:0:0: handle(0x0009), sas_address(0x500c0ff133ae4000), phy(0)
Feb 27 15:18:57 hpdl380g72 kernel: [ 666.612276] scsi target4:0:0: enclosure logical id(0x500605b004417760), slot(0)
Feb 27 15:18:57 hpdl380g72 kernel: [ 666.614703] sd 4:0:0:1: device reset: SUCCESS scmd(0000000066bff89f)
Feb 27 15:18:57 hpdl380g72 kernel: [ 666.614873] sd 4:0:0:1: Power-on or device reset occurred
Feb 27 15:19:27 hpdl380g72 kernel: [ 697.340357] sd 4:0:0:1: attempting device reset! scmd(00000000280ba9db)
Feb 27 15:19:27 hpdl380g72 kernel: [ 697.340361] sd 4:0:0:1: [sdf] tag#0 CDB: Write(10) 2a 00 00 00 00 00 00 00 18 00
Feb 27 15:19:27 hpdl380g72 kernel: [ 697.340364] scsi target4:0:0: handle(0x0009), sas_address(0x500c0ff133ae4000), phy(0)
Feb 27 15:19:27 hpdl380g72 kernel: [ 697.340366] scsi target4:0:0: enclosure logical id(0x500605b004417760), slot(0)
Feb 27 15:19:27 hpdl380g72 kernel: [ 697.342746] sd 4:0:0:1: device reset: SUCCESS scmd(00000000280ba9db)
Feb 27 15:19:27 hpdl380g72 kernel: [ 697.342914] sd 4:0:0:1: Power-on or device reset occurred
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980299] INFO: task parted:16680 blocked for more than 120 seconds.
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980495] Tainted: P IOE 4.15.0-45-generic #48-Ubuntu
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980692] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980918] parted D 0 16680 16679 0x00000000
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980922] Call Trace:
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980932] __schedule+0x291/0x8a0
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980935] schedule+0x2c/0x80
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980940] io_schedule+0x16/0x40
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980944] wait_on_page_bit_common+0xd8/0x160
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980947] ? page_cache_tree_insert+0xe0/0xe0
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980950] __filemap_fdatawait_range+0xfa/0x160
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980955] filemap_write_and_wait+0x4d/0x90
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980959] sync_blockdev.part.32+0x16/0x20
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980961] fsync_bdev+0x2c/0x60
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980966] blkdev_ioctl+0x662/0x970
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980969] block_ioctl+0x3d/0x50
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980973] do_vfs_ioctl+0xa8/0x630
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980976] ? __fput+0x193/0x220
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980979] SyS_ioctl+0x79/0x90
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980984] do_syscall_64+0x73/0x130
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980988] entry_SYSCALL_64_after_hwframe+0x3d/0xa2
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980991] RIP: 0033:0x7f95e1c845d7
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980993] RSP: 002b:00007fffc78007d8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980995] RAX: ffffffffffffffda RBX: 000055dc28fcf8f0 RCX: 00007f95e1c845d7
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980997] RDX: 0000000000000000 RSI: 0000000000001261 RDI: 0000000000000003
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.980998] RBP: 000055dc28fc5950 R08: 00007f95e2835540 R09: 0000000000000000
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.981000] R10: 00007f95e1d0ccc0 R11: 0000000000000246 R12: 000055dc28fc5950
Feb 27 15:19:56 hpdl380g72 kernel: [ 725.981001] R13: 0000000000000000 R14: 0000000000000100 R15: 000055dc28fc2b20
Feb 27 15:19:58 hpdl380g72 kernel: [ 728.044058] sd 4:0:0:1: attempting device reset! scmd(0000000066bff89f)
Feb 27 15:19:58 hpdl380g72 kernel: [ 728.044065] sd 4:0:0:1: [sdf] tag#0 CDB: Write(10) 2a 00 22 ce e4 68 00 00 18 00
Feb 27 15:19:58 hpdl380g72 kernel: [ 728.044069] scsi target4:0:0: handle(0x0009), sas_address(0x500c0ff133ae4000), phy(0)
Feb 27 15:19:58 hpdl380g72 kernel: [ 728.044071] scsi target4:0:0: enclosure logical id(0x500605b004417760), slot(0)
Feb 27 15:19:58 hpdl380g72 kernel: [ 728.046482] sd 4:0:0:1: device reset: SUCCESS scmd(0000000066bff89f)
Feb 27 15:19:58 hpdl380g72 kernel: [ 728.046649] sd 4:0:0:1: Power-on or device reset occurred
Feb 27 15:20:05 hpdl380g72 systemd-timesyncd[1560]: Timed out waiting for reply from 49.212.186.27:123 (49.212.186.27).
Feb 27 15:20:16 hpdl380g72 systemd-timesyncd[1560]: Timed out waiting for reply from 122.215.240.76:123 (122.215.240.76).
Feb 27 15:20:26 hpdl380g72 systemd-timesyncd[1560]: Timed out waiting for reply from 106.185.48.114:123 (106.185.48.114).
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.764241] sd 4:0:0:1: attempting device reset! scmd(00000000280ba9db)
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.764248] sd 4:0:0:1: [sdf] tag#0 CDB: Write(10) 2a 00 00 00 00 00 00 00 18 00
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.764251] scsi target4:0:0: handle(0x0009), sas_address(0x500c0ff133ae4000), phy(0)
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.764253] scsi target4:0:0: enclosure logical id(0x500605b004417760), slot(0)
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.766630] sd 4:0:0:1: device reset: SUCCESS scmd(00000000280ba9db)
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.766797] sd 4:0:0:1: Power-on or device reset occurred
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.766876] sd 4:0:0:1: [sdf] tag#0 FAILED Result: hostbyte=DID_RESET driverbyte=DRIVER_OK
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.766880] sd 4:0:0:1: [sdf] tag#0 CDB: Write(10) 2a 00 00 00 00 00 00 00 18 00
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.766883] print_req_error: I/O error, dev sdf, sector 0
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.767046] Buffer I/O error on dev sdf, logical block 0, lost async page write
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.767265] Buffer I/O error on dev sdf, logical block 1, lost async page write
Feb 27 15:20:29 hpdl380g72 kernel: [ 758.767648] Buffer I/O error on dev sdf, logical block 2, lost async page write​

I have been working on this issue for a while, went through 4 HBAs, reflashed the BIOS and firmware of the HBAs, used different cables but still I can't find the reason why. From the SAN point of view, everything is fine, no warnings or errors. I have no problem connecting to a DAS enclosure with these HBAs.
Any thought/help welcome!
Thanks!
Charles