ESXi 5.5 GuestOS losing connection to PCI passthrough RAID (IBM m5014) drives

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
D

DouglasABaker

New Member
Mar 6, 2022
6
0
1
Hi all,

I've been browsing for a long time as I try to keep things stable, but have run into a troubleshooting issue I can't seem to diagnose, so would appreciate any insight you all may provide.

The short version is that my Windows Home Server (WHS2011) is losing visibility to the drives on an IBM m5014 RAID card operating in passthrough mode. It has been stable for years - this problem just started last week.

System details (yes, I know everything is old and outdated - I try not to fix things that aren't broken if I don't have to):
ESXi 5.5u2 running off a PNY 128GB USB stick
Physical setup is an 8 core processor
Drives:
1 240GB SSD running off the motherboard SATA as a datastore
1 IBM m5015 hosting a pair of 256GB SSD in RAID1, also as a datastore
1 IBM m5014 hosting 4 2GB WD Red in RAID 10 ("Storage"), and with an attached HBA hosting 4 4GB WD Red in RAID 10 ("Videos") - this adapter is operating in passthrough mode (and has been)

I have multiple guests:
WHS2011 which serves the home Plex, shared drives, etc
Windows 95 to allow access to old vehicle diagnostics
and a couple others, but all are irrelevant except the WHS2011

The system is stable EXCEPT for the problem with the m5014 on the WHS guest.

The WHS2011 is obviously the only guest with access to the m5014.
Current symptoms:
Drives (both "Storage" and "Videos") disappear during use. By disappear I mean they are no longer available on the network AND that MegaRAID storage manager shows 0 drives. Note that is DOES still see the m5014, just with nothing attached.

Rebooting the server solves the problem for 15-30 minutes until they drop again. It is unclear to me if this is usage related or time related.

Booting directly into WebBIOS yields no issues with the drives or arrays - they pass consistency checks and there are no substantive errors in the error log outside of a couple of "Unexpected Sense", but there does not appear to be a correlation between the drives dropping and the Unexpected Sense.

Things I have tried:
All Guests WERE hosted on the m5015 datastore. I have moved them all to the 240GB datastore. No change in issue
I have a backup USB drive for ESXi itself - no change in issue
Read through all MegaRAID logs - nothing substantive
Tried to read through the ESXi logs, but honestly, I just don't understand them or even which to read. Happy to post anything useful.

Any and all thoughts are welcome; it seems like I should get another RAID card since they are pretty cheap, but hate just throwing parts at a problem without a diagnosis (plus I'm a bit scared of losing my data during the foreign array import)

Thanks in advance!

Doug
 
D

DouglasABaker

New Member
Mar 6, 2022
6
0
1
As a secondary update, last night the server itself became unresponsive - no connections to guests, no ability to manipulate through vSphere, and unresponsive to direct input through the DCUI. This leans toward either corruption of the OS or an underlying hardware challenge in my mind, but would appreciate other thoughts. My research also suggested that log files that were too large might cause this challenge as well.

Thanks in advance everyone!

Doug
 
D

DouglasABaker

New Member
Mar 6, 2022
6
0
1
Looking in syslog, I see the following for the failure last night (actually all I see a series of these errors repeated starting at 2:11:13 - it appears to have filled the entire syslog).

I appears that one of the RAID cards is not responding, but how can I determine which one is sfcb-LSIESG_SMIS13_HHR[35272]? And how do I determine why (bad card, bad NIC, something else)?

Thanks!

Code: 
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getLDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StorageVolumeOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonLD() Failed!
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getBBUStatus, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL BBU::refresh: Failed BBUStatus
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getBBUCapacityInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL BBU::refresh:Failed CapacityInfo
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getBBUDesignInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL BBU::refresh:Failed DesignInfo
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getBBUProperties, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL BBU::refresh:Failed Properties
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getBBUFRUInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL BBU::refresh:Failed BBU FRU Properties
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getBBUStatus, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::fireDCMDPassthru, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getLDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StorageVolumeOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonLD() Failed!
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::fireDCMDPassthru, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:20Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getLDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StorageVolumeOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonLD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::fireDCMDPassthru, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getLDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StorageVolumeOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonLD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::fireDCMDPassthru, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getLDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StorageVolumeOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonLD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::fireDCMDPassthru, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getLDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StorageVolumeOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonLD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getLDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StorageVolumeOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonLD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::getPDAllowedOperations, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL DiskDriveOperationalCapabilitiesProvider::populateNonKeyAttributes getAllowedOperationsonPD() Failed!
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::fireDCMDPassthru, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::fireDCMDPassthru, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
2022-03-07T02:49:21Z sfcb-LSIESG_SMIS13_HHR[35272]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacadeMR::getPatrolReadStatusInfo, ProcessLibCommandCall failed, returnValue = 0x8017
 
D

DouglasABaker

New Member
Mar 6, 2022
6
0
1
If I jump to the log from this morning, when I rebooted, I get the following. I've pulled out the major errors that I'll be looking into, but included the whole boot sequence (sorry if I should be doing something else - it appears this is how folks post partial logs):

It appears I lost my 256GB SSD RAID 1 on the m5015 RAID - it is no longer listed in the datastores, nor is hba32 listed in the adapters. When I reboot to MSM, all the drives are there just fine...
2022-03-07T15:03:10Z jumpstart: StorageInfo: Unable to name LUN mpx.vmhba32:C0:T0:L0. Cannot set display name on this device. Unable to guarantee name will not change across reboots or media change.
2022-03-07T15:03:10Z jumpstart: StorageInfo: Unable to name LUN mpx.vmhba32:C0:T0:L0. Cannot set display name on this device. Unable to guarantee name will not change across reboots or media change.

Some sort of sensord ipmi error? Potentially related to the above?
2022-03-07T15:03:18Z root: init Running sensord start
2022-03-07T15:03:18Z watchdog-sensord: [33849] Begin '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000, bg_pid_file = ''
2022-03-07T15:03:18Z watchdog-sensord: Executing '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l'
2022-03-07T15:03:18Z sensord: Warning: failed to open ipmi device: No such file or dir
2022-03-07T15:03:19Z watchdog-sensord: '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l' exited after 0 seconds (quick failure 1) 0
2022-03-07T15:03:19Z watchdog-sensord: Executing '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l'
2022-03-07T15:03:19Z sensord: Warning: failed to open ipmi device: No such file or dir
2022-03-07T15:03:19Z watchdog-sensord: '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l' exited after 0 seconds (quick failure 2) 0
2022-03-07T15:03:19Z watchdog-sensord: End '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l', failure limit reached
2022-03-07T15:03:29Z watchdog-sensord: Unable to verify sensord started after 10 seconds

Not sure why the host name is not found, but these occur multiple times:
2022-03-07T15:03:37Z ntpd_intres[34240]: host name not found: time.nist.gov
2022-03-07T15:03:37Z ntpd_intres[34240]: host name not found: pool.ntp.otg

An snmpd error:
022-03-07T15:03:43Z snmpd: fetch_fixed_disk_status: fetch VSI_NODE_storage_scsifw_devices_smart_healthStatus(mpx.vmhba32:C0:T0:L0) failed Not supported, reporting unknown status
2022-03-07T15:03:43Z snmpd: fetch_device_sensors: open device '/dev/ipmi0' failed 2 No such file or directory, device sensors offline
2022-03-07T15:03:44Z snmpd: cache_insert_object: no invalidation method specified for key:hrmib
2022-03-07T15:03:44Z snmpd: cache_insert_object: no invalidation method specified for key:lldpmib
2022-03-07T15:03:44Z snmpd: load_def_router: getaddrinfo('') failed -2 Name or service not known, ignoring
2022-03-07T15:03:44Z snmpd: mac_string_to_binary: unable to parse VSI mac address ''
2022-03-07T15:03:44Z snmpd: load_arp_nd: no nd neighbors found
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba38, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba0, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba3, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba32, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba33, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba34, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba35, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba36, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba37, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: cache_insert_object: no invalidation method specified for key:vmwmib
2022-03-07T15:03:44Z snmpd: agent disabled by configuration, shutting down
2022-03-07T15:03:44Z snmpd: snmpd: install_configuration failed. Continuing anyway.

and lastly, some LSI errors again:
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StorelibAdapter::getFacadeInstance - controllerList for storelib is empty
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::initLib, ProcessLibCommandCall failed, returnValue = 0x8002
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StoreLibFacadeIR::Constructor: init library failed
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StorelibAdapter::getFacadeInstance - controllerList for storelibir is empty
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::initLib, ProcessLibCommandCall failed, returnValue = 0x8002
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StoreLibFacadeIT1::Constructor: init library failed
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StorelibAdapter::getFacadeInstanceIT1 - controllerList for storelibit is empty
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StorelibAdapter::getFacadeInstanceIR2 - getFacadeInstance for storelibir2
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StorelibAdapter::getFacadeInstanceIR2 - controllerList for storelibir2 is empty

These are what I'll be researching, but hoping someone can give me some shortcut interpretations!

Doug

Code: 
2022-03-07T15:02:39Z watchdog-vobd: [33219] Begin '/usr/lib/vmware/vob/bin/vobd group=vobd', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000000, bg_pid_file = ''
2022-03-07T15:02:39Z watchdog-vobd: Executing '/usr/lib/vmware/vob/bin/vobd group=host/vim/vmvisor/vobd'
2022-03-07T15:02:40Z jumpstart: restoring configuration
2022-03-07T15:02:40Z jumpstart: extracting from file /local.tgz
2022-03-07T15:02:40Z jumpstart: ConfigCheck: Running ipv6 option upgrade, redundantly
2022-03-07T15:02:40Z jumpstart: Util: tcpip4 IPv6 enabled
2022-03-07T15:02:40Z watchdog-vmkeventd: [33261] Begin '/usr/lib/vmware/vmkeventd/bin/vmkeventd ++group=vmkeventd -t', min-uptime = 10, max-quick-failures = 5, max-total-failures = 9999999, bg_pid_file = ''
2022-03-07T15:02:40Z watchdog-vmkeventd: Executing '/usr/lib/vmware/vmkeventd/bin/vmkeventd ++group=host/vim/vmvisor/vmkeventd -t'
2022-03-07T15:02:42Z vmkmicrocode: File microcode_amd_0x100fa0.bin does not contain a valid microcode update for any of the processors
2022-03-07T15:02:42Z vmkmicrocode: Directory /etc/vmware/microcode/ does not contain a valid microcode update for this processor
2022-03-07T15:02:42Z jumpstart: Using policy dir /etc/vmware/secpolicy
2022-03-07T15:02:42Z jumpstart: Parsed all objects
2022-03-07T15:02:42Z jumpstart: Objects defined and obsolete objects removed
2022-03-07T15:02:42Z jumpstart: Parsed all domain names
2022-03-07T15:02:42Z jumpstart: Domains defined and obsolete domains removed
2022-03-07T15:02:42Z jumpstart: Domain policies parsed and syntax validated
2022-03-07T15:02:42Z jumpstart: Constraints check for domain policies succeeded
2022-03-07T15:02:42Z jumpstart: Domain policies set
2022-03-07T15:02:42Z jumpstart: Parsed all the tardisk policy files
2022-03-07T15:02:42Z jumpstart: Set all the tardisk labels and policy
2022-03-07T15:02:42Z jumpstart: Parsed all file label mappings
2022-03-07T15:02:42Z jumpstart: Set all file labels
2022-03-07T15:02:42Z jumpstart: System security policy has been set successfully
2022-03-07T15:02:43Z jumpstart: Starting vmkdevmgr
2022-03-07T15:02:44Z jumpstart: NetworkingLoad.cc:LoadDrivers
2022-03-07T15:02:46Z jumpstart: LoadVmklinuxDriver: Loaded module e1000
2022-03-07T15:02:52Z watchdog-net-lacp: [33409] Begin '/usr/sbin/net-lacp ++group=lacpd', min-uptime = 1000, max-quick-failures = 100, max-total-failures = 100, bg_pid_file = ''
2022-03-07T15:02:52Z watchdog-net-lacp: Executing '/usr/sbin/net-lacp ++group=host/vim/vmvisor/lacpd'
2022-03-07T15:02:53Z jumpstart: execution of 'system module load --module iscsi_linux' failed in context storage-drivers[start]': unknown module 'iscsi_linux'
2022-03-07T15:02:58Z jumpstart: LoadVmklinuxDriver: Loaded module ahci
2022-03-07T15:03:02Z jumpstart: NetworkInfoImpl: Enabling 1 netstack instances during boot
2022-03-07T15:03:02Z jumpstart: VmKernelNicInfo::LoadConfig: Storing previous management interface:'vmk0'
2022-03-07T15:03:02Z jumpstart: VmKernelNicInfo::LoadConfig: Processing config for'vmk0'
2022-03-07T15:03:02Z jumpstart: GetManagementInterface: Tagging vmk0 as Management
2022-03-07T15:03:02Z jumpstart: SetTaggedManagementInterface: Writing vmk0 to the ManagementIface node
2022-03-07T15:03:02Z jumpstart: GetManagementInterface: Tagging vmk0 as Management
2022-03-07T15:03:02Z jumpstart: SetTaggedManagementInterface: Writing vmk0 to the ManagementIface node
2022-03-07T15:03:02Z jumpstart: RoutingInfo: LoadConfig called on RoutingInfo
2022-03-07T15:03:02Z jumpstart: GetManagementInterface: Tagging vmk0 as Management
2022-03-07T15:03:02Z jumpstart: SetTaggedManagementInterface: Writing vmk0 to the ManagementIface node
2022-03-07T15:03:02Z jumpstart: VmkNic::Enable: netstack:'defaultTcpipStack', interface:'vmk0', portStr:'Management Network'
2022-03-07T15:03:02Z jumpstart: RoutingInfo: LoadConfig called on RoutingInfo
2022-03-07T15:03:02Z jumpstart: GetManagementInterface: Tagging vmk0 as Management
2022-03-07T15:03:02Z jumpstart: SetTaggedManagementInterface: Writing vmk0 to the ManagementIface node
2022-03-07T15:03:02Z jumpstart: No iBFT data present in the BIOS
2022-03-07T15:03:10Z jumpstart: StorageInfo: Unable to name LUN mpx.vmhba32:C0:T0:L0. Cannot set display name on this device.  Unable to guarantee name will not change across reboots or media change.
2022-03-07T15:03:10Z jumpstart: StorageInfo: Unable to name LUN mpx.vmhba32:C0:T0:L0. Cannot set display name on this device.  Unable to guarantee name will not change across reboots or media change.
2022-03-07T15:03:10Z jumpstart: VsanDevel: DevelBootDelay: 0
2022-03-07T15:03:10Z jumpstart: VsanDevel: DevelWipeDisksOnBoot:
2022-03-07T15:03:10Z jumpstart: VsanDevel: DevelWipeConfigOnBoot: 0
2022-03-07T15:03:10Z jumpstart: VsanDevel: DevelTagSSD: Starting
2022-03-07T15:03:10Z jumpstart: VsanDevel: DevelTagSSD: Done.
2022-03-07T15:03:10Z jumpstart: current bootstate: BOOT_STATE_VALID
2022-03-07T15:03:11Z jumpstart: using /vmfs/volumes/54a2c1b5-4a44312c-90de-000e04145641/.locker as /scratch
2022-03-07T15:03:11Z jumpstart: Using /locker/packages/5.5.0 as /productLocker
2022-03-07T15:03:11Z jumpstart: using /store as /locker
2022-03-07T15:03:12Z jumpstart: VmkCtl: Diagnostic partition configured with appropriate space; not auto creating Diagnostic File
2022-03-07T15:03:12Z jumpstart: execution of 'system coredump file set --enable=true --smart' failed in context dump-file[start]': Unable to smart activate a dump file.  Error was: No suitable diagnostic file found.
2022-03-07T15:03:12Z jumpstart: VmFileSystem: Fs Info from fsswitch
2022-03-07T15:03:12Z jumpstart: VmFileSystem: uuid:54a2c1b5-4a44312c-90de-000e04145641, Label:240GB-SSD,logicalDevice:54a2c17d-d7b9595b-3929-000e04145641, headExtent:t10.ATA_____SSD2SC240GD2DH16T2DT_____________________PNY13320000280890706:1
2022-03-07T15:03:12Z jumpstart: VmFileSystem: Fs Info from UnresolvedVmfsVolume
2022-03-07T15:03:12Z jumpstart: VmFileSystem: Fs Info from fsswitch
2022-03-07T15:03:12Z jumpstart: VmFileSystem: uuid:54a2c1b5-4a44312c-90de-000e04145641, Label:240GB-SSD,logicalDevice:54a2c17d-d7b9595b-3929-000e04145641, headExtent:t10.ATA_____SSD2SC240GD2DH16T2DT_____________________PNY13320000280890706:1
2022-03-07T15:03:12Z jumpstart: VmFileSystem: Fs Info from UnresolvedVmfsVolume
2022-03-07T15:03:12Z crond[33612]: crond: crond (busybox 1.20.2) started, log level 8
2022-03-07T15:03:12Z init: starting pid 33613, tty '': '/bin/services.sh start'
2022-03-07T15:03:12Z root: init Running vsantraced start
2022-03-07T15:03:12Z vsantraced: Storing traces to /scratch/vsantraces
2022-03-07T15:03:12Z watchdog-vsantraced: [33647] Begin '/bin/chardevlogger ++group=host/vim/vmvisor/vsantraced -o -R timestamp -S 64 -z3 -m 8 -s 200 -n vsantraced /dev/vsanTraces "/scratch/vsantraces/vsantraces"', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000000, bg_pid_file = ''
2022-03-07T15:03:12Z watchdog-vsantraced: Executing '/bin/chardevlogger ++group=host/vim/vmvisor/vsantraced -o -R timestamp -S 64 -z3 -m 8 -s 200 -n vsantraced /dev/vsanTraces "/scratch/vsantraces/vsantraces"'
2022-03-07T15:03:13Z watchdog-vsantracedUrgen: [33676] Begin '/bin/chardevlogger ++group=host/vim/vmvisor/vsantraced -o -R timestamp -S 64 -z3 -m 4 -s 100 -n vsantracedUrgen /dev/vsanTracesUrgent "/scratch/vsantraces/vsantracesUrgent"', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000000, bg_pid_file = ''
2022-03-07T15:03:14Z watchdog-vsantracedUrgen: Executing '/bin/chardevlogger ++group=host/vim/vmvisor/vsantraced -o -R timestamp -S 64 -z3 -m 4 -s 100 -n vsantracedUrgen /dev/vsanTracesUrgent "/scratch/vsantraces/vsantracesUrgent"'
2022-03-07T15:03:14Z root: init Running ntpd start
2022-03-07T15:03:15Z root: ntpd Starting ntpd
2022-03-07T15:03:15Z watchdog-ntpd: [33716] Begin '/sbin/ntpd ++group=ntpd -g -n -c /etc/ntp.conf -f /etc/ntp.drift', min-uptime = 60, max-quick-failures = 1, max-total-failures = 100, bg_pid_file = ''
2022-03-07T15:03:15Z watchdog-ntpd: Executing '/sbin/ntpd ++group=host/vim/vmvisor/ntpd -g -n -c /etc/ntp.conf -f /etc/ntp.drift'
2022-03-07T15:03:15Z ntpd[33739]: ntpd 4.2.6p2@1.2194-o Tue Jan 21 05:49:29 UTC 2014 (1)
2022-03-07T15:03:15Z ntpd[33739]: proto: precision = 0.543 usec
2022-03-07T15:03:15Z ntpd[33739]: Listen and drop on 0 v4wildcard 0.0.0.0 UDP 123
2022-03-07T15:03:15Z ntpd[33739]: Listen and drop on 1 v6wildcard :: UDP 123
2022-03-07T15:03:15Z ntpd[33739]: Listen normally on 2 lo0 127.0.0.1 UDP 123
2022-03-07T15:03:15Z ntpd[33739]: Listen normally on 3 vmk0 192.168.17.5 UDP 123
2022-03-07T15:03:15Z ntpd[33739]: Listen normally on 4 lo0 ::1 UDP 123
2022-03-07T15:03:15Z ntpd[33739]: Listen normally on 5 lo0 fe80::1 UDP 123
2022-03-07T15:03:15Z ntpd[33739]: Listen normally on 6 vmk0 fe80::20e:4ff:fe14:5641 UDP 123
2022-03-07T15:03:16Z root: init Running ESXShell start
2022-03-07T15:03:16Z root: init Running SSH start
2022-03-07T15:03:16Z root: init Running DCUI start
2022-03-07T15:03:16Z root: DCUI Enabling DCUI login: runlevel =
2022-03-07T15:03:16Z root: init Running usbarbitrator start
2022-03-07T15:03:16Z usbarbitrator: Reserving USB boot device
2022-03-07T15:03:16Z usbarbitrator: evicting objects on USB from OC
2022-03-07T15:03:17Z usbarbitrator: unclaiming USB devices
2022-03-07T15:03:17Z usbarbitrator: Found reserved USB device vmhba32
2022-03-07T15:03:17Z usbarbitrator: rescanning to complete removal of USB devices
2022-03-07T15:03:17Z watchdog-usbarbitrator: [33812] Begin '/usr/lib/vmware/bin/vmware-usbarbitrator ++group=usbArbitrator -t --max-clients=214', min-uptime = 60, max-quick-failures = 1, max-total-failures = 5, bg_pid_file = ''
2022-03-07T15:03:17Z watchdog-usbarbitrator: Executing '/usr/lib/vmware/bin/vmware-usbarbitrator ++group=host/vim/vmvisor/usbArbitrator -t --max-clients=214'
2022-03-07T15:03:18Z root: init Running sensord start
2022-03-07T15:03:18Z watchdog-sensord: [33849] Begin '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000, bg_pid_file = ''
2022-03-07T15:03:18Z watchdog-sensord: Executing '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l'
2022-03-07T15:03:18Z sensord: Warning: failed to open ipmi device: No such file or dir
2022-03-07T15:03:19Z watchdog-sensord: '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l' exited after 0 seconds (quick failure 1) 0
2022-03-07T15:03:19Z watchdog-sensord: Executing '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l'
2022-03-07T15:03:19Z sensord: Warning: failed to open ipmi device: No such file or dir
2022-03-07T15:03:19Z watchdog-sensord: '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l' exited after 0 seconds (quick failure 2) 0
2022-03-07T15:03:19Z watchdog-sensord: End '/usr/lib/vmware/bin/sensord ++min=0,max=10 -l', failure limit reached
2022-03-07T15:03:29Z watchdog-sensord: Unable to verify sensord started after 10 seconds
2022-03-07T15:03:29Z root: init Running rhttpproxy start
2022-03-07T15:03:29Z rhttpproxy-upgrade-config: INFO: Carrying some config entries from file "/etc/vmware/rhttpproxy/config.xml" to file "/etc/vmware/rhttpproxy/config.xml" [force=False]�
2022-03-07T15:03:29Z rhttpproxy-upgrade-config: DEBUG: From and to doc are on the same version�
2022-03-07T15:03:29Z rhttpproxy-upgrade-config: DEBUG: Skip migrating since the version of the new file is the same as the version of the existing file�
2022-03-07T15:03:29Z watchdog-rhttpproxy: [33910] Begin 'rhttpproxy ++min=0,swapscope=system,group=hostd -r /etc/vmware/rhttpproxy/config.xml', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000000, bg_pid_file = ''
2022-03-07T15:03:29Z watchdog-rhttpproxy: Executing 'rhttpproxy ++min=0,swapscope=system,group=host/vim/vmvisor/hostd -r /etc/vmware/rhttpproxy/config.xml'
2022-03-07T15:03:30Z root: init Running sdrsInjector start
2022-03-07T15:03:30Z watchdog-sdrsInjector: [33951] Begin '/sbin/sdrsInjector ++group=sioc', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000000, bg_pid_file = ''
2022-03-07T15:03:30Z watchdog-sdrsInjector: Executing '/sbin/sdrsInjector ++group=host/vim/vmvisor/sioc'
2022-03-07T15:03:31Z root: init Running lbtd start
2022-03-07T15:03:31Z watchdog-net-lbt: [33987] Begin '/sbin/net-lbt ++min=0,group=lbt', min-uptime = 1000, max-quick-failures = 100, max-total-failures = 100, bg_pid_file = ''
2022-03-07T15:03:31Z watchdog-net-lbt: Executing '/sbin/net-lbt ++min=0,group=host/vim/vmvisor/lbt'
2022-03-07T15:03:32Z root: init Running vmfstraced start
2022-03-07T15:03:32Z vmfstracegd: VMFS Global Tracing is not enabled.
2022-03-07T15:03:32Z root: init Running hostd start
2022-03-07T15:03:32Z hostd-upgrade-config: INFO: Carrying some config entries from file "/etc/vmware/hostd/config.xml" to file "/etc/vmware/hostd/config.xml" [force=False]�
2022-03-07T15:03:32Z hostd-upgrade-config: DEBUG: From and to doc are on the same version�
2022-03-07T15:03:32Z hostd-upgrade-config: DEBUG: Skip migrating since the version of the new file is the same as the version of the existing file�
2022-03-07T15:03:32Z hostd: Estimating 'hostd' ramdisk size of 413MB
2022-03-07T15:03:32Z hostd: Creating ramdisk 'hostdstats' mounted on '/var/lib/vmware/hostd/stats' of size 413MB.
2022-03-07T15:03:32Z watchdog-hostd: [34048] Begin 'hostd ++min=0,swapscope=system,group=hostd /etc/vmware/hostd/config.xml', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000000, bg_pid_file = ''
2022-03-07T15:03:33Z watchdog-hostd: Executing 'hostd ++min=0,swapscope=system,group=host/vim/vmvisor/hostd /etc/vmware/hostd/config.xml'
2022-03-07T15:03:33Z root: init Running storageRM start
2022-03-07T15:03:34Z watchdog-storageRM: [34096] Begin '/sbin/storageRM ++group=sioc', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000000, bg_pid_file = ''
2022-03-07T15:03:34Z watchdog-storageRM: Executing '/sbin/storageRM ++group=host/vim/vmvisor/sioc'
2022-03-07T15:03:34Z sfcbd-watchdog: Unable to locate SFCB ticket location. Unable to remove inactive tickets.
2022-03-07T15:03:35Z root: init Running slpd start
2022-03-07T15:03:35Z root: slpd Starting slpd
2022-03-07T15:03:35Z root: slpd Generating registration file /etc/slp.reg
2022-03-07T15:03:35Z slpd[34190]: test - LOG_INFO
2022-03-07T15:03:35Z slpd[34190]: test - LOG_WARNING
2022-03-07T15:03:35Z slpd[34190]: test - LOG_ERROR
2022-03-07T15:03:35Z slpd[34190]: *** SLPD daemon version 1.0.0 started
2022-03-07T15:03:35Z slpd[34190]: Command line = /sbin/slpd
2022-03-07T15:03:35Z slpd[34190]: Using configuration file = /etc/slp.conf
2022-03-07T15:03:35Z slpd[34190]: Using registration file = /etc/slp.reg
2022-03-07T15:03:35Z slpd[34190]: Agent Interfaces = 192.168.17.5,fe80::20e:4ff:fe14:5641%vmk0
2022-03-07T15:03:35Z slpd[34190]: Agent URL = service:service-agent://192.168.17.5
2022-03-07T15:03:35Z slpd[34192]: *** BEGIN SERVICES
2022-03-07T15:03:35Z root: init Running nscd start
2022-03-07T15:03:35Z watchdog-nscd: [34210] Begin '/usr/lib/vmware/nscd/bin/nscd ++group=nscd', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000000, bg_pid_file = '/var/run/nscd/nscd.pid'
2022-03-07T15:03:35Z ntpd[33739]: Deferring DNS for time.nist.gov 1
2022-03-07T15:03:35Z ntpd[33739]: Deferring DNS for pool.ntp.otg 1
2022-03-07T15:03:35Z watchdog-nscd: Executing '/usr/lib/vmware/nscd/bin/nscd ++group=host/vim/vmvisor/nscd'
2022-03-07T15:03:35Z nscd: 34245 cannot create /var/db/nscd/hosts; no persistent database used
2022-03-07T15:03:36Z root: init Running cdp start
2022-03-07T15:03:36Z watchdog-cdp: [34266] Begin '/usr/sbin/net-cdp ++group=net-daemons', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000000, bg_pid_file = ''
2022-03-07T15:03:36Z watchdog-cdp: Executing '/usr/sbin/net-cdp ++group=host/vim/vmvisor/net-daemons'
2022-03-07T15:03:37Z root: init Running dcbd start
2022-03-07T15:03:37Z ntpd_intres[34240]: host name not found: time.nist.gov
2022-03-07T15:03:37Z ntpd_intres[34240]: host name not found: pool.ntp.otg
2022-03-07T15:03:37Z watchdog-dcbd: [34309] Begin '/usr/sbin/dcbd ++group=net-daemons', min-uptime = 60, max-quick-failures = 1, max-total-failures = 5, bg_pid_file = ''
2022-03-07T15:03:37Z watchdog-dcbd: Executing '/usr/sbin/dcbd ++group=host/vim/vmvisor/net-daemons'
2022-03-07T15:03:37Z dcbd: [info]     Main loop running.
2022-03-07T15:03:38Z root: init Running smartd start
2022-03-07T15:03:38Z watchdog-smartd: [34348] Begin '/usr/sbin/smartd ++group=smartd', min-uptime = 60, max-quick-failures = 1, max-total-failures = 5, bg_pid_file = ''
2022-03-07T15:03:38Z watchdog-smartd: Executing '/usr/sbin/smartd ++group=host/vim/vmvisor/smartd'
2022-03-07T15:03:38Z smartd: [warn] smartd starts to run.
2022-03-07T15:03:39Z root: init Running memscrubd start
2022-03-07T15:03:39Z root: init Running lacp start
2022-03-07T15:03:39Z root: init Running vobd start
2022-03-07T15:03:39Z root: init Running vpxa start
2022-03-07T15:03:40Z watchdog-vpxa: [34423] Begin '/usr/lib/vmware/vpxa/bin/vpxa ++min=0,swapscope=system,group=vpxa -D /etc/vmware/vpxa', min-uptime = 60, max-quick-failures = 1, max-total-failures = 1000000, bg_pid_file = ''
2022-03-07T15:03:40Z watchdog-vpxa: Executing '/usr/lib/vmware/vpxa/bin/vpxa ++min=0,swapscope=system,group=host/vim/vmvisor/vpxa -D /etc/vmware/vpxa'
2022-03-07T15:03:41Z root: init Running sfcbd-watchdog start
2022-03-07T15:03:41Z sfcbd-watchdog: Unable to locate SFCB ticket location. Unable to remove inactive tickets.
2022-03-07T15:03:42Z sfcbd-watchdog: Request to start sfcbd-watchdog, pid 34605
2022-03-07T15:03:42Z sfcbd-watchdog: Unable to locate SFCB ticket location. Unable to remove inactive tickets.
2022-03-07T15:03:42Z sfcbd-watchdog: Watchdog active: interval 60 seconds, pid 34703
2022-03-07T15:03:42Z sfcbd-watchdog: starting sfcbd
2022-03-07T15:03:42Z sfcbd: Starting sfcbd
2022-03-07T15:03:43Z root: init Running snmpd start
2022-03-07T15:03:43Z root: Starting snmpd
2022-03-07T15:03:43Z root: snmpd opening firewall port(s) for notifications.
2022-03-07T15:03:43Z sfcb-sfcb[34940]: --- Log syslog level: 3
2022-03-07T15:03:43Z localcli: SnmpAgentConfigImpl: UpdateFirewall: 0 out of 0 ports updated
2022-03-07T15:03:43Z root: snmpd Mounted /var/spool/snmp ramdisk size 1
2022-03-07T15:03:43Z watchdog-snmpd: [34966] Begin '/sbin/snmpd ++min=0,group=snmpd,securitydom=0', min-uptime = 60, max-quick-failures = 5, max-total-failures = 10, bg_pid_file = ''
2022-03-07T15:03:43Z watchdog-snmpd: Executing '/sbin/snmpd ++min=0,group=host/vim/vmvisor/snmpd,securitydom=0'
2022-03-07T15:03:43Z snmpd: snmpd: SNMP Research EMANATE/Lite Agent Version 17.2.2.0
2022-03-07T15:03:43Z snmpd: snmpd: Copyright 1989-2011 SNMP Research, Inc.
2022-03-07T15:03:43Z snmpd: load_config: issues with config file detected, see prior errors
2022-03-07T15:03:43Z snmpd: set_engine_id: installed engine id '00000063000000a100000000'
2022-03-07T15:03:43Z snmpd: set_log_level: log info level set
2022-03-07T15:03:43Z snmpd: VSI and VMkernel system calls initialized ok
2022-03-07T15:03:43Z snmpd: append_pnic_details: no matching device found, using last idx 10
2022-03-07T15:03:43Z snmpd: fetch_fixed_disk_status: fetch VSI_NODE_storage_scsifw_devices_smart_healthStatus(mpx.vmhba32:C0:T0:L0) failed Not supported, reporting unknown status
2022-03-07T15:03:43Z snmpd: fetch_device_sensors: open device '/dev/ipmi0' failed 2 No such file or directory, device sensors offline
2022-03-07T15:03:44Z snmpd: cache_insert_object: no invalidation method specified for key:hrmib
2022-03-07T15:03:44Z snmpd: cache_insert_object: no invalidation method specified for key:lldpmib
2022-03-07T15:03:44Z snmpd: load_def_router: getaddrinfo('') failed -2 Name or service not known, ignoring
2022-03-07T15:03:44Z snmpd: mac_string_to_binary: unable to parse VSI mac address ''
2022-03-07T15:03:44Z snmpd: load_arp_nd: no nd neighbors found
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba38, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba0, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba3, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba32, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba33, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba34, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba35, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba36, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: get_hba_status: ioctl(4, vmhba37, cmd=IODM_IOCTL_GET_HOST_ATTR) failed 38 Function not implemented
2022-03-07T15:03:44Z snmpd: cache_insert_object: no invalidation method specified for key:vmwmib
2022-03-07T15:03:44Z snmpd: agent disabled by configuration, shutting down
2022-03-07T15:03:44Z snmpd: snmpd: install_configuration failed. Continuing anyway.
2022-03-07T15:03:44Z root: init Running wsman start
2022-03-07T15:03:44Z root: openwsmand Starting openwsmand
2022-03-07T15:03:44Z watchdog-openwsmand: [35010] Begin '/sbin/openwsmand ++min=0,group=wsman,securitydom=4 --syslog=3 --foreground-process', min-uptime = 60, max-quick-failures = 5, max-total-failures = 10, bg_pid_file = ''
2022-03-07T15:03:44Z watchdog-openwsmand: Executing '/sbin/openwsmand ++min=0,group=host/vim/vmvisor/wsman,securitydom=4 --syslog=3 --foreground-process'
2022-03-07T15:03:44Z openwsmand: [wrn][35033:/build/mts/release/bora-1821109/cayman_openwsman/openwsman/src/src/server/wsmand.c:316:main] nsswitch.conf successfully stat'ed
2022-03-07T15:03:45Z root: init Running sfcbd start
2022-03-07T15:03:45Z root: init Running xorg start
2022-03-07T15:03:46Z init: starting pid 35201, tty '': '/bin/apply-host-profiles'
2022-03-07T15:03:46Z init: starting pid 35202, tty '': '/usr/lib/vmware/vmksummary/log-bootstop.sh boot'
2022-03-07T15:03:46Z esxcfg-dumppart: DiagnosticPartition: Unable to copy the dump partition: Couldn't find a valid VMKernel dump file. Dump partition might be uninitialized.
2022-03-07T15:03:46Z init: starting pid 35208, tty '': '/bin/vmdumper -g 'Boot Successful''
2022-03-07T15:03:46Z init: starting pid 35209, tty '': '/bin/sh ++min=0,group=host/vim/vimuser/terminal/shell /etc/rc.local'
2022-03-07T15:03:47Z root: init Running local.sh
2022-03-07T15:03:47Z init: starting pid 35218, tty '': '/bin/esxcfg-init --set-boot-progress done'
2022-03-07T15:03:47Z init: starting pid 35219, tty '': '/bin/vmware-autostart.sh start'
2022-03-07T15:03:47Z VMware[startup]: Starting VMs
2022-03-07T15:03:47Z init: starting pid 35222, tty '/dev/tty1': '/bin/initterm.sh tty1 /bin/techsupport.sh'
2022-03-07T15:03:47Z init: starting pid 35224, tty '/dev/tty2': '-/bin/initterm.sh tty2 /bin/dcuiweasel'
2022-03-07T15:03:47Z DCUI: Starting DCUI
2022-03-07T15:03:47Z DCUI: GetManagementInterface: Tagging vmk0 as Management
2022-03-07T15:03:47Z DCUI: SetTaggedManagementInterface: Writing vmk0 to the ManagementIface node
2022-03-07T15:03:47Z DCUI: GetManagementInterface: Tagging vmk0 as Management
2022-03-07T15:03:47Z DCUI: SetTaggedManagementInterface: Writing vmk0 to the ManagementIface node
2022-03-07T15:03:48Z cimslp: --- Using /etc/sfcb/sfcb.cfg
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StorelibAdapter::getFacadeInstance - controllerList for storelib is empty
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::initLib, ProcessLibCommandCall failed, returnValue = 0x8002
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StoreLibFacadeIR::Constructor: init library failed
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StorelibAdapter::getFacadeInstance - controllerList for storelibir is empty
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StoreLibFacade::fireStorelibCommand - caller StoreLibFacade::initLib, ProcessLibCommandCall failed, returnValue = 0x8002
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StoreLibFacadeIT1::Constructor: init library failed
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StorelibAdapter::getFacadeInstanceIT1 - controllerList for storelibit is empty
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StorelibAdapter::getFacadeInstanceIR2 - getFacadeInstance for storelibir2
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StorelibAdapter::getFacadeInstanceIR2 - controllerList for storelibir2 is empty
2022-03-07T15:03:49Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL StorelibAdapter::getFacadeInstanceIT - controllerList for storelibit is empty
2022-03-07T15:03:54Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:55Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:55Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:55Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:55Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:55Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:55Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:55Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:55Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:55Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:56Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:56Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:56Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:56Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:56Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:56Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:56Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:56Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:57Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:57Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:57Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:57Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:57Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:57Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:57Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:57Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:57Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:58Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:58Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:58Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:58Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:58Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:58Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:03:58Z sfcb-LSIESG_SMIS13_HHR[35270]: INTERNAL ProviderFacade::getInstance - unsupported class requested, returning null.
2022-03-07T15:04:00Z cimslp: Found 43 profiles in namespace root/interop
2022-03-07T15:04:00Z cimslp: ProcessSrvReg: sending request
2022-03-07T15:04:00Z cimslp: CallbackSrvReg(errcode= 0, peerinfo= (unknown address family) 0)
2022-03-07T15:04:00Z cimslp: registerCIMService: SLPReg(service:wbem:https://esxi:5989) rc = 0
2022-03-07T15:04:59Z ntpd_intres[34240]: host name not found: time.nist.gov
2022-03-07T15:04:59Z ntpd_intres[34240]: host name not found: pool.ntp.otg
2022-03-07T15:05:01Z crond[33612]: crond: USER root pid 35472 cmd /sbin/hostd-probe ++group=host/vim/vmvisor/hostd-probe
2022-03-07T15:05:01Z syslog[35473]: starting hostd probing.
2022-03-07T15:05:01Z syslog[35473]: hostd probing is done.
2022-03-07T15:05:21Z sfcb-hhrc[35507]: InitHHRCWrapperThreads: Sample interval was set to 20 secs
2022-03-07T15:07:21Z ntpd_intres[34240]: host name not found: time.nist.gov
2022-03-07T15:07:21Z ntpd_intres[34240]: host name not found: pool.ntp.otg
2022-03-07T15:10:01Z crond[33612]: crond: USER root pid 36248 cmd /sbin/hostd-probe ++group=host/vim/vmvisor/hostd-probe
2022-03-07T15:10:01Z syslog[36249]: starting hostd probing.
2022-03-07T15:10:01Z syslog[36249]: hostd probing is done.
2022-03-07T15:11:43Z ntpd_intres[34240]: host name not found: time.nist.gov
2022-03-07T15:11:43Z ntpd_intres[34240]: host name not found: pool.ntp.otg
2022-03-07T15:15:01Z crond[33612]: crond: USER root pid 37035 cmd /sbin/hostd-probe ++group=host/vim/vmvisor/hostd-probe
2022-03-07T15:15:01Z syslog[37036]: starting hostd probing.
2022-03-07T15:15:01Z syslog[37036]: hostd probing is done.
2022-03-07T15:20:01Z crond[33612]: crond: USER root pid 37783 cmd /sbin/hostd-probe ++group=host/vim/vmvisor/hostd-probe
2022-03-07T15:20:01Z syslog[37784]: starting hostd probing.
2022-03-07T15:20:02Z syslog[37784]: hostd probing is done.
2022-03-07T15:20:05Z ntpd_intres[34240]: host name not found: time.nist.gov
2022-03-07T15:20:05Z ntpd_intres[34240]: host name not found: pool.ntp.otg
 
Last edited:
D

DouglasABaker

New Member
Mar 6, 2022
6
0
1
I'll assume after this amount of time that either I'm really unlucky and no one else has those problem, or the problem is so hard that no one has any idea how to solve it. Or I posted the wrong information.

Regardless, here is an update:
1. My data store problem was apparently a product of a raid controller that had lost its heatsink. I reconnected it but it crapped out the next day anyway. New one waived today and will be installed shortly.
2. The time server problem appears to be a typo where I used .otg instead of .org. interestingly, I fixed this, it was fine for a few days, and has now reverted to .otg again. Weird.
3. There problems with the WHS2011 host dropping the passthrough controller continue. What I've now determined, however, is that ESXi itself never loses the connection - restarting three be WHS guest reconnects the drives (until they drop again).

So, next question someone will hopefully answer: which logs should I be looking in for clues was to why? Everything I've researched above seems to be either a non-issue or a known ESXi log issue.

Thanks!

Doug
 
You must log in or register to reply here.
Top Bottom