vCenter Server Applicance statsmonitor Service Failed to Start

Applies to

VMware vCenter Server Applicance, 7.0.3.01400, 21477706

Symptoms

root@localhost [ ~ ]# service-control --start --all
Operation not cancellable. Please wait for it to finish...
Performing start operation on service lwsmd...
Successfully started service lwsmd
Performing start operation on service vmafdd...
Successfully started service vmafdd
Performing start operation on service vmdird...
Successfully started service vmdird
Performing start operation on service vmcad...
Successfully started service vmcad
Performing start operation on profile: ALL...
Successfully started service vmware-vmon
Service-control failed. Error: Failed to start services in profile ALL. RC=2, stderr=Failed to start statsmonitor services. Error: Service crashed while starting

root@localhost [ ~ ]# tac /var/log/vmware/applmgmt/StatsMonitor.log | more
2023-11-29T09:37:56.874+08:00 info StatsMonitor[14480] [Originator@6876 sub=StatsMonitor] Exiting with status=false.
2023-11-29T09:37:56.874+08:00 info StatsMonitor[14480] [Originator@6876 sub=StatsMonitor] Initialization took 13ms with status=false.
2023-11-29T09:37:56.874+08:00 error StatsMonitor[14480] [Originator@6876 sub=StatsMonitor] Unable to open and initialize storage engine: database disk image is malformed
2023-11-29T09:37:56.874+08:00 error StatsMonitor[14480] [Originator@6876 sub=StatsMonitor] Failed to execute SQL PRAGMA journal_mode=wal;
2023-11-29T09:37:56.872+08:00 info StatsMonitor[14480] [Originator@6876 sub=StatsMonitor] SqliteStorageEngine using SQLite version: 3.35.5

Cause

The database disk image file /var/vmware/applmgmt/appliance_stats.sqlite is malformed.

Solution

Remove the /var/vmware/applmgmt/appliance_stats.sqlite file.

root@localhost [ ~ ]# ls -l /var/vmware/applmgmt/appliance_stats*
-rw-r--r-- 1 root root 296869888 Nov 29 09:10 /var/vmware/applmgmt/appliance_stats.sqlite

root@localhost [ ~ ]# mv /var/vmware/applmgmt/appliance_stats* /tmp/

root@localhost [ ~ ]# service-control --restart statsmonitor
Successfully restarted service statsmonitor

root@localhost [ ~ ]# service-control --status
Running:
applmgmt lookupsvc lwsmd observability observability-vapi pschealth vlcm vmafdd vmcad vmdird vmonapi vmware-analytics vmware-certificateauthority vmware-certificatemanagement vmware-cis-license vmware-content-library vmware-eam vmware-envoy vmware-hvc vmware-infraprofile vmware-perfcharts vmware-pod vmware-postgres-archiver vmware-rhttpproxy vmware-sca vmware-sps vmware-statsmonitor vmware-stsd vmware-topologysvc vmware-trustmanagement vmware-updatemgr vmware-vapi-endpoint vmware-vdtc vmware-vmon vmware-vpostgres vmware-vpxd vmware-vpxd-svcs vmware-vsan-health vmware-vsm vsphere-ui vstats vtsdb wcp
Stopped:
vmcam vmware-imagebuilder vmware-netdumper vmware-rbd-watchdog vmware-vcha