Log Disk Exhaustion on VCSA

VCSA 7.0.3 20051473

Symptoms

Log Disk Exhaustion on 10.

Cause

The /storage/log is being used at 96% capacity.

root@vc [ ~ ]# df -h /storage/log
Filesystem                                Size  Used Avail Use% Mounted on
/dev/mapper/log_vg-log                     10G  9.5G  0.4G  96% /storage/log

Solution 1: Expand the file system

  1. Login VCSM(:5480) and confirm the disk number corresponding to /storage/log, such as Hard Disk 5.

  1. Remove all snapshot of vCenter VM.

  2. Edit setting of vCenter VM, expand Hard Disk 5 capacity from 10G to 15G.

  3. SSH to VCSA, run the /usr/lib/applmgmt/support/scripts/autogrow.sh script

root@vc [ ~ ]# /usr/lib/applmgmt/support/scripts/autogrow.sh

root@vc [ ~ ]# df -h /storage/log
Filesystem                                Size  Used Avail Use% Mounted on
/dev/mapper/log_vg-log                     15G  9.5G  4.6G  68% /storage/log

Solution 2: Cleanup the largest files

  1. Take a snapshot of the vCenter VM.

  2. Run the following command to identify the largest files:

root@vc [ ~ ]# find /storage/log -type f -print0 | xargs -0 du -h | sort -rh | head -n 10
  1. Truncate the log file using the following command to free up disk space.

e.g.)

> /storage/log/vmware/vmware-updatemgr/updatemgr-vmon.log.stderr
echo -n > /storage/log/vmware/sca/vmon-0.stderr

Reference

・ Increasing the disk space for the vCenter Server Appliance in vSphere 6.5, 6.7, 7.0 and 8.0
・ vCenter log disk exhaustion or /storage/log full
・ vCenter Appliance /storage/log partition full due to /storage/log/vmware/sca/vmon.stderr
・ After update to vCenter Server Appliance 6.7 Update 3r, /storage/log fills up sue to growth in content-library-runtime.log.stdout