vCenter Server Applicance vmdird Service Failed to Start

Applies to

VMware vCenter Server Applicance, 7.0.3.01400, 21477706

Symptoms

Web client show "No Healthy upstream".

root@localhost [ ~ ]# service-control --start --all
Operation not cancellable. Please wait for it to finish...
Performing start operation on service lwsmd...
Successfully started service lwsmd
Performing start operation on service vmafdd...
Successfully started service vmafdd
Performing start operation on service vmdird...
2023-11-29T01:14:29.508Z  RC = 1
Stdout =
Stderr = Job for vmdird.service failed because the control process exited with error code.
See "systemctl status vmdird.service" and "journalctl -xe" for details.

2023-11-29T01:14:29.508Z  {
    "detail": [
        {
            "id": "install.ciscommon.command.errinvoke",
            "translatable": "An error occurred while invoking external command : '%(0)s'",
            "args": [
                "Stderr: Job for vmdird.service failed because the control process exited with error code.\nSee \"systemctl status vmdird.service\" and \"journalctl -xe\" for details.\n"
            ],
            "localized": "An error occurred while invoking external command : 'Stderr: Job for vmdird.service failed because the control process exited with error code.\nSee \"systemctl status vmdird.service\" and \"journalctl -xe\" for details.\n'"
        }
    ],
    "componentKey": null,
    "problemId": null,
    "resolution": null
}
Error executing start on service vmdird. Details {
    "detail": [
        {
            "id": "install.ciscommon.service.failstart",
            "translatable": "An error occurred while starting service '%(0)s'",
            "args": [
                "vmdird"
            ],
            "localized": "An error occurred while starting service 'vmdird'"
        }
    ],
    "componentKey": null,
    "problemId": null,
    "resolution": null
}
Service-control failed. Error: {
    "detail": [
        {
            "id": "install.ciscommon.service.failstart",
            "translatable": "An error occurred while starting service '%(0)s'",
            "args": [
                "vmdird"
            ],
            "localized": "An error occurred while starting service 'vmdird'"
        }
    ],
    "componentKey": null,
    "problemId": null,
    "resolution": null
}

root@localhost [ ~ ]# journalctl -xe
Nov 29 09:14:29 localhost vmdird[55849]: t@139643626645312: _VmDirOpenDbEnv: mdb_env_open failed on database /storage/db/vmware-vmdir/snapshot, MDB error -30793
Nov 29 09:14:29 localhost vmdird[55849]: t@139643626645312: MDBInitializeDB failed with error code: -30793, error string: MDB_INVALID: File is not an MDB file
Nov 29 09:14:29 localhost vmdird[55849]: t@139643626645312: VmDirInitBackend failed (-30793)
Nov 29 09:14:29 localhost lwsmd[55586]: Service died: vmdir (restarted 2 times in 0 seconds)

Cause

The /storage/db/vmware-vmdir/snapshot/data.mdb file invalid.

Solution

Remove the /storage/db/vmware-vmdir/snapshot/data.mdb file.

root@localhost [ ~ ]# ls -l /storage/db/vmware-vmdir/snapshot
total 32388
-rw------T 1 vmdird lwis 33161216 Sep  6 12:55 data.mdb
-rw------- 1 vmdird lwis    64128 Nov 29 09:14 lock.mdb

root@localhost [ ~ ]# mv /storage/db/vmware-vmdir/snapshot/data.mdb /tmp/
root@localhost [ ~ ]# service-control --start --all