Login as: service Using keyboard-interactive authentication. Password:
service@ManagementServer:~> sudo /sbin/shutdown 0
Broadcast message from root (pts/1) (Tue Feb 8 18:12:30 2010): The system is going down to maintenance mode NOW!
Fibre Channel COM Switches
Switch
Address in cluster-1
A
128.221.252.34
B
128.221.253.34
Verify the health of the Fibre Channel COM switches.
service@ManagementServer:~> telnet 128.221.252.34
FC-Switch-A login: service Password: Mi@Dim7T
FC-Switch-A:service> switchstatusshow
Shut down the Fibre Channel COM switches.
FC-Switch-A:service> sysshutdown This command will shutdown the operating systems on your switch. You are required to power-cycle the switch in order to restore operation. Are you sure you want to shutdown the switch [y/n]?y
Broadcast message from root (pts/0) Fri Nov 18 20:09:11 2011... The system is going down for system halt NOW !! FC-Switch-A:service> Connection closed by foreign host.
FC-Switch-A:service> exit
FRU Replacement
Example of Replace SPS:
service@vplex-idc:~> vplexcli Trying ::1... Connected to localhost. Escape character is '^]'. Enter User Name: service Password: creating logfile:/var/log/VPlex/cli/session.log_service_localhost_T8650_20240507001144
VPlexcli:/> VPlexcli:/> cd /notifications/call-home VPlexcli:/notifications/call-home> set enabled false VPlexcli:/> VPlexcli:/> ll /engines/engine-1-1/stand-by-power-supplies/*
/engines/engine-1-1/stand-by-power-supplies/stand-by-power-supply-a/conditioning: Name Value ---------------------- ---------------------------- enabled true in-progress false manual-cycle-requested false next-cycle Mon Jun 03 00:00:00 UTC 2024 previous-cycle Mon May 06 00:00:04 UTC 2024 previous-cycle-result PASS
/engines/engine-1-1/stand-by-power-supplies/stand-by-power-supply-b/conditioning: Name Value ---------------------- ---------------------------- enabled true in-progress false manual-cycle-requested false next-cycle Mon Jun 03 12:00:00 UTC 2024 previous-cycle Mon Apr 01 12:00:03 UTC 2024 previous-cycle-result SKIPPED
/engines/engine-1-1/stand-by-power-supplies/stand-by-power-supply-a/conditioning: Name Value ---------------------- ---------------------------- enabled false in-progress false manual-cycle-requested false next-cycle Mon Jun 03 00:00:00 UTC 2024 previous-cycle Mon May 06 00:00:04 UTC 2024 previous-cycle-result PASS
/engines/engine-1-1/stand-by-power-supplies/stand-by-power-supply-b/conditioning: Name Value ---------------------- ---------------------------- enabled false in-progress false manual-cycle-requested false next-cycle Mon Jun 03 12:00:00 UTC 2024 previous-cycle Mon Apr 01 12:00:03 UTC 2024 previous-cycle-result SKIPPED
/engines/engine-1-1/stand-by-power-supplies/stand-by-power-supply-a/conditioning: Name Value ---------------------- ---------------------------- enabled true in-progress false manual-cycle-requested false next-cycle Mon Jun 03 00:00:00 UTC 2024 previous-cycle Mon May 06 00:00:04 UTC 2024 previous-cycle-result PASS
/engines/engine-1-1/stand-by-power-supplies/stand-by-power-supply-b/conditioning: Name Value ---------------------- ---------------------------- enabled true in-progress false manual-cycle-requested false next-cycle Mon Jun 03 12:00:00 UTC 2024 previous-cycle - previous-cycle-result unknown
VPlexcli:/> VPlexcli:/> cd /notifications/call-home VPlexcli:/notifications/call-home> set enabled true VPlexcli:/> VPlexcli:/> cluster status Cluster cluster-1 operational-status: ok transitioning-indications: transitioning-progress: health-state: ok health-indications: local-com: ok
VPlexcli:/> VPlexcli:/> health-check
Example of Replace PSU:
service@vplex-1:~> screen -S replace_ps service@vplex-1:~> service@vplex-1:~> vplexcli Trying ::1... Connected to localhost. Escape character is '^]'.
Enter User Name: service Password: creating logfile:/var/log/VPlex/cli/session.log_service_localhost_T9119_20240116055902 VPlexcli:/> VPlexcli:/> cluster status Cluster cluster-1 operational-status: ok transitioning-indications: transitioning-progress: health-state: major-failure health-indications: 18 unhealthy Devices or storage-volumes engine-1-1 : director-1-1-A : power-supply-b0 : The state of the specified FRU is faulted engine-1-1 : director-1-1-B : power-supply-b0 : The state of the specified FRU is faulted local-com: ok
VPlexcli:/> VPlexcli:/> script -i VPlexadmin VPlexcli:/> VPlexcli:/> VPlexadmin replace-fru ** Displaying figure 'no-replacement-in-progress' at http://128.221.252.2/fru/procedure.html ** 0. Exit fru replacement 1. Management server -- the cluster 1 management server 2. engine-1-1 -- the VPLEX chassis in position 1 of cluster 1 3. engine-1-2 -- the VPLEX chassis in position 2 of cluster 1
Select an entry by typing its number and pressing enter: 2
Current fru: engine-1-1 0. Go to parent fru 1. Replace the VPLEX chassis in position 1 of cluster 1 2. PSA0 -- power supply A0 3. PSA1 -- power supply A1 4. PSB0 -- power supply B0 5. PSB1 -- power supply B1 6. director-1-1-A -- VPLEX director A in engine 1-1 7. director-1-1-B -- VPLEX director B in engine 1-1
Select an entry by typing its number and pressing enter: 4
Current fru: PSB0 0. Go to parent fru 1. Replace power supply B0
Select an entry by typing its number and pressing enter: 1
You have selected the following fru to replace: Name: PSB0 Description: power supply B0 fruid: 0x000B001D part-num: 071-000-543 revision: A10 serial-num: ASTAC164400007
Are you sure you want to replace this FRU? (yes/no) yes
Verifying that the redundant power supply is operational. Pass
Verifying that the director's peer is operational. Fail
WARNING: It is unsafe to perform the procedure at this time. Serious problems can occur if you proceed: - Peer director is not operational. Performing this FRU replacement may result in a DU.
Are you sure you want to continue? (yes/no) yes
To indicate that you understand the risks and still want to proceed with this command, please type "REPLACE" to continue: (REPLACE/no) REPLACE
Do you want to run "collect-diagnostics" to collect system information? No failure conditions have been detected that mandate a run. (yes/no) no
The amber marker led is lit to help with identification.
Did you successfully identify engine-1-1? (yes/no) yes ** Displaying figure 'argonaut-power-supply-identify' at http://128.221.252.2/fru/procedure.html **
Identify power supply PSB0 on the figure, and identify the corresponding power supply on the engine.
The director's amber marker LED is lit. It is located between the power supply you are removing and another power supply.
Did you successfully identify power supply PSB0? (yes/no) yes ** Displaying figure 'argonaut-engine-remove-bezel' at http://128.221.252.2/fru/procedure.html **
At the front of the cabinet, remove the engine's 2U front panel.
Press enter to continue: ** Displaying figure 'argonaut-power-supply-remove' at http://128.221.252.2/fru/procedure.html **
Push the orange latch down on power supply PSB0 to free the handle. Then grasp the handle and pull the power supply module out of the engine enclosure.
Press enter to continue: ** Displaying figure 'argonaut-power-supply-install' at http://128.221.252.2/fru/procedure.html **
Slide power supply PSB0 into the engine enclosure, and push on the two areas shown to seat the power supply module. Make sure the power supply handle latches to ensure it is seated properly.
Press enter to continue:
Verifying that the power supply has been inserted correctly. Pass ** Displaying figure 'argonaut-engine-install-bezel' at http://128.221.252.2/fru/procedure.html **
Replace the engine's front panel.
Press enter to continue:
Verifying that the FRU replacement was successful. Fail
There were problems with the procedure. See the errors listed below: - Verification of the replacement part has failed. - Power supply PSB0 state is faulted.
Collecting configuration information and log files from all directors and the management server. This will take a few minutes. Pass
Use a web browser to download the following file to your service laptop: http://128.221.252.2/CKM00171701700-c1-diagnostics-2024-01-16-06.28.52.tar.gz
Did you successfully download the file? (yes/no) yes
Contact the EMC Support Center.
Verifying that the system is in good health. Pass
WARNING: there are problems with the system. See the errors listed below: - The health-state of cluster /clusters/cluster-1 is degraded.
VPlexcli:/> VPlexcli:/> health-check
Example of Replace DIMM:
service@vplex596:~> screen -S upgrade service@vplex596:~> service@vplex596:~> vplexcli Trying ::1... Connected to localhost. Escape character is '^]'. Enter User Name: service Password: creating logfile:/var/log/VPlex/cli/session.log_service_localhost_T5231_20250912054105 VPlexcli:/> VPlexcli:/> cluster status Cluster cluster-1 operational-status: ok transitioning-indications: transitioning-progress: health-state: degraded health-indications: engine-1-1 : director-1-1-A : DIMM1 : The specified device is in a degraded state. local-com: ok
Cluster cluster-2 operational-status: ok transitioning-indications: transitioning-progress: health-state: ok health-indications: local-com: ok
/engines/engine-1-1/directors/director-1-1-A/hardware/dimms/dimm-A1: Name Value ------------------ ------------------ operational-status degraded part-number 100-562-866 serial-number 802C0F15090EDBE9BD
VPlexcli:/> VPlexcli:/> script -i VPlexadmin VPlexcli:/> VPlexadmin replace-fru ** Displaying figure 'no-replacement-in-progress' at http://128.221.252.2/fru/procedure.html ** 0. Exit fru replacement 1. Management server -- the cluster 1 management server 2. engine-1-1 -- the VPLEX chassis in position 1 of cluster 1
Select an entry by typing its number and pressing enter: 2 Current fru: engine-1-1 0. Go to parent fru 1. Replace the VPLEX chassis in position 1 of cluster 1 2. PSA0 -- power supply A0 3. PSA1 -- power supply A1 4. PSB0 -- power supply B0 5. PSB1 -- power supply B1 6. director-1-1-A -- VPLEX director A in engine 1-1 7. director-1-1-B -- VPLEX director B in engine 1-1
Select an entry by typing its number and pressing enter: 6 Current fru: director-1-1-A 0. Go to parent fru 1. Replace VPLEX director A in engine 1-1 2. A0 -- IO Module A0 3. A1 -- IO Module A1 4. A2 -- IO Module A2 5. A3 -- IO Module A3 6. internal disk -- the director's SSD.
Select an entry by typing its number and pressing enter: 1
You have selected the following fru to replace: Name: director-1-1-A Description: VPLEX director A in engine 1-1 fruid: 0x0012000B part-num: 110-113-436B-01 revision: FFF serial-num: CF23K151600078
Are you sure you want to replace this FRU? (yes/no) yes
Verifying that the director's peer is operational. Pass
Verifying that the director's peer has redundant power sources. Pass
Verifying that the other directors' cluster connectivity is operational. Pass
Do you want to run "collect-diagnostics" to collect system information? No failure conditions have been detected that mandate a run. (yes/no) no
The amber marker led is lit to help with identification.
Did you successfully identify engine-1-1? (yes/no) yes ** Displaying figure 'argonaut-director-leds' at http://128.221.252.2/fru/procedure.html **
Identify director-1-1-A.
The amber marker LED is lit to help with the identification.
Did you successfully identify director-1-1-A? (yes/no) yes
Setting up the PXE server. Pass
Stopping the director firmware. Pass
Disconnecting the director from the VPlexcli. WARNING: Failed to unconfigure RabbitMQ for director 'director-1-1-A' Pass
Shutting down the director. Pass ** Displaying figure 'argonaut-engine-remove-bezel' at http://128.221.252.2/fru/procedure.html **
At the front of the cabinet, remove the engine's 2U front panel.
Press enter to continue: ** Displaying figure 'argonaut-power-supply-remove' at http://128.221.252.2/fru/procedure.html **
Push the orange latch down on power supply PSA0 to free the handle. Then grasp the handle and pull the power supply module out of the engine enclosure.
Press enter to continue: ** Displaying figure 'argonaut-power-supply-remove' at http://128.221.252.2/fru/procedure.html **
Push the orange latch down on power supply PSA1 to free the handle. Then grasp the handle and pull the power supply module out of the engine enclosure.
Press enter to continue: ** Displaying figure 'argonaut-director-remove' at http://128.221.252.2/fru/procedure.html **
Pull director A's orange latches out to free the latch bars. Then grasp the latch bars as shown, and pull the director out of the engine enclosure.
Press enter to continue:
Follow the instructions printed on the left side of the director to remove the SSD and install it in the new director. Note: Be sure to push the SSD in firmly, to seat it fully.
Press enter to continue:
Transfer each DIMM from the director that has just been removed into the replacement part. Instructions for removing and inserting the DIMMs follow:
Press gently on the tabs and pull to remove the DIMM cover.
Press enter to continue:
Locate the DIMM in slot 0. DIMM slot numbering is labelled on the memory module cover. The leftmost slot when you remove the director is numbered 0 and the numbers increase as you move towards the center of the director.
Press enter to continue: ** Displaying figure 'argonaut-dimm-remove' at http://128.221.252.2/fru/procedure.html **
Push down on the socket ejectors on either side of the DIMM in slot 0. Touch only the outside edges of the DIMM as you pull it straight up and out of its slot.
Press enter to continue: ** Displaying figure 'argonaut-dimm-install' at http://128.221.252.2/fru/procedure.html **
Handling only the outside edges, align the DIMM with the currently empty slot 0. Push the DIMM straight down into the slot firmly and evenly until the socket ejectors close against the DIMM.
Press enter to continue:
Repeat the previous instructions for the DIMM in slot 1.
Press enter to continue:
Repeat the previous instructions for the DIMM in slot 2.
Press enter to continue:
Repeat the previous instructions for the DIMM in slot 3.
Press enter to continue:
Repeat the previous instructions for the DIMM in slot 4.
Press enter to continue:
Repeat the previous instructions for the DIMM in slot 5.
Press enter to continue:
Restore the DIMM cover.
Press enter to continue: ** Displaying figure 'argonaut-director-install' at http://128.221.252.2/fru/procedure.html **
Align director A with the engine enclosure, and slide the director fully into the chassis. Push in on the director's latch bars to latch the director into place.
Press enter to continue: ** Displaying figure 'argonaut-power-supply-install' at http://128.221.252.2/fru/procedure.html **
Slide power supply PSA0 into the engine enclosure, and push on the two areas shown to seat the power supply module. Make sure the power supply handle latches to ensure it is seated properly.
Press enter to continue: ** Displaying figure 'argonaut-power-supply-install' at http://128.221.252.2/fru/procedure.html **
Slide power supply PSA1 into the engine enclosure, and push on the two areas shown to seat the power supply module. Make sure the power supply handle latches to ensure it is seated properly.
Press enter to continue: ** Displaying figure 'argonaut-engine-install-bezel' at http://128.221.252.2/fru/procedure.html **
Replace the engine's front panel.
Press enter to continue:
Powering on the director. Pass
Warning: Replacement director is the same as the original director.
Continue anyway? (yes/no) yes
Waiting for the directors to netboot. Pass
Checking if SSD on director-1-1-a is accessable. Pass
Upgrading the directors bios, post and firmware bundle. Pass
Tearing down the PXE server. Pass
Rebooting the netbooted directors. Pass
Powering on the director. Pass
Waiting for the director to start up. Will wait up to 10 minutes. Pass
Connecting the director to the VPlexcli. WARNING: Failed to configure RabbitMQ for director 'director-1-1-A' Pass
Verifying that the FRU replacement was successful. Fail
There were problems with the procedure. See the errors listed below: - Verification of the replacement part has failed. - director-1-1-A is not fully operational. - Power supply PSA1 state is faulted. - director-1-1-A is not fully operational. - director-1-1-A is not fully operational. - director-1-1-A is not fully operational. - director-1-1-A is not fully operational. - director-1-1-A is not fully operational. - director-1-1-A is not fully operational.
Collecting configuration information and log files from all directors and the management server. This will take a few minutes. Pass
Use a web browser to download the following file to your service laptop: http://128.221.252.2/CKM00151900596-diagnostics-2025-09-12-06.36.46.tar.gz
Did you successfully download the file? (yes/no) yes
Contact the EMC Support Center.
Verifying that the system is in good health. Pass
WARNING: there are problems with the system. See the errors listed below: - The health-state of cluster /clusters/cluster-1 is major-failure.
VPlexcli:/> VPlexcli:/> cluster status Cluster cluster-1 operational-status: ok transitioning-indications: transitioning-progress: health-state: major-failure health-indications: engine-1-1 : director-1-1-A : power-supply-a1 : The state of the specified FRU is faulted engine-1-1 : director-1-1-B : power-supply-a1 : The state of the specified FRU is faulted local-com: ok
Cluster cluster-2 operational-status: ok transitioning-indications: transitioning-progress: health-state: ok health-indications: local-com: ok
