Replacing a disk drive or solid-state drive for mirrored rootvg in AIX
Replacing a disk drive or solid-state drive for mirrored rootvg in AIX
-
查看系统故障日志，确定故障硬盘信息。
]/# errpt
IDENTIFIER TIMESTAMP T C RESOURCE_NAME DESCRIPTION
EAA3D429 1113051522 U S LVDD PHYSICAL PARTITION MARKED STALE
E86653C3 1113051522 P H LVDD I/O ERROR DETECTED BY LVM
B6267342 1113051522 P H hdisk0 DISK OPERATION ERROR
]/#errpt -aj B6267342
......
Diagnostic Analysis
Diagnostic Log sequence number: 2639
Resource tested: hdisk0
Resource Description: SAS Disk Drive
Location: U78AA.001.WZSKPLU-P2-D1
SRN: 2672-128
Description: Error log analysis indicates a hardware failure.
Possible FRUs:
hdisk0 FRU: 00E6167 U78AA.001.WZSKPLU-P2-D1 SAS Disk Drive
]/#lscfg -vl hdisk0
hdisk0 U78AA.001.WZSKPLU-P2-D1 SAS Disk Drive (300000 MB)
Manufacturer................IBM
Machine Type and Model......HUC109030CSS600
FRU Number..................00E6167
ROS Level and ID............45354336
Serial Number...............KFGK2XER
EC Level....................L37106
Part Number.................74Y9268
Device Specific.(Z0)........000006329F011002
Device Specific.(Z1)........CEIPE5C6
Device Specific.(Z2)........00SS
Device Specific.(Z3)........14156
Device Specific.(Z4)........
Device Specific.(Z5)........22
Device Specific.(Z6)........L37510
Hardware Location Code......U78AA.001.WZSKPLU-P2-D1 -
查看系统启动设备。
]/#bootlist -m normal -o
hdisk0 blv=hd5 pathid=0
hdisk1 blv=hd5 pathid=0 -
检查 rootvg 卷组状态信息。
]/#lsvg rootvg
VOLUME GROUP: rootvg VG IDENTIFIER: 00f9838900004c0000000149a2d111cf
VG STATE: active PP SIZE: 512 megabyte(s)
VG PERMISSION: read/write TOTAL PPs: 1116 (571392 megabytes)
MAX LVs: 256 FREE PPs: 520 (266240 megabytes)
LVs: 15 USED PPs: 596 (305152 megabytes)
OPEN LVs: 14 QUORUM: 1 (Disabled)
TOTAL PVs: 2 VG DESCRIPTORS: 3
STALE PVs: 1 STALE PPs: 1
ACTIVE PVs: 2 AUTO ON: yes
MAX PPs per VG: 32512
MAX PPs per PV: 1016 MAX PVs: 32
LTG size (Dynamic): 1024 kilobyte(s) AUTO SYNC: no
HOT SPARE: no BB POLICY: relocatable
PV RESTRICTION: none INFINITE RETRY: no
]/#lsvg -p rootvg
rootvg:
PV_NAME PV STATE TOTAL PPs FREE PPs FREE DISTRIBUTION
hdisk0 active 558 250 111..00..00..27..112
hdisk1 active 558 270 111..00..00..47..112
]/#lsvg -l rootvg
rootvg:
LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT
hd5 boot 1 2 2 closed/syncd N/A
hd6 paging 32 64 2 open/syncd N/A
hd8 jfs2log 1 2 2 open/syncd N/A
hd4 jfs2 20 40 2 open/syncd /
hd2 jfs2 30 60 2 open/syncd /usr
hd9var jfs2 20 40 2 open/syncd /var
hd3 jfs2 20 40 2 open/syncd /tmp
hd1 jfs2 120 240 2 open/stale /home
hd10opt jfs2 20 40 2 open/syncd /opt
hd11admin jfs2 1 2 2 open/syncd /admin
lg_dumplv sysdump 20 20 1 open/syncd N/A
livedump jfs2 1 2 2 open/syncd /var/adm/ras/livedump
loglv00 jfslog 1 2 2 open/syncd N/A
lv00 jfs 1 2 2 open/syncd /var/adm/csd
fslv00 jfs2 20 40 2 open/syncd /isc可以看到 rootvg 卷组中存在 1 个
STALE PPs。卷组的 LPs:PPs 为 1:2 处于镜像中。 -
查看卷组的物理卷状态。
]/#lspv hdisk0
PHYSICAL VOLUME: hdisk0 VOLUME GROUP: rootvg
PV IDENTIFIER: 00f9838959802512 VG IDENTIFIER 00f9838900004c0000000149a2d111cf
PV STATE: active
STALE PARTITIONS: 1 ALLOCATABLE: yes
PP SIZE: 512 megabyte(s) LOGICAL VOLUMES: 15
TOTAL PPs: 558 (285696 megabytes) VG DESCRIPTORS: 2
FREE PPs: 250 (128000 megabytes) HOT SPARE: no
USED PPs: 308 (157696 megabytes) MAX REQUEST: 1 megabyte
FREE DISTRIBUTION: 111..00..00..27..112
USED DISTRIBUTION: 01..112..111..84..00
MIRROR POOL: None
]/#lspv hdisk1
PHYSICAL VOLUME: hdisk1 VOLUME GROUP: rootvg
PV IDENTIFIER: 00f98389cb6fdbfe VG IDENTIFIER 00f9838900004c0000000149a2d111cf
PV STATE: active
STALE PARTITIONS: 0 ALLOCATABLE: yes
PP SIZE: 512 megabyte(s) LOGICAL VOLUMES: 14
TOTAL PPs: 558 (285696 megabytes) VG DESCRIPTORS: 1
FREE PPs: 270 (138240 megabytes) HOT SPARE: no
USED PPs: 288 (147456 megabytes) MAX REQUEST: 1 megabyte
FREE DISTRIBUTION: 111..00..00..47..112
USED DISTRIBUTION: 01..112..111..64..00
MIRROR POOL: NoneSTALE PPs位于故障盘物理卷 hdisk0，因此无需处理。否则需要执行物理卷同步命令syncvg –p hdisk0 hdisk1 -
迁移
sysdump设备，sysdump 位于故障盘则进行迁移，否则跳过此步骤。]/#lspv -l hdisk0
hdisk0:
LV NAME LPs PPs DISTRIBUTION MOUNT POINT
hd10opt 20 20 00..00..20..00..00 /opt
hd2 30 30 00..10..20..00..00 /usr
hd9var 20 20 00..00..20..00..00 /var
hd3 20 20 00..00..20..00..00 /tmp
hd1 120 120 00..27..09..84..00 /home
hd5 1 1 01..00..00..00..00 N/A
hd6 32 32 00..32..00..00..00 N/A
hd8 1 1 00..00..01..00..00 N/A
hd4 20 20 00..00..20..00..00 /
hd11admin 1 1 00..00..01..00..00 /admin
lg_dumplv 20 20 00..20..00..00..00 N/A
livedump 1 1 00..01..00..00..00 /var/adm/ras/livedump
loglv00 1 1 00..01..00..00..00 N/A
lv00 1 1 00..01..00..00..00 /var/adm/csd
fslv00 20 20 00..20..00..00..00 /isc
]/#migratepv -l lg_dumplv hdisk0 hdisk1
]/#lspv -l hdisk1
hdisk1:
LV NAME LPs PPs DISTRIBUTION MOUNT POINT
hd10opt 20 20 00..20..00..00..00 /opt
hd2 30 30 00..01..29..00..00 /usr
hd9var 20 20 00..00..20..00..00 /var
hd3 20 20 00..00..20..00..00 /tmp
hd1 120 120 00..36..20..64..00 /home
hd5 1 1 01..00..00..00..00 N/A
hd6 32 32 00..32..00..00..00 N/A
hd8 1 1 00..00..01..00..00 N/A
hd4 20 20 00..00..20..00..00 /
hd11admin 1 1 00..00..01..00..00 /admin
lg_dumplv 20 20 20..00..00..00..00 N/A
livedump 1 1 00..01..00..00..00 /var/adm/ras/livedump
loglv00 1 1 00..01..00..00..00 N/A
lv00 1 1 00..01..00..00..00 /var/adm/csd
fslv00 20 20 00..20..00..00..00 /isc如果 sysdump 设备丢失，则需要进行创建。
]/#mklv -t sysdump -y lg_dumplv rootvg 8 hdisk1
]/#sysdumpdev -Pp /dev/lg_dumplv
]/#sysdumpdev -l -
拆除卷组 rootvg 镜像，移除故障盘物理卷，清除故障盘信息。
]/#unmirrorvg rootvg hdisk0
0516-1246 rmlvcopy: If hd5 is the boot logical volume, please run 'chpv -c <diskname>'
as root user to clear the boot record and avoid a potential boot
off an old boot image that may reside on the disk from which this
logical volume is moved/removed.
0516-1804 chvg: The quorum change takes effect immediately.
0516-1144 unmirrorvg: rootvg successfully unmirrored, user should perform
bosboot of system to reinitialize boot records. Then, user must modify
bootlist to just include: hdisk1.
]/#lsvg rootvg
VOLUME GROUP: rootvg VG IDENTIFIER: 00f9838900004c0000000149a2d111cf
VG STATE: active PP SIZE: 512 megabyte(s)
VG PERMISSION: read/write TOTAL PPs: 1116 (571392 megabytes)
MAX LVs: 256 FREE PPs: 808 (413696 megabytes)
LVs: 15 USED PPs: 308 (157696 megabytes)
OPEN LVs: 14 QUORUM: 2 (Enabled)
TOTAL PVs: 2 VG DESCRIPTORS: 3
STALE PVs: 0 STALE PPs: 0
ACTIVE PVs: 2 AUTO ON: yes
MAX PPs per VG: 32512
MAX PPs per PV: 1016 MAX PVs: 32
LTG size (Dynamic): 1024 kilobyte(s) AUTO SYNC: no
HOT SPARE: no BB POLICY: relocatable
PV RESTRICTION: none INFINITE RETRY: no
]/#lsvg -l rootvg
rootvg:
LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT
hd5 boot 1 1 1 closed/syncd N/A
hd6 paging 32 32 1 open/syncd N/A
hd8 jfs2log 1 1 1 open/syncd N/A
hd4 jfs2 20 20 1 open/syncd /
hd2 jfs2 30 30 1 open/syncd /usr
hd9var jfs2 20 20 1 open/syncd /var
hd3 jfs2 20 20 1 open/syncd /tmp
hd1 jfs2 120 120 1 open/syncd /home
hd10opt jfs2 20 20 1 open/syncd /opt
hd11admin jfs2 1 1 1 open/syncd /admin
lg_dumplv sysdump 20 20 1 open/syncd N/A
livedump jfs2 1 1 1 open/syncd /var/adm/ras/livedump
loglv00 jfslog 1 1 1 open/syncd N/A
lv00 jfs 1 1 1 open/syncd /var/adm/csd
fslv00 jfs2 20 20 1 open/syncd /isc
]/#reducevg rootvg hdisk0
]/#chpv -c hdisk0 -
硬盘热拔插更换。
使用
diag命令进行热插拔更换。Preparing to Remove and Replace a Disk Drive in AIX
或使用
rmdev -dl hdisk0直接删除硬盘。更换时可能遇到进程占用导致磁盘忙问题，可根据实际情况杀掉占用进程。
]/#fuser /dev/hdisk0
/dev/hdisk0: 22282522
]/#proctree 22282522
22282522 /usr/bin/topas_nmon -f -d -T -^ -J -s 300 -c 288 -youtput_dir=/KIC/LOG/NMON/TR
]/#kill -9 22282522
]/#fuser /dev/hdisk0
/dev/hdisk0: -
重新配置卷组 rootvg 镜像。
]/#cfgmgr -v
]/#lspv
hdisk0 none None
hdisk1 00f98389cb6fdbfe rootvg active
]/#chdev -l hdisk0 -a pv=yes
hdisk0 changed
]/#extendvg rootvg hdisk0
]/#lspv
hdisk0 00f983897ac05ab6 rootvg active
hdisk1 00f98389cb6fdbfe rootvg active
]/#mirrorvg -S rootvg hdisk0
0516-1804 chvg: The quorum change takes effect immediately.
0516-1126 mirrorvg: rootvg successfully mirrored, user should perform
bosboot of system to initialize boot records. Then, user must modify
bootlist to include: hdisk0 hdisk1.
]/#lsvg rootvg
VOLUME GROUP: rootvg VG IDENTIFIER: 00f9838900004c0000000149a2d111cf
VG STATE: active PP SIZE: 512 megabyte(s)
VG PERMISSION: read/write TOTAL PPs: 1116 (571392 megabytes)
MAX LVs: 256 FREE PPs: 520 (266240 megabytes)
LVs: 15 USED PPs: 596 (305152 megabytes)
OPEN LVs: 15 QUORUM: 1 (Disabled)
TOTAL PVs: 2 VG DESCRIPTORS: 3
STALE PVs: 1 STALE PPs: 288
ACTIVE PVs: 2 AUTO ON: yes
MAX PPs per VG: 32512
MAX PPs per PV: 1016 MAX PVs: 32
LTG size (Dynamic): 1024 kilobyte(s) AUTO SYNC: no
HOT SPARE: no BB POLICY: relocatable
PV RESTRICTION: none INFINITE RETRY: no
]/#lsvg -l rootvg
rootvg:
LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT
hd5 boot 1 2 2 closed/syncd N/A
hd6 paging 32 64 2 open/stale N/A
hd8 jfs2log 1 2 2 open/stale N/A
hd4 jfs2 20 40 2 open/stale /
hd2 jfs2 30 60 2 open/stale /usr
hd9var jfs2 20 40 2 open/stale /var
hd3 jfs2 20 40 2 open/stale /tmp
hd1 jfs2 120 240 2 open/stale /home
hd10opt jfs2 20 40 2 open/stale /opt
hd11admin jfs2 1 2 2 open/stale /admin
lg_dumplv sysdump 20 20 1 open/syncd N/A
livedump jfs2 1 2 2 open/stale /var/adm/ras/livedump
loglv00 jfslog 1 2 2 open/stale N/A
lv00 jfs 1 2 2 open/stale /var/adm/csd
fslv00 jfs2 20 40 2 open/stale /isc -
等待镜像同步完成，LV STATE 由
stale变为syncd。]/#lsvg -l rootvg
rootvg:
LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT
hd5 boot 1 2 2 closed/syncd N/A
hd6 paging 32 64 2 open/syncd N/A
hd8 jfs2log 1 2 2 open/syncd N/A
hd4 jfs2 20 40 2 open/syncd /
hd2 jfs2 30 60 2 open/syncd /usr
hd9var jfs2 20 40 2 open/syncd /var
hd3 jfs2 20 40 2 open/syncd /tmp
hd1 jfs2 120 240 2 open/syncd /home
hd10opt jfs2 20 40 2 open/syncd /opt
hd11admin jfs2 1 2 2 open/syncd /admin
lg_dumplv sysdump 20 20 1 open/syncd N/A
livedump jfs2 1 2 2 open/syncd /var/adm/ras/livedump
loglv00 jfslog 1 2 2 open/syncd N/A
lv00 jfs 1 2 2 open/syncd /var/adm/csd
fslv00 jfs2 20 40 2 open/syncd /isc
]/#lsvg rootvg
VOLUME GROUP: rootvg VG IDENTIFIER: 00f9838900004c0000000149a2d111cf
VG STATE: active PP SIZE: 512 megabyte(s)
VG PERMISSION: read/write TOTAL PPs: 1116 (571392 megabytes)
MAX LVs: 256 FREE PPs: 520 (266240 megabytes)
LVs: 15 USED PPs: 596 (305152 megabytes)
OPEN LVs: 14 QUORUM: 1 (Disabled)
TOTAL PVs: 2 VG DESCRIPTORS: 3
STALE PVs: 0 STALE PPs: 0
ACTIVE PVs: 2 AUTO ON: yes
MAX PPs per VG: 32512
MAX PPs per PV: 1016 MAX PVs: 32
LTG size (Dynamic): 1024 kilobyte(s) AUTO SYNC: no
HOT SPARE: no BB POLICY: relocatable
PV RESTRICTION: none INFINITE RETRY: no -
配置系统启动设备。
]/#bootlist -m normal -o
hdisk0 pathid=0
hdisk1 blv=hd5 pathid=0
]/#bosboot -ad hdisk0
bosboot: Boot image is 55324 512 byte blocks.
]/#bootlist -m normal hdisk0 hdisk1
]/#bootlist -m normal -o
hdisk0 blv=hd5 pathid=0
hdisk1 blv=hd5 pathid=0 -
To delete all entries from the error log.
]/#errclear 0
-
Deactivating the indicator light by using AIX diagnostics.
a. Log in as root user.
b. At the command line, typediagand press Enter.
c. From the Function Selection menu, select Task Selection and press Enter.
d. From the Task Selection menu, select Identify and Attention Indicators and press Enter.
e. From the list of lights, select the location code for the part or Set System Attention Indicator to NORMAL and press Enter. When a light is activated for a part, an I character precedes the location code.
f. Select Commit.
g. Exit to the command line.
All articles on this blog are licensed under CC BY-NC-SA 4.0 unless otherwise stated.
