IBM AIX 7.3 – Common Problem 024 – Diagnosis and Fix

📖 ~1 min read

Table of contents

1. Symptom & Impact
2. Environment & Reproduction
3. Root Cause Analysis
4. Quick Triage
5. Step-by-Step Diagnosis
6. Solution – Primary Fix
7. Solution – Alternative Approaches
8. Verification & Acceptance Criteria
9. Rollback Plan
10. Prevention & Hardening
11. Related Errors & Cross-Refs
12. References & Further Reading

Symptom & Impact

PowerHA cluster node remains in joining state and resource group never acquires.

Environment & Reproduction

IBM AIX 7.3 LPAR exhibiting HACMP / PowerHA failover issues under standard PowerVM workloads.

clmgr query cluster
lssrc -ls clstrmgrES

Root Cause Analysis

Network heartbeat path down or RSCT topology cannot form quorum.

Quick Triage

Confirm scope with errpt, recent changes, and subsystem state via lssrc.

clmgr -v query node
lssrc -ls clstrmgrES

Step-by-Step Diagnosis

Inspect cluster.log, clstrmgr state, and network interfaces.

tail /var/hacmp/log/cluster.log
clmgr query network

Solution – Primary Fix

Restart the cluster node services after fixing the heartbeat network.

clmgr offline node node1
clmgr online node node1

Solution – Alternative Approaches

Manually bring the resource group online on a healthy node.

Verification & Acceptance Criteria

Confirm subsystem returns to RUNNING state and errpt shows no new entries.

clmgr query rg
clRGinfo -p

Rollback Plan

Restore prior configuration from mksysb or alt_disk_install clone if the fix regresses.

clmgr offline node node1 -p sticky

Prevention & Hardening

Encode the fix in NIM customisation scripts and monitor via topas/nmon.

smit sysmirror  # verify cluster annually

Related Errors & Cross-Refs

errpt LABEL=TOPSVCS_*; node_down events

Related tutorial: View the step-by-step tutorial for aix-7.3.

View all aix-7.3 tutorials on the Tutorials Hub →

Browse all common problems & solutions on the Tutorials Hub.

References & Further Reading

IBM PowerHA SystemMirror administration