IBM AIX 7.3 – Common Problem 148 – Diagnosis and Fix

📖 ~1 min read

Table of contents

1. Symptom & Impact
2. Environment & Reproduction
3. Root Cause Analysis
4. Quick Triage
5. Step-by-Step Diagnosis
6. Solution – Primary Fix
7. Solution – Alternative Approaches
8. Verification & Acceptance Criteria
9. Rollback Plan
10. Prevention & Hardening
11. Related Errors & Cross-Refs
12. References & Further Reading

Symptom & Impact

`errpt` is dominated by `RMCD_RM_HA_INFO` and `IBM.MgmtDomainRM` events filling `/var`.

Environment & Reproduction

AIX 7.3 LPAR registered with HMC and PowerHA where RMC heartbeat is unstable.

Root Cause Analysis

RMC subsystem cannot reach the HMC due to a firewall rule on the management VLAN.

Quick Triage

Run `lssrc -s ctrmc`, `rmcdomainstatus -s ctrmc`, and `errpt -j RMCD_RM_HA_INFO`.

Step-by-Step Diagnosis

Capture `/var/ct/IW/log/mc/IBM.MgmtDomainRM/trace*` for the affected timeframe.

Solution – Primary Fix

Restart RMC cleanly: `rmcctrl -z` then `rmcctrl -A` after the firewall rule is corrected.

Solution – Alternative Approaches

Re-register with HMC: `mkrsct -r ManagementServer -p ` and `rmcctrl -p`.

Verification & Acceptance Criteria

`rmcdomainstatus -s ctrmc` reports `RC=0 Active` and errpt flood stops.

Rollback Plan

Disable RMC temporarily with `rmcctrl -d` if it threatens to fill `/var`.

Prevention & Hardening

Allow ports 657/tcp and 657/udp HMC-to-LPAR and monitor `errpt -d S -T PERM` daily.

Related Errors & Cross-Refs

Related to HMC `dlpar` failures and `0931-001` console resource errors.

Related tutorial: View the step-by-step tutorial for aix-7.3.

View all aix-7.3 tutorials on the Tutorials Hub →

Browse all common problems & solutions on the Tutorials Hub.

References & Further Reading

IBM Docs: AIX RMC/RSCT troubleshooting, HMC LPAR dynamic operations.