HP ProLiant BL · Dell PowerEdge · IBM MegaRAID

🖥️ Server Hardware Reference Guide

HP ProLiant BL Series · HP C7000 Blade Chassis · Dell PowerEdge · IBM MegaRAID · L3 Deep Technical Q&A

HP iLO / OA Dell iDRAC / racadm C7000 Blade Chassis RAID · Firmware · Scenarios
💽

HP Smart Array, IBM MegaRAID & HP ILO

RAID controller management, Smart Array commands, IBM MegaRAID storcli/MegaCli, and HP iLO out-of-band management

01

HP HPSSACLI / HPACUCLI — Smart Array Commands

# Show full controller config hpssacli ctrl all show config hpssacli ctrl all show config | egrep -i 'reb|rec' # rebuilding/recovery # Controller status hpssacli ctrl all show status hpssacli ctrl all show detail | egrep "Firmware Version:|Array" # Physical drive status hpssacli ctrl slot=0 pd all show status hpssacli ctrl slot=0 pd 2I:1:6 show detail # View logical drives hpssacli ctrl slot=0 ld all show hpssacli ctrl slot=0 ld 2 show # Create RAID logical drives hpssacli ctrl slot=0 create type=ld drives=1I:1:3 raid=0 hpssacli ctrl slot=0 create type=ld drives=1I:1:3,1I:1:4 raid=1 hpssacli ctrl slot=0 create type=ld drives=1I:1:3,1I:1:4,2I:1:6,2I:1:7,2I:1:8 raid=5 # LED management (locate physical disk) hpssacli ctrl slot=0 ld 2 modify led=on hpssacli ctrl slot=0 ld 2 modify led=off hpssacli ctrl slot=0 pd 1I:4:1 modify led=on # Blink Fault LED # Reenable a failed logical drive hpssacli ctrl slot=0 ld 10 modify reenable forced # Add spare disks hpssacli ctrl slot=0 array all add spares=2I:1:6,2I:1:7 # HP hardware health check hpasmcli -s 'SHOW FAN; SHOW TEMP; SHOW POWERSUPPLY' # Individual drive detail ssacli ctrl slot=0 pd 1I:1:14 show detail
QExplain RAID levels 0, 1, and 5. When would you use each?
▸ ANSWER

RAID 0 (Striping) — data split across all disks, best performance, NO redundancy. If one disk fails, ALL data lost. Use for: temp/scratch data, caches. RAID 1 (Mirroring) — exact copy on two disks. Can lose one disk. Reads are fast (both disks serve reads). Use for: OS drives, boot volumes. RAID 5 (Distributed Parity) — data + parity distributed across 3+ disks. Can lose 1 disk. Good balance of performance/redundancy. Use for: data volumes. RAID 6 — like RAID 5 but can lose 2 disks (double parity). For production critical storage.

QHow do you identify a failing physical disk and replace it in HP server?
▸ ANSWER
  1. 1Check status: hpssacli ctrl slot=0 pd all show status — look for "Predictive Failure" or "Failed"
  2. 2Get drive location: hpssacli ctrl slot=0 pd 2I:1:6 show detail — note Port, Box, Bay
  3. 3Blink the LED: hpssacli ctrl slot=0 pd 2I:1:6 modify led=on — physically identify the drive
  4. 4Hot-swap the drive (if RAID allows)
  5. 5Turn off LED: hpssacli ctrl slot=0 pd 2I:1:6 modify led=off
  6. 6Rescan: hpssacli rescan
  7. 7Monitor rebuild: hpssacli ctrl slot=0 ld all show status
02

IBM MegaRAID storcli & MegaCli Commands

# Show controller info /opt/MegaRAID/storcli/storcli64 /c0 show all # Physical disk slot/state list /opt/MegaRAID/MegaCli/MegaCli64 -PDList -aALL \ | egrep -i 'slot|state' | grep -v Forei | paste - - # Locate a disk (blink LED) /opt/MegaRAID/storcli/storcli64 /c0/e23/s12 start locate /opt/MegaRAID/storcli/storcli64 /c0/e8/s0 start locate # Delete preserved cache (use if controller stuck) /opt/MegaRAID/storcli/storcli64 /c0/v11 delete preservedcache # IBM RAID creation (RAID 0, disk at enclosure:slot) /opt/MegaRAID/MegaCli/MegaCli64 -CfgLdAdd -r0 [8:5] -a0 # Firmware check dmidecode | egrep -i 'rel|rev|prod' dmidecode -t 0 | grep Firmware
QWhat is "preserved cache" in MegaRAID and when do you delete it?
▸ ANSWER

Preserved cache is write-back cache stored in the controller's battery-backed memory when a virtual drive goes offline unexpectedly (e.g., power loss, disk failure). The controller preserves this cache to prevent data loss hoping the drives come back. If the drives are gone permanently (replaced), the controller keeps this orphaned cache and may block operations. You then run storcli64 /c0/v11 delete preservedcache to clear it. Only do this when you're certain the data isn't needed — it's a destructive operation.

03

HP ILO — Out-of-Band Management

# Find ILO IP address hponcfg -w /tmp/ilo.out cat /tmp/ilo.out # Reset ILO password via XML rpm -ivh /mnt/ilo6_hponcfg-3.2.0-0.noarch.rpm # Create XML file: /tmp/pwd_ilo.xml cat > /tmp/pwd_ilo.xml <<'EOF' <RIBCL VERSION="2.0"> <LOGIN USER_LOGIN="x" PASSWORD="x"> <USER_INFO MODE="write"> <MOD_USER USER_LOGIN="Administrator"> <PASSWORD value="Welcome1"/> </MOD_USER> </USER_INFO> </LOGIN> </RIBCL> EOF chmod 755 /tmp/pwd_ilo.xml hponcfg -f /tmp/pwd_ilo.xml
QWhat is ILO and why is it important in enterprise server management?
▸ ANSWER

ILO (Integrated Lights-Out) is HP's out-of-band management technology. It's a dedicated management processor with its own network port that allows admins to manage servers even when the OS is down, crashed, or the server is powered off. Features: remote console (KVM), remote power on/off/reset, hardware health monitoring, firmware updates, virtual media mounting, BIOS configuration. IBM equivalent is IMM (Integrated Management Module). Dell calls it iDRAC. Essential for remote data centers where physical access is impractical.

🔷

HP BladeSystem C7000 & BL Series

c7000 chassis components, Onboard Administrator, Virtual Connect, iLO deep dive, blade recovery, firmware updates

Q1

Describe the HP BladeSystem c7000 chassis architecture — all major hardware components.

▸ ANSWERc7000 is a 10U enclosure housing up to 16 half-height or 8 full-height blade servers.

  • Onboard Administrator (OA) — dual redundant management modules (slots 1 & 2). Provides web UI, CLI, SNMP, REST API. Manages power, cooling, firmware, and inter-module communication.
  • Blade Server Bays (1–16) — house BL460c, BL680c, BL2x220c. Half-height blades = 1 bay; full-height = 2 bays.
  • Power Supply Bays (1–6) — up to six hot-plug PSUs. Minimum 4 for N+1 redundancy under full load.
  • Fan Bays (1–10) — ten hot-plug redundant fans with zone-based cooling. Active Cool fans auto-adjust from thermal sensors.
  • Interconnect Module Bays (1–8) — network (FlexFabric, VC) and SAN (FC, SAS) modules. Bays 1–2 = LOM connected; Bays 3–8 = mezzanine card connected.
  • Insight Display — front LCD for chassis status, IP config, and UID control.
  • Midplane — backplane connecting blades to interconnect modules and power distribution.
Key OA CLI: show enclosure info | show server list | poweroff server 3 | iLO reset 5 | show interconnect list | show power
Q2

What is the HP Onboard Administrator (OA)? What can and cannot be configured through it?

▸ ANSWERThe OA is the chassis management controller — equivalent to Dell's CMC. Runs embedded firmware.
✅ CAN DO
  • Power on/off/reset individual blades, set power capping per bay
  • Configure interconnect modules
  • Update blade iLO firmware remotely
  • Configure LDAP/RADIUS for OA authentication
  • Configure enclosure SNMP traps
  • Manage Virtual Connect from OA CLI
  • Configure UID LEDs, download chassis-wide logs
  • Configure rack topology
❌ CANNOT DO
  • OS-level management (that is iLO's job)
  • Configure BIOS/boot order (done via iLO or iLO RESTful API)
  • Access individual disk controllers (done via Smart Array in iLO)
  • Manage VM workloads
Access: SSH to OA IP, HTTPS web UI, SNMP. Dual OA setup — primary active, secondary standby. Failover is automatic on primary OA failure.
Q3

Explain the Virtual Connect (VC) module in c7000. What problem does it solve and how do you manage it?

▸ ANSWERVirtual Connect solves the N×M cabling problem in blade environments. Without VC, each blade's NICs would require individual cables to top-of-rack switches — in a 16-blade chassis that's 32+ cables.
  • Abstraction: VC presents virtual MAC addresses and WWNs to blades. Physical upstream connections are shared. When a blade is replaced, the same virtual MAC/WWN is reassigned — server identity preserved without switch reconfiguration.
  • Uplink aggregation: VC modules aggregate blade traffic to a small number of uplinks to the core network.
  • Server Profiles: define which networks and fabrics a blade can access. Profiles contain virtual MACs, WWNs, network assignments, and bandwidth policies.
  • Management: HP OneView or VC Manager GUI, OA CLI (vc manager commands), or REST API.
  • Common issue: Server profile conflict when re-seating blades — resolve by reassigning or cloning the profile.
★ PRO TIP: Interviewers ask: "What happens when a blade is removed and re-inserted in a different bay?" Answer: VC profile re-assignment — the virtual MAC/WWN follows the profile, not the physical blade bay.
Q4

What is HP iLO and how is it different from the OA? What can you do in iLO that you cannot do in OA?

▸ ANSWERiLO (Integrated Lights-Out) is the per-blade management controller embedded on every HP ProLiant server. It is independent of the OS — has its own processor, memory, NIC, and power from the chassis standby rail. You can access iLO even when the OS is down, hung at POST, or powered off.
CapabilityiLOOA
Management scopeIndividual server (OS + hardware level)Entire chassis (power, cooling, interconnects)
OS independenceYes — works when OS is downYes — chassis level
Virtual console (KVM)✅ Yes❌ No
BIOS configuration✅ Yes❌ No
RAID management✅ via Smart Array❌ No
Virtual media (ISO mount)✅ Yes❌ No
iLO versionsiLO 4 (Gen8/9), iLO 5 (Gen10), iLO 6 (Gen11)N/A
APIRedfish (iLO 5+)REST/SNMP
In BL blades, iLO uses OA backplane connection — there is no physical iLO NIC port on the blade itself.
Q5

Walk me through remotely recovering a blade server with a hung kernel (OS unresponsive).

▸ ANSWERL3 remote recovery procedure using iLO:
  1. Access iLO web UI or SSH: ssh Administrator@<iLO-IP>. If iLO unreachable, access via OA CLI → iLO connect <blade-number>
  2. Check IML: verify iLO System Health for hardware faults (memory ECC errors, processor faults, storage alerts)
  3. Virtual Console: launch HTML5 iLO remote console — if hung kernel, you'll see the Linux panic output or frozen screen
  4. Attempt graceful shutdown first: iLO Power & Thermal → Momentary Press (sends ACPI power button signal). Wait 60 seconds.
  5. If no response: Force Power Off (hard power cycle). Document as unclean shutdown.
  6. After reboot: use virtual console to monitor POST and OS boot. If boot fails, mount ISO via iLO Virtual Media to boot from rescue image.
  7. Post-recovery: check IML for hardware alerts, check OS logs (/var/log/messages, dmesg) after recovery.
Q6

How do you update iLO firmware, BIOS, and Smart Array firmware on HP BL blades in production?

▸ ANSWER
MethodDescriptionRequires Reboot?
HP SPP (Service Pack for ProLiant)Bootable ISO containing all firmware/drivers. Mount via iLO Virtual Media, run interactive/automated update. Best for full stack updates.Yes
HP iLO Amplifier / OneViewCentralized firmware management. Detects versions, applies baseline. Can update iLO firmware online (no reboot for iLO-only in iLO 4+).iLO: No; BIOS: Yes
OA CLI pushFIRMWARE UPDATE <bay> — updates iLO firmware to all blades from OA without booting OS.No (iLO only)
HP Smart Update Manager (SUM)Run on Linux, deploys RPM packages for online firmware update. Updates BIOS, NIC, Smart Array online.Yes (BIOS)
Satellite + firmware RPMsHP provides firmware as RPMs via HPE Software Delivery Repository. Deploy via package management.Yes
Production best practice: test on non-production blade first, schedule change window, verify iLO firmware compatibility matrix before BIOS update, always have iLO console access ready during BIOS update in case of POST failure.
🔶

Dell PowerEdge — iDRAC, PERC & Lifecycle Controller

iDRAC vs iLO comparison, racadm CLI commands, Lifecycle Controller, PERC RAID management

Q7

Compare HP iLO and Dell iDRAC — functional equivalents and key differences.

▸ ANSWER
FeatureHP iLODell iDRAC
Management ControlleriLO (Integrated Lights-Out)iDRAC (Integrated Dell Remote Access Controller)
Current GenerationiLO 6 (Gen11)iDRAC9 (14G/15G), iDRAC10 (16G)
Chassis ManagementOA (Onboard Administrator)CMC (M-series), OME (rack)
API StandardRedfish (iLO 5+), REST APIRedfish, WSMAN, REST API
Remote ConsoleIRC Java/HTML5Virtual Console Java/HTML5, iDRAC Direct
Firmware ManagementHPE OneView, SPP, SUMiDRAC, OMSA, Lifecycle Controller
Storage ManagementHP SSA / SSACLIOMSA / racadm / PERC / storcli
OS DeploymentiLO Virtual Media + PXEiDRAC Virtual Media + Lifecycle Controller
Free LicenseiLO Standard (basic)iDRAC Basic (limited), Enterprise (full)
Q8

What is racadm and how do you use it for remote Dell server management? Give key commands.

▸ ANSWERracadm is the Dell CLI for iDRAC management. Available as remote racadm, local racadm, or SSH to iDRAC.
# System info & sensors racadm -r <iDRAC-IP> -u root -p <pass> getsysinfo racadm -r <IP> -u root -p <pass> getsensorinfo # Power actions racadm -r <IP> -u root -p <pass> serveraction graceshutdown racadm -r <IP> -u root -p <pass> serveraction hardreset # iDRAC network config racadm -r <IP> -u root -p <pass> getniccfg racadm -r <IP> -u root -p <pass> setniccfg -s <static-IP> <mask> <gateway> # PERC RAID status racadm -r <IP> -u root -p <pass> raid get vdisks -t racadm -r <IP> -u root -p <pass> raid get pdisks -t # Hardware event log racadm -r <IP> -u root -p <pass> getsel racadm -r <IP> -u root -p <pass> clrsel # Soft reset iDRAC (does NOT power cycle server) racadm -r <IP> -u root -p <pass> racreset # Mount virtual media racadm -r <IP> -u root -p <pass> remoteimage -c -u <user> -p <pass> -l <NFS/CIFS-path>
Q9

What is the Dell Lifecycle Controller and how is it used in production?

▸ ANSWERThe Lifecycle Controller is firmware embedded in iDRAC providing OS-independent hardware management — accessed during server boot (F10) or via iDRAC.
  • OS Deployment: deploy OS from ISO via virtual media or network share without a PXE server. Configures drivers automatically.
  • Firmware Update: update all server firmware (BIOS, iDRAC, PERC, NIC, PSU) from a network share or attached media in one pass.
  • Hardware Configuration: configure BIOS settings, RAID arrays, network adapter settings, and boot order without booting the OS.
  • Part Replacement: when replacing a system board or PERC controller, LC restores previous configuration from backup — critical for blade swap scenarios.
  • System Erase: securely wipe all data and configuration — used for decommissioning.
  • SupportAssist: collect hardware diagnostics for Dell support.
Access: Boot server → press F10 → Lifecycle Controller UI. Or via iDRAC: Configuration > Lifecycle Controller. Or via racadm: racadm get BIOS.* to view and set BIOS settings.
Q10

How do you manage a Dell PERC RAID controller? Health check, failed drive replacement, storage expansion.

▸ ANSWERPERC (PowerEdge RAID Controller) management tools:
# Show controller status and all drives storcli /c0 show all storcli /c0 /vall show # Virtual drives storcli /c0 /eall/sall show # All physical disks # RAID health via racadm racadm -r <IP> -u root -p <pass> raid get vdisks -t racadm -r <IP> -u root -p <pass> raid get pdisks -t # Monitor rebuild progress after hot-swap storcli /c0/v0 show | grep Progress # Add hot spare storcli /c0/e<encl>/s<slot> add hotsparedrive # Expand storage online (no downtime) storcli /c0/v0 expand size=<GB> # Run consistency check (schedule monthly) storcli /c0/v0 start cc
Critical: Never remove a second disk from a RAID 5 array while first is rebuilding — this causes data loss. Verify rebuild completion before any maintenance.
🔴

Hardware Troubleshooting Scenarios

5 real-world scenarios — power loss, POST failure, VC network outage, iDRAC unreachable, temperature alerts

🔴 Scenario: HP C7000: Full Enclosure Power Loss

You receive a P1 alert that an HP c7000 blade enclosure has lost power. 14 of 16 blades are offline. Two blades show "insufficient power" in OA. The data center reports no power failure at the PDU level. You have OA CLI and iLO access.

Interviewer Probe Questions
  • What is your first diagnostic step via OA CLI?
  • How do you determine if it is a PSU failure or a power budget issue?
  • What OA commands do you use to check power status and PSU health?
  • If two PSUs have failed, what is the recovery procedure?
  • How do you bring the 14 offline blades back online safely?
Strong Candidate Demonstrates
  • SSH to OA IPshow enclosure power (overall power status) → show powersupply all (lists all 6 PSU slots with status, input voltage, output wattage, health) → show server list (power state of all 16 bays)
  • c7000 requires minimum 4 PSUs for N+1 under full load — 2 failures may trip power budget protection.
  • If PSUs failed: identify failed units (status = Failed or Unknown), dispatch data center to physically inspect/replace.
  • Power budget: show enclosure power — if total blade demand exceeds available supply, OA enforces power capping. Solution: reduce power cap on non-critical blades or bring PSUs back online.
  • Safe restart: power on blades in priority order — poweron server <bay> — stagger by 30 seconds to avoid inrush current spike.
  • After recovery: check IML on each blade for hardware faults logged during unclean shutdown.
⚠️ Red Flags — Weak Answers
  • Rebooting all 16 blades simultaneously — risks exceeding power budget and causing repeat failure
  • Not checking PSU input voltage — may indicate upstream PDU issue the DC team missed
🔴 Scenario: HP BL460c: Blade Fails to POST — No Console Output

A critical application blade (BL460c Gen9) does not respond after a scheduled maintenance reboot. iLO shows the server is powered on but the virtual console shows a black screen. OA shows the blade as "Powered On — Health: Degraded".

Interviewer Probe Questions
  • How do you access the server when the console shows a black screen?
  • What is your step-by-step diagnostic process via iLO?
  • What does "Degraded" health in OA typically indicate?
  • How do you check for POST failure codes?
  • What is your escalation path if iLO itself is unresponsive?
Strong Candidate Demonstrates
  • Try iLO virtual console via both Java IWS and HTML5 — sometimes one works when the other does not. Also try iLO text console: ssh to iLO → start /system1/oemhp_vsp1
  • Check IML: iLO > Information > Integrated Management Log — look for critical alerts (DIMM fault, processor fault, POST error code).
  • "Degraded" usually means: failed DIMM (ECC uncorrectable), failed CPU, overtemperature event, or failed storage controller.
  • POST error codes display on the virtual console. On Gen9, check iLO Physical Activity Log for POST-phase errors. HP POST error codes are documented in the server maintenance guide.
  • If black screen persists: perform iLO reset (does NOT reboot the server): OA CLI: iLO reset <bay>. Wait 90 seconds.
  • Escalation: if hardware fault confirmed (e.g., DIMM failure), open HPE support case with IML export and plan blade swap maintenance window.
🔴 Scenario: C7000 VC Module: Network Connectivity Lost on 8 Blades

All 8 blades connected to VC module in interconnect bay 1 have lost network connectivity simultaneously. Blades in bay 2 are fine. Servers respond to iLO management but have no data network.

Interviewer Probe Questions
  • How do you determine if this is a VC module failure, uplink failure, or server profile issue?
  • What OA and VC CLI commands do you use for diagnosis?
  • How do you check uplink status on the VC module?
  • What is the recovery procedure if the VC module has failed?
  • How do you verify server profile assignments during the outage?
Strong Candidate Demonstrates
  • OA CLI: show interconnect list — shows status of all 8 interconnect bays, health, and link state. show interconnect <bay1> — port statistics, link status, firmware version.
  • Connect to VC Manager: vc manager loginshow ports, show networks, show uplinksets — check if uplinks are down.
  • Check VC uplinks: if uplinks to core switch are down, blades lose connectivity but VC module itself may be healthy. Verify on core switch side — are VC trunk ports showing link?
  • If VC module failed: hot-swap replacement is possible in c7000. VC module in bay 1 can be replaced while bay 2 continues. Server profiles are stored in OA, not the VC module — they restore on new module insertion.
  • VC module firmware mismatch after replacement: new module may need firmware update to match bay 2 — do this before re-activating.
🔴 Scenario: Dell PowerEdge: iDRAC Unreachable After OS Patch

After applying OS patches on a Dell R740 server, iDRAC becomes unreachable on the network. The OS is running fine. The iDRAC was accessible before the patch. You have console access to the OS.

Interviewer Probe Questions
  • What could cause iDRAC to lose network connectivity after an OS patch?
  • How do you diagnose and recover iDRAC network settings from within the OS?
  • What racadm commands do you use locally to reset iDRAC network configuration?
  • How do you reset iDRAC to factory defaults if configuration is corrupted?
  • What should you check to prevent this from recurring?
Strong Candidate Demonstrates
  • Root causes: OS network config change affected shared NIC used by iDRAC; iDRAC firmware update in patch triggered reset of NIC config; patching disabled iDRAC Service Module (ISM) which manages shared NIC arbitration.
  • From OS (local racadm): racadm getniccfg — verify current iDRAC IP settings. Reset: racadm setniccfg -s <static-IP> <mask> <gateway>
  • If ISM was affected: systemctl status dcismeng → restart if stopped: systemctl restart dcismeng
  • If config corrupted: racadm racreset — soft reset iDRAC (~2 minutes, does NOT power cycle server). Or: racadm factorydefaults — WARNING: resets all config including credentials.
  • Prevention: exclude iDRAC shared NIC driver packages from OS patching scope, or switch to dedicated iDRAC NIC port to eliminate shared NIC dependency.
⚠️ Red Flags — Weak Answers
  • Attempting iDRAC factory reset without knowing the recovery credentials — locks you out permanently
🔴 Scenario: Dell PowerEdge: Critical Temperature Alert — Degraded Fans

You receive a critical alert: a Dell R640 in production reports inlet temperature at 35°C (threshold 30°C) and CPU temperature at 85°C. Two fans are reported as degraded in iDRAC. Server is still running.

Interviewer Probe Questions
  • What is your immediate triage process?
  • How do you check fan and temperature status via iDRAC and racadm?
  • What Dell thermal management options can you use?
  • At what point do you proactively shutdown the server to prevent hardware damage?
  • What is the root cause investigation process?
Strong Candidate Demonstrates
  • racadm -r <IP> getsensorinfo | grep -i temp — get all temperature readings. racadm -r <IP> getsensorinfo | grep -i fan — check fan RPMs.
  • iDRAC GUI: Hardware > Fans — shows all fan RPMs and status. Identify the two degraded fans (bay location, current RPM vs expected).
  • Dell thermal management: iDRAC > Configuration > Thermal — switch to Maximum Cooling mode (forces all fans to max RPM) as emergency measure while degraded fans are replaced.
  • IPMI force max fan speed: ipmitool -I lanplus -H <iDRAC-IP> -U root -P <pass> raw 0x30 0x30 0x01 0x00
  • Shutdown threshold: if inlet temp exceeds 40°C or any CPU exceeds 95°C, proactive graceful shutdown is warranted. Do not wait for iDRAC auto-shutdown at critical threshold.
  • Root cause: failed fans (bearing failure), blocked airflow (cable management, empty bay without filler panel), cooling system failure (CRACs/CRAHs), elevated DC ambient temperature.
📋

Quick Reference — HP OA/iLO & Dell iDRAC/racadm Cheat Sheet

Complete command reference for HP OA CLI, iLO CLI, SSACLI, Dell racadm, and storcli

REF

Quick Reference — HP OA/iLO & Dell iDRAC/racadm Command Cheat Sheet

TaskHP OA / iLO Command
Show all blades statusshow server list (OA CLI)
Power on blade in bay 3poweron server 3 (OA CLI)
Reset iLO on bay 5iLO reset 5 (OA CLI)
Show PSU statusshow powersupply all (OA CLI)
Show enclosure powershow enclosure power (OA CLI)
Show interconnect modulesshow interconnect list (OA CLI)
iLO SSH loginssh Administrator@<iLO-IP>
Show IML via iLO CLIshow /system1/log1 (iLO CLI)
Start virtual consolestart /system1/oemhp_vsp1 (iLO CLI)
Show RAID via SSACLIssacli ctrl slot=0 ld all show
Show physical disksssacli ctrl slot=0 pd all show status
Rebuild statusssacli ctrl slot=0 ld 1 show detail | grep -i progress
Taskracadm / storcli Command
Get system inforacadm -r <IP> -u root -p <pass> getsysinfo
Get all sensor dataracadm -r <IP> -u root -p <pass> getsensorinfo
Graceful shutdownracadm -r <IP> -u root -p <pass> serveraction graceshutdown
Hard resetracadm -r <IP> -u root -p <pass> serveraction hardreset
Get hardware event logracadm -r <IP> -u root -p <pass> getsel
Get iDRAC NIC configracadm -r <IP> -u root -p <pass> getniccfg
Soft reset iDRACracadm -r <IP> -u root -p <pass> racreset
Show RAID virtual disksstorcli /c0 /vall show
Show all physical disksstorcli /c0 /eall/sall show
Check rebuild progressstorcli /c0/v0 show | grep Progress
Add hot sparestorcli /c0/e<enc>/s<slot> add hotsparedrive
Run consistency checkstorcli /c0/v0 start cc
☀️

Oracle SPARC Server Hardware — Complete Study Guide

T Series · M Series · S Series · V Series · SuperCluster — Architecture, Features, Administration & L3 Interview Guide

OVR

Oracle SPARC Server Portfolio — Overview & Series Comparison

Oracle SPARC servers are enterprise-grade systems built around the SPARC (Scalable Processor ARChitecture) processor family. Unlike x86, SPARC is RISC (Reduced Instruction Set Computing) architecture, designed for extreme reliability, RAS (Reliability, Availability, Serviceability), and mission-critical workloads. All SPARC servers run Oracle Solaris.

SeriesProcessorMarket SegmentKey StrengthTypical Workloads
T Series (CMT)SPARC T4 → T8Mid-range / Scale-outThread-dense — massive parallelism (256 threads in T8)Web servers, Java apps, database frontends, cloud workloads
M Series (SMP)SPARC M7 → M12High-end / Mission-criticalExtreme RAS, large SMP, huge RAM capacity (up to 32TB)Core banking, ERP, Oracle DB, mission-critical OLTP
S Series (Superserver)SPARC S7Entry-level / DepartmentCost-effective, Software in Silicon, in-memory securityDev/test, SMB workloads, departmental database
V Series (x86 + SPARC)VariesVirtual/CloudEngineered system integration, VM consolidationMixed Oracle workload consolidation
SuperClusterT/M SeriesEngineered SystemFull-stack optimisation (HW+OS+DB+Middleware)Oracle Exadata alternative — Oracle DB + middleware
Key differentiator for interviews: SPARC servers feature Software in Silicon — hardware acceleration for cryptography, database compression, deduplication, and security monitoring built directly into the SPARC processor. This means zero CPU overhead for these operations.

☀️ T Series — SPARC CMT (Chip Multithreading) Servers

T-01

T Series Architecture — CMT & Thread Density

CMT = Chip Multithreading — the defining characteristic of T Series. A single SPARC T8 chip has 32 cores × 8 threads = 256 hardware threads per socket. Compare to a typical x86 server: 32 cores × 2 threads = 64 threads.

CMT was designed to handle thousands of concurrent requests by keeping the CPU pipeline full with many threads, tolerating memory latency by switching threads during cache misses.

ProcessorCores/SocketThreads/CoreMax Threads/SocketMax Clock SpeedL3 Cache
SPARC T488643.0 GHz4 MB/core
SPARC T51681283.6 GHz8 MB/core
SPARC T73282564.13 GHz256 MB total
SPARC T83282564.5 GHz256 MB total

T Series Server Models:

  • T4-1 / T5-1 / T7-1 / T8-1 — Single socket, 1U/2U rack server. Entry-level CMT.
  • T4-2 / T5-2 / T7-2 / T8-2 — Dual socket, 2U rack server. Most common deployment.
  • T4-4 / T5-4 / T7-4 — 4-socket server. 512 threads in a T5-4.
  • T4-1B / T5-1B / T7-1B — Blade server form factor for Oracle SPARC T4 Blade Server System.
  • T5-8 / T7-4 — 8-socket/4-socket max scale CMT configurations.
★ PRO TIP: When an interviewer asks "how many CPUs does a T5-2 have?" — answer: 2 sockets × 16 cores × 8 threads = 256 hardware threads total. Distinguish between sockets, cores, and threads. SPARC counts differ from x86.
T-02

T Series Key Features — Software in Silicon & RAS

Software in Silicon — hardware-accelerated capabilities built into the SPARC T7/T8 processor die:

Silicon FeatureDescriptionBenefit vs x86
Crypto acceleration (DAX)AES-NI equivalent but broader: RSA, SHA, DES, 3DES, RC4, MD5 all in hardwareZero CPU overhead for TLS, VPN, database encryption
Database in SiliconSQL operators (scan, filter, decompression) accelerated in hardwareOracle DB queries run 2-10x faster with no software change
Dedup/CompressionZFS inline compression/deduplication in hardwareDoubles effective storage, zero CPU penalty
Silicon Secured Memory (SSM)Hardware memory tagging — detects buffer overflows at nanosecond speedCatches exploits like HeartBleed in hardware, not software
Palomar (Query Acceleration)Offloads Oracle DB column store scanning to the processorDirect Oracle DB performance improvement built into CPU

RAS Features (Reliability, Availability, Serviceability):

  • Chipkill ECC — corrects multi-bit memory errors. Goes beyond standard single-bit ECC correction.
  • Hot-plug DIMMs (M Series) — replace memory modules without downtime.
  • CPU/Core retirement — faulty cores are automatically retired and marked offline by the hypervisor. System continues operating.
  • Memory mirroring — duplicate all memory writes to a mirror for immediate failover.
  • Memory sparing — a DIMM row is held in reserve; activated automatically when a DIMM begins failing.
  • Predictive self-healing (ASR) — Automatic System Recovery. Faulty components are detected before failure and automatically taken offline.
  • FMA (Fault Management Architecture) — Solaris fault management framework. Every hardware fault generates a structured fault event (UUID) with automated diagnosis and suggested repair action.
T-03

T Series Administration — ILOM, OBP & Key Commands

ILOM — Integrated Lights Out Manager (equivalent to HP iLO / Dell iDRAC)
# Access ILOM via SSH ssh root@ # ILOM CLI — show system health -> show /System -> show /System/Fans -> show /System/Power_Supply -> show /System/Processors # Show environmental status -> show /SYS # Show host power state -> show /HOST # Power on/off server -> set /HOST/domain/control send_break_action=break -> set /System/component_state=Disabled # graceful shutdown -> set /System/component_state=Enabled # power on # Show fault list -> show -level all /SP/faultmgmt/shell # Reset ILOM (does NOT power cycle server) -> reset /SP # Show ILOM firmware version -> show /SP/firmware_version # Set ILOM IP (static) -> set /SP/network pendingipaddress=x.x.x.x pendingipnetmask=255.255.255.0 pendingipgateway=x.x.x.x -> set /SP/network commitpending=true # ILOM Web UI https://
OBP — OpenBoot PROM (Solaris boot firmware, equivalent to BIOS/UEFI)
# Access OBP — interrupt from ILOM: -> set /HOST/domain/control send_break_action=break # Or from console: Stop-A (keyboard) or Break (serial) # OBP key commands: ok> boot # boot from default device ok> boot disk0 # boot from first disk ok> boot cdrom # boot from CD/DVD ok> boot net # boot from network (PXE/jumpstart) ok> boot net -v # verbose network boot ok> boot -s # boot to single user mode (maintenance) ok> boot -r # reconfigure boot (like probe devices) ok> printenv # show all OBP variables ok> setenv boot-device disk0 disk1 # set boot device (with failover) ok> setenv auto-boot? true # enable auto-boot ok> reset-all # cold reset ok> probe-scsi-all # scan and show all SCSI/SAS devices ok> probe-ide-all # scan IDE devices ok> .env # show environment (temps, voltages) ok> show-devs # show device tree
Solaris host administration
# Show CPU topology psrinfo -pv # physical processors, cores, threads psrinfo -v | head # detailed CPU info kstat cpu_info | grep -E "brand|model|ncore|nthread" # Show memory prtconf | grep Memory prtdiag -v | grep -i memory # Show full hardware config prtdiag -v # all hardware components prtfru # FRU (Field Replaceable Unit) list with serial numbers prtconf -vp # OBP device tree # FMA — fault management fmadm faulty # show active faults fmadm repaired # mark fault repaired fmstat # FMA module statistics fmdump -ev # fault event log fmdump -V -u # detail for a specific fault UUID

⬛ M Series — Mission-Critical SMP Servers

M-01

M Series Architecture — SMP & Extreme RAS

The M Series is Oracle's flagship SMP (Symmetric Multiprocessing) server line — designed for absolute maximum reliability for mission-critical workloads like core banking, Oracle databases, and ERP. The M12 supports up to 32 TB of RAM and 384 cores.

ModelProcessorMax SocketsMax CoresMax RAMMax I/O SlotsForm Factor
SPARC M3000SPARC64 VII+1464 GBRack
SPARC M4000SPARC64 VII+28128 GB10 PCIeRack
SPARC M5000SPARC64 VII+416256 GB20 PCIeRack
SPARC M8000SPARC64 VII+832512 GB40 PCIeRack
SPARC M9000SPARC64 VII+16/3264/1282 TB160 PCIeCabinet
SPARC M6-32SPARC M63238432 TBRack
SPARC M7-8SPARC M7825632 TBRack
SPARC M8-8SPARC M8825648 TBRack
SPARC M12-2SSPARC M12419232 TBRack
Key M Series differentiator: M Series uses SPARC64 processors (Fujitsu-designed, used in M3000-M9000) or Oracle-designed SPARC M6/M7/M8 processors (M6-32, M7-8, M8-8). The M12 uses Fujitsu SPARC XII. Interviewers may ask you to distinguish these generations.
M-02

M Series RAS Features — Dynamic Domains & Memory Protection

M Series RAS features go far beyond T Series — designed for five-nines (99.999%) uptime:

  • Dynamic Domains (DR — Dynamic Reconfiguration) — partition the server into independent logical domains, each with its own OS instance. Add or remove CPUs, memory, and I/O from a domain while it is running.
  • Dynamic CPU/Memory Addition — hot-add CPU boards and memory boards to a running system. No downtime.
  • CPU Locking — lock specific CPU cores to a domain to prevent NUMA migration.
  • Mirror Memory Mode — entire memory is mirrored. A single DIMM failure causes zero data loss — the mirror takes over immediately.
  • Memory Scrubbing — continuous background ECC scrubbing detects and corrects single-bit errors before they accumulate into multi-bit errors.
  • XSCF (eXtended System Control Facility) — M Series management controller (equivalent to ILOM in T Series, but more powerful). Manages hardware partitioning, domains, environmental monitoring.
  • Field Replaceable Units (FRUs) — virtually every component is a FRU: CPU boards, memory boards, I/O boards, fans, PSUs, backplanes — all hot-swappable.
  • Predictive Failure Analysis (PFA) — monitors component health trends and predicts failures before they occur.
XSCF — eXtended System Control Facility commands (M Series specific)
# Login to XSCF (management controller) ssh platadm@ # Show system status XSCF> showhardconf # full hardware configuration XSCF> showstatus # environmental status XSCF> showboards # show all boards (CPU, MEM, I/O) XSCF> showdomainstatus -a # status of all domains XSCF> showlogs error # show error logs XSCF> showlogs monitor # monitoring logs # Domain management XSCF> addboard -c assign -d 0 -f MBU_A# add CPU/MEM board to domain 0 XSCF> deleteboard -c unassign MBU_A # remove board from domain XSCF> poweroff -d 0 # power off domain 0 XSCF> poweron -d 0 # power on domain 0 XSCF> reset -d 0 # reset domain 0 # FRU management XSCF> replacefru # guided FRU replacement procedure XSCF> showhardconf -M # show FRU list with location codes XSCF> showfru -s # show FRU serial numbers # Set XSCF network XSCF> setnetwork -i -m -g lan#0 XSCF> applynetwork # apply network changes XSCF> showntp # show NTP config XSCF> setntp -m manual -s # set NTP server
★ PRO TIP: In interviews, clearly distinguish ILOM (T Series, S Series management) from XSCF (M Series management — M3000 through M9000) from Oracle Hardware Management Pack (unified tool for newer systems). Using the wrong tool name for the wrong series is a red flag.
M-03

Dynamic Reconfiguration (DR) — CPU/Memory/IO Hot Operations

DR is one of the most interview-tested M Series features. It allows zero-downtime hardware changes on a live production system.

DR — Solaris OS side (on the domain)
# Check DR status cfgadm -al # show all attachment points cfgadm -al | grep cpu # show CPU attachment points cfgadm -al | grep mem # show memory attachment points # Unconfigure a CPU board (before physical removal) cfgadm -c unconfigure SB0 # unconfigure system board 0 # This migrates all processes off the board, marks CPUs offline # Configure a new board (after physical insertion) cfgadm -c configure SB2 # configure new system board 2 # Memory DR — force a specific memory segment offline cfgadm -c unconfigure -o disable-POST mem:0::0 # Show CPU states psrinfo -p # physical processor info psrinfo -s # check if processor is online/offline # Offline a specific CPU core for maintenance psradm -f # take CPU offline (fail) psradm -n # bring CPU online (normal)
XSCF side — before DR operation
# Check board status before DR XSCF> showboards -a XSCF> showdcl -d 0 # show domain component list # Assign a new board to domain 0 while running XSCF> addboard -c assign -d 0 MBU_B # Verify boards after DR XSCF> showboards -a XSCF> showdomainstatus -d 0
DR Pre-checks before removing a board from a live domain:
1. Verify board is not running critical processes: cfgadm -al SB0
2. Check memory usage — ensure remaining memory can absorb workload: prtconf | grep Memory
3. Check CPU load — ensure remaining CPUs can handle workload: mpstat 1 5
4. Alert application teams before CPU DR — some JVMs do not handle CPU removal gracefully.

🟦 S Series — SPARC S7 Superserver

S-01

SPARC S7-2 & S7-2L Architecture & Features

The SPARC S7 (introduced 2016) is Oracle's entry/mid-range SPARC server — designed to bring Software in Silicon to a more cost-effective platform.

SpecificationSPARC S7-2SPARC S7-2L (Large Memory)
ProcessorSPARC S7 (8 cores/socket)SPARC S7 (8 cores/socket)
Sockets1 or 21 or 2
Max Cores1616
Threads/Core88
Max Threads128128
Clock Speed4.27 GHz4.27 GHz
Max RAM512 GB1 TB
DIMM Slots1632 (extended memory board)
PCIe Slots88
Form Factor2U Rack2U Rack
Storage8 × 2.5" SAS/SATA/SSD8 × 2.5" SAS/SATA/SSD
ManagementILOM 3.2+ILOM 3.2+

Key SPARC S7 Features:

  • Software in Silicon — full DAX (Data Analytics Accelerator), cryptographic acceleration, Silicon Secured Memory (SSM), and Query Acceleration from T7/M7 generation, available at entry-level price.
  • In-Memory Security — Silicon Secured Memory (SSM) detects buffer overflows, heap sprays, and use-after-free attacks in hardware. Enabled with a single kernel parameter change.
  • Oracle Solaris Zones — S7 is well-suited for zone-dense deployments due to its thread count. A 2-socket S7-2 with 128 threads can run 20-40 OS zones efficiently.
  • Oracle VM for SPARC (LDoms) — S7 supports LDoms for hardware virtualisation. Create guest domains for OS isolation.
  • PCIe 3.0 — high-bandwidth I/O for SAN connectivity, 10/25/40 GbE networking.
★ PRO TIP: The S7 is frequently confused with the S Series x86 servers. The SPARC S7 runs Solaris only. If an interviewer asks "can you run Linux on SPARC S7?" — the answer is: Oracle Linux and certain other Linux distributions have limited SPARC support, but the primary and supported OS is Oracle Solaris.
S-02

Silicon Secured Memory (SSM) — Hardware Security Feature

SSM is one of the most distinctive SPARC S7/T7/T8/M7/M8 features. It uses hardware memory tagging to detect memory corruption attacks in the processor itself, before software-level security can even respond.

Attack TypeWithout SSMWith SSM
Buffer overflowExploitable — writes beyond buffer boundary undetectedHardware detects the overflow at the instruction boundary, raises fault
HeartBleed-styleApplication reads beyond allocated memory — leaks dataReads outside tagged region generate hardware exception immediately
Use-after-freeFreed memory still accessible — dangling pointerFreed region's tag invalidated — subsequent access triggers hardware fault
Return-oriented programming (ROP)Stack spray undetectedStack region tagged — unexpected execution path triggers detection
Heap sprayHeap corruption undetectedHeap allocations tagged — cross-region access detected in hardware
Enable SSM on Solaris
# Check if processor supports SSM prtconf -v | grep -i "adi-blk" # ADI = Adi (Address Integrity) — SSM underlying mechanism # Enable SSM in Solaris kernel echo "hardware-adi:1" >> /etc/system # Or via mdb: mdb -kw > adi_version/W 1 > :q # Verify SSM is active kstat -m adi | grep enabled # Test SSM (development use only — triggers intentional fault) # A test program writing outside its tagged region will SIGBUS with SSM active
Interview context: SSM is often called "ADI" (Application Data Integrity) in lower-level documentation — it is the underlying hardware mechanism. SSM is the marketing/feature name. Understanding both terms shows depth.

🟩 V Series — Oracle SPARC V & Virtual Platforms

V-01

Oracle SPARC V Series — Engineered Virtualisation Platforms

The V Series covers Oracle's engineered virtualisation and hybrid platforms that combine SPARC hardware with Oracle software stack integration.

PlatformTypeKey Characteristic
SPARC T4-4 (V-scale)4-socket T SeriesVirtual-dense — 512 hardware threads for zone/LDom consolidation
Oracle VM Server for SPARC (LDoms)Hypervisor (Type-1)Logical Domains — hardware partitioning on SPARC CMT servers
Oracle Solaris ZonesOS VirtualisationLightweight namespace containers within a single Solaris instance
Oracle SuperCluster T8-8Engineered SystemSPARC T8 + ZS7-2 storage + InfiniBand — Oracle DB+middleware optimised
Oracle SuperCluster M8Engineered SystemSPARC M8-8 + ZS7-2 + InfiniBand — mission-critical Oracle stack

Oracle VM Server for SPARC (LDoms) — Architecture:

  • Control Domain — the primary domain that hosts the LDom Manager software. Manages all other domains. Always domain 0.
  • Service Domain — provides virtual I/O services (virtual disk, virtual network) to guest domains. Often combined with the control domain.
  • I/O Domain — a domain that has direct (PCIe passthrough) access to a physical I/O device. Can share that device as a virtual device to other domains.
  • Guest Domain — a virtual machine. Consumes virtual CPUs (vCPUs), virtual memory, and virtual I/O. Can run a full independent Solaris instance.
  • vCPU allocation — LDom vCPUs are allocated as SPARC hardware thread strands. A T8-1 (256 threads) can run 8 guest domains × 32 vCPUs each.
LDom administration commands
# Show all LDom domains ldm list # list all domains with status ldm list-domain # verbose domain list ldm list-bindings # show resource bindings (CPU, mem, devices) # Create a new guest domain ldm add-domain guestA ldm set-core 4 guestA # allocate 4 SPARC cores (32 threads) ldm set-memory 8G guestA # allocate 8GB RAM ldm add-vnet vnet0 primary-vsw0 guestA # add virtual NIC ldm add-vdisk vdisk0 vol0@primary-vds0 guestA # add virtual disk # Bind and start ldm bind guestA ldm start guestA # Stop and unbind ldm stop guestA ldm unbind guestA # Live migration (LDOM to LDOM on same or different server) ldm migrate-domain -n guestA ldoms@target-server-ilom-ip # Snapshot (save guest state) ldm stop-domain -r guestA # graceful stop + release resources # Monitor domain resources ldm list-util # utilisation of each domain ldm list-io # I/O device assignments # Power cap a domain (limit power consumption) ldm set-power-cap 100 guestA # cap at 100 watts

🔬 SPARC Processor Generations — Technical Deep Dive

PROC-01

SPARC Processor Generations — Feature Evolution

GenerationUsed InKey InnovationNotable Feature
SPARC64 VIM3000–M4000Chip-multithreading on M SeriesFirst M-class CMT
SPARC64 VIIM4000–M90004-core, 2-thread HTDouble floating point throughput
SPARC64 VII+M3000–M9000 refreshHigher clock speedECC improvements
SPARC T3T3-x Series16-core CMT, 128 threads/socketOn-chip 10GbE
SPARC T4T4-x, T4-1B8-core, 8-thread, superscalarOut-of-order execution + CMT (hybrid)
SPARC T5T5-2, T5-4, T5-816-core, 128 threads/socket2× T4 in one package
SPARC M5M5-3232-core SMP, 512 threadsFirst Software in Silicon preview
SPARC M6M6-3212-core, 96 threads/chip32 sockets = 384 cores
SPARC M7/T7M7-8, T7-2, T7-432-core, 256 threads/socketFull Software in Silicon (DAX, SSM, Crypto)
SPARC M8/T8M8-8, T8-2, T8-432-core, 256 threads, 4.5GHz30% faster DAX v2, enhanced SSM
SPARC S7S7-2, S7-2L8-core, 64 threads/socketSoftware in Silicon at entry-level
SPARC M12 (Fujitsu SPARC XII)M12-2S12-core, 4.25GHzDesigned for in-memory DB (SAP HANA)
Architecture fork note: SPARC T Series (CMT) and SPARC M Series (SMP) were originally distinct processor families. With the M7/T7 generation, Oracle unified them — the SPARC M7 is the same die used in T7-2 and M7-8, just in different system configurations. The key difference is now the system architecture (SMP interconnects, RAS features) rather than the processor itself.
PROC-02

SPARC NUMA Architecture & Memory Topology

All modern multi-socket SPARC servers are NUMA (Non-Uniform Memory Access). Understanding NUMA topology is critical for performance tuning.

  • NUMA node — each socket (processor) has its own local memory bank. Memory attached to Socket 0 is "local" to Socket 0 and "remote" to Socket 1.
  • NUMA latency — local memory access: ~50ns. Remote memory access: 100-200ns. Binding Oracle DB processes to local NUMA nodes reduces latency significantly.
  • On-chip interconnect — SPARC T7/T8 uses on-chip coherent interconnect to link sockets. No separate northbridge chip as in older x86 designs.
  • Coherent Interconnect — cache coherence is maintained across all sockets by the hardware. All sockets see a single unified memory address space.
NUMA topology commands
# Show NUMA topology (Solaris) lgrpinfo -a # locality group info — shows NUMA topology lgrpinfo -T # NUMA topology tree kstat -m lgrp # LGRP (locality group) statistics # Show memory per NUMA node prtconf -vP | grep -A5 memory-controller # Bind a process to a specific LGRP (NUMA node) lgrpinfo -l # list lgrp IDs plgrp # show which lgrp a process is running on lgrp -l command # start command bound to specific NUMA node # For Oracle Database NUMA binding — set in init.ora # USE_LARGE_PAGES = TRUE # MEMORY_TARGET and PGA_AGGREGATE_TARGET respect NUMA # Show CPU-to-LGRP mapping psrinfo -p | head # show processor sets kstat cpu_info | grep -E "chip_id|core_id|lgroup_id"

🔧 Common SPARC Administration Tasks

ADM-01

SPARC Boot Management — OBP, Solaris Boot & Troubleshooting

OBP Boot sequences
# Normal boot ok> boot # boot default device ok> boot disk0 # explicit disk ok> boot disk0 -s # single user mode ok> boot disk0 -v # verbose boot (most useful for troubleshooting) ok> boot net # network boot (requires DHCP + TFTP/NFS) ok> boot net -v # verbose network boot — shows JumpStart/AI progress ok> boot net -i # interactive boot (stops at milestones) # Boot to Solaris failsafe (like Windows Safe Mode) ok> boot disk0 -F failsafe # Boot from alternate BE (Boot Environment) ok> boot /dev/dsk/c0t0d0s0 # explicit device path # Or from Solaris: beadm activate new-BE # activate boot environment init 6 # reboot into it # Multi-disk OBP: show available disks ok> probe-scsi-all # scan all SCSI/SAS/SATA devices ok> devalias # show device aliases (disk0, disk1, cdrom, net) ok> nvalias disk0 /pci@/disk@0 # create a device alias
Solaris boot process (Solaris 11)
# Boot phases on Solaris 11: # 1. OBP POST # 2. OBP loads bootloader (/platform/sun4v/ufsboot or grub2 on x86, bootsys on SPARC) # 3. Kernel loaded (genunix, unix) # 4. SMF (Service Management Facility) starts services in dependency order # Monitor SMF boot services svcs -x # show services with issues svcs -a | grep maint # services in maintenance state svcadm clear # clear maintenance state svcs -l # detailed service info with logs # Boot environment management (Solaris 11) beadm list # list all boot environments beadm create new-BE # create new BE (snapshot of current) beadm activate new-BE# set new-BE as active for next boot beadm mount new-BE /mnt # mount a BE for offline repair beadm destroy old-BE # delete old boot environment
Critical interview point: Solaris uses SMF (Service Management Facility) instead of SysV init or systemd. Services have FMRIs (Fault Management Resource Identifiers) like svc:/network/ssh:default. This is a key differentiator from Linux.
ADM-02

Solaris FMA — Fault Management Architecture

FMA is Solaris's automated hardware and software fault management framework. It is one of the most L3-tested SPARC topics because it integrates hardware and software fault diagnosis.

  • DE (Diagnosis Engine) — analyses fault telemetry and produces a structured fault event with UUID, diagnosis, and suggested repair actions.
  • FRU (Field Replaceable Unit) — the specific hardware component implicated in a fault. FMA identifies the exact FRU to replace.
  • FMRI — Fault Management Resource Identifier — uniquely identifies a resource (service, device, or hardware component) in FMA.
  • Suspect list — FMA provides a ranked list of components that may have caused a fault, with percentage certainty.
  • Retire — FMA retires faulty CPU cores, memory pages, or other components to continue system operation while repairs are scheduled.
FMA commands — essential for L3
# Show all active faults fmadm faulty # list faulty components with UUID fmadm faulty -s # summary view fmadm faulty -a # include repaired/resolved # Detailed fault analysis fmdump -ev # show fault event log fmdump -V -u # full details for a specific fault UUID fmdump -V -u | head -80 # first 80 lines of fault details # Show FMA module statistics fmstat # all diagnosis engine (DE) statistics fmstat -m cpumem-diagnosis # CPU/memory diagnosis engine fmstat -m io-retire # I/O retirement engine # Show retired resources fmadm faulty | grep -i retire psrinfo -s # check if CPU online/offline/spare # Repair workflow (after replacing hardware) fmadm repair # mark fault as repaired (before FRU replacement) fmadm repaired # mark fault as repaired (after FRU replacement) # Clear a fault after hardware repair fmadm acquit # acquit all suspects for a fault # Online a retired CPU after repair psradm -n # bring CPU back online # Memory page retirement (FMA retires bad memory pages automatically) fmadm faulty | grep mem # To un-retire pages after DIMM replacement: fmadm repair fmadm repaired
Interview scenario: "A SPARC server reboots overnight with no apparent reason. How do you investigate?" Answer: fmdump -ev | tail -100 to check for FMA fault events before the reboot. Then check /var/adm/messages, then ILOM/XSCF event logs. FMA should have generated a UUID for any hardware fault that caused the reboot.
ADM-03

ZFS on SPARC — Hardware Accelerated Features

ZFS on SPARC servers benefits directly from Software in Silicon — compression and deduplication are hardware-accelerated, not software. This makes ZFS practical where it would impose too much CPU overhead on x86.

ZFS pool and filesystem management
# Create ZFS pool zpool create data mirror c0t0d0 c0t1d0 # RAID-1 mirror zpool create data raidz2 c0t0d0 c0t1d0 c0t2d0 c0t3d0 # RAIDZ-2 # Pool status and health zpool status # all pools with health zpool status data # specific pool zpool status -v data # verbose (shows scrub errors per disk) zpool list # capacity and usage # Filesystem operations zfs list # list all datasets zfs create data/db # create a filesystem zfs set compression=lz4 data/db # enable LZ4 compression (hardware-accelerated on SPARC M7+) zfs set dedup=on data/db # enable dedup (hardware-accelerated on SPARC M7+) zfs set quota=100G data/db # set 100GB quota # Snapshots zfs snapshot data/db@backup-20250615 # create snapshot zfs list -t snapshot # list snapshots zfs rollback data/db@backup-20250615 # rollback to snapshot zfs clone data/db@backup-20250615 data/db-clone # create clone # ZFS send/receive (replication) zfs send data/db@snap1 | ssh root@remote zfs recv backup/db zfs send -i data/db@snap1 data/db@snap2 | ssh root@remote zfs recv backup/db # incremental # Pool scrub (manual integrity check) zpool scrub data # start scrub zpool status data # monitor scrub progress # Replace a failed disk zpool replace data c0t0d0 c0t5d0 # replace failed disk with new one zpool status data # monitor resilvering progress
SPARC M7/T7+ advantage: ZFS deduplication on x86 typically causes 30-50% CPU overhead — often making it impractical. On SPARC M7+ with hardware dedup acceleration, the overhead is near zero. This is a genuine architectural advantage and a strong interview talking point.

🎯 SPARC Interview Q&A — L3 Level Questions

IQ-01

Architecture & Comparison Questions

QWhat is the fundamental difference between SPARC T Series and M Series? When would you recommend each?
▸ ANSWERT Series (CMT) is designed for throughput — it maximises hardware threads (256 per socket on T8). Ideal when you have many concurrent lightweight workloads: web application servers, Java EE containers, REST API services. It trades single-thread performance for massive parallelism.

M Series (SMP) is designed for mission-critical reliability and very large workloads — up to 32TB RAM, Dynamic Reconfiguration, memory mirroring, and XSCF hardware management. Ideal for core banking systems, Oracle Database instances requiring 10TB+ memory, ERP systems that cannot afford downtime. Price is significantly higher.

Recommendation framework: If the workload is multi-threaded and I can afford some single-thread latency → T Series. If the workload requires maximum RAS, huge memory, and I need hardware-level DR → M Series. If budget is limited but I need Software in Silicon → S Series.
QWhat is Software in Silicon and why does it matter compared to x86?
▸ ANSWERSoftware in Silicon refers to hardware-accelerated implementations of common software operations built directly into the SPARC processor die — not as a coprocessor, but as native processor instructions. This means: (1) Zero CPU overhead — AES encryption, ZFS compression, Oracle DB scanning all run without consuming CPU cycles from applications. (2) Deterministic performance — hardware acceleration doesn't vary based on load. (3) Security in silicon — SSM detects memory attacks before software can respond.

On x86, AES-NI provides hardware encryption, but ZFS compression is purely software, and there is no equivalent to SSM or DAX. The gap is most visible in Oracle Database workloads where DAX accelerates SQL column store scanning by offloading filter/scan operations to the processor itself.
QExplain ILOM vs XSCF — which SPARC systems use each?
▸ ANSWERILOM (Integrated Lights Out Manager): Used on T Series (T4, T5, T7, T8), S Series (S7), and blade servers. It is Oracle's equivalent of HP iLO or Dell iDRAC — provides per-server management: power control, virtual console (KVM), BIOS/OBP configuration, sensor monitoring, firmware updates. Access via SSH or HTTPS web UI.

XSCF (eXtended System Control Facility): Used on M Series (M3000 through M9000 with SPARC64 processors). It is more powerful than ILOM because it manages hardware domains, dynamic reconfiguration, and FRU management at the chassis level. Commands like showboards, addboard, showdomainstatus are XSCF-only.

M7-8 and M8-8 use a newer management architecture combining ILOM-style interfaces with domain management — interviewers may probe on this distinction.
QHow do Oracle Solaris Zones differ from LDoms? When would you use each?
▸ ANSWERLDoms (Logical Domains) are hardware virtualisation — each domain gets dedicated vCPUs (hardware thread strands), a dedicated memory partition, and virtual or passthrough I/O. Each domain boots its own Solaris kernel independently. A fault in one domain does not affect other domains. CPU and memory are hard-partitioned — a domain cannot use resources beyond what was allocated.

Zones are OS-level virtualisation — all zones share the same Solaris kernel. They provide namespace isolation (process space, network stack, filesystem view) but not kernel isolation. More lightweight (200+ zones on a T8-2 are feasible). Zones can access host resources dynamically (capped CPU, fair share scheduling).

Use case guidance: LDoms when you need kernel isolation, different Solaris versions per domain, or when a domain needs direct PCIe passthrough. Zones when you need lightweight multi-tenancy, application isolation, and very fast provisioning (a zone creates in seconds).
IQ-02

Operational & Troubleshooting Questions

QA SPARC T8-2 server reboots unexpectedly in the middle of the night. Walk me through your investigation.
▸ ANSWERStep 1 — ILOM logs first: ssh root@<ILOM-IP> → show /SP/logs/event/list. Look for hardware alerts (temperature, power, memory) logged before the reboot.
Step 2 — FMA events: fmdump -ev | tail -200 on Solaris. Look for fault UUIDs generated before the reboot. fmadm faulty to see if any component is currently flagged.
Step 3 — Solaris system log: tail -500 /var/adm/messages. Look for panic messages, kernel errors, or driver faults immediately before the timestamp of the reboot.
Step 4 — Crash dump: Check if a crash dump was generated: ls -la /var/crash/$(uname -n)/. If yes: mdb -k /var/crash/$(uname -n)/unix.0 /var/crash/$(uname -n)/vmcore.0::stack to see the panic stack trace.
Step 5 — Power/Thermal: If ILOM shows temperature or power alerts, investigate the physical environment (DC cooling, PSU failure).
Step 6 — SMF services: svcs -x after reboot to see if any services failed to start and may indicate a software cause.
QHow do you add a new disk to a SPARC server and expand a ZFS pool online?
▸ ANSWERStep 1 — Physical insertion: insert the hot-plug disk into an empty bay. SPARC servers with SAS backplanes support hot-plug.
Step 2 — Verify Solaris detects the disk: cfgadm -al to see attachment points, or format to list disks, or devfsadm to trigger device rescan → format.
Step 3 — Identify new disk path: ls /dev/dsk/ | sort to find new device node (e.g., c1t5d0).
Step 4 — ZFS pool expansion:
• To add a new mirror vdev to a raidz/mirror pool: zpool add data mirror c1t5d0 c1t6d0
• To replace a failed disk in an existing mirror: zpool replace data c1t0d0 c1t5d0
• To expand pool by adding a spare: zpool add data spare c1t5d0
Step 5 — Monitor: zpool status data — watch resilvering progress for replace operations.
Step 6 — After resilvering: zpool status data should show ONLINE for all vdevs.
QWhat is "core retirement" in SPARC and how does the system continue operating?
▸ ANSWERCore retirement is Solaris FMA's self-healing mechanism. When a SPARC core develops a hardware fault (ECC error on L2 cache, intermittent execution error, overtemperature), FMA's diagnosis engine identifies the faulty core and automatically takes it offline (retires it).

The process: (1) The SPARC core generates a hardware error trap. (2) FMA's cpumem-diagnosis engine analyses the error, determines severity, and generates a fault UUID. (3) If the core is unreliable, FMA calls psradm -f <cpu-id> to take all hardware threads on that core offline. (4) The OS migrates all threads off the retired core transparently. (5) The system continues running with reduced CPU capacity. (6) fmadm faulty shows the retired core with fault UUID. (7) After hardware repair (typically replacing the CPU board/module), fmadm repaired <UUID> and psradm -n <cpu-id> bring it back online.

This is fundamentally different from x86 — a faulty x86 core typically causes a system panic. SPARC continues running.
QHow do you perform a live firmware update on a SPARC T8-2 without downtime?
▸ ANSWEROn T Series, ILOM firmware can be updated without rebooting the host OS. BIOS/OBP firmware typically requires a reboot. Procedure:

Step 1 — Download firmware: obtain the latest firmware bundle from My Oracle Support (MOS) or Oracle Software Delivery Cloud. Firmware is delivered as a .pkg file or .zip.
Step 2 — Upload to ILOM: ILOM web UI → Administration → Firmware Upgrade → upload .pkg file. Or via ILOM CLI: → load -source tftp://<server>/firmware.pkg /SP/firmware
Step 3 — ILOM-only update: select "Preserve existing configuration" and "Delay BIOS update" options. ILOM firmware updates immediately; host BIOS update is deferred to next reboot.
Step 4 — Verify: → show /SP/firmware_version
Step 5 — Schedule BIOS update: plan a maintenance window for the host reboot to apply deferred BIOS/OBP firmware.
IQ-03

Real-World Scenario Questions

QA production SPARC M7-8 running Oracle Database reports a hardware memory error. fmadm shows a DIMM fault. The database is live. Walk me through the remediation.
▸ ANSWERStep 1 — Assess severity: fmadm faulty -s → check if fault is correctable (CE — Correctable Error) or uncorrectable (UE). CE can be tolerated temporarily; UE requires immediate action.
Step 2 — Identify affected DIMM: fmdump -V -u <UUID> → look for the FRU location code (e.g., /SYS/MB/MEM_GRP0/DIMM0).
Step 3 — Check if page retirement is active: FMA may have already retired the faulty memory page and the database is running on remaining memory.
Step 4 — Plan DR (Dynamic Reconfiguration): M7-8 supports hot-memory operations. Check if the DIMM can be taken offline without rebooting: cfgadm -al | grep mem → check if the memory board (not just DIMM) can be unconfigured.
Step 5 — If CE and page retired: schedule memory board replacement during the next maintenance window. Monitor with fmstat -m cpumem-diagnosis for increasing error rate.
Step 6 — If UE or escalating: arrange emergency Oracle Support visit for hot DIMM replacement (M7-8 supports hot-add memory boards). Coordinate with DBA to migrate database instance to a RAC node during hardware service.
Step 7 — After replacement: fmadm repaired <UUID> → verify with fmadm faulty (should show empty or resolved).
QYou are asked to migrate a production LDom (Oracle VM) from one SPARC T7-2 to another T7-2 during peak hours for a hardware upgrade. How do you do this?
▸ ANSWERPre-migration checks: (1) Target server has sufficient vCPUs and RAM available: ldm list-util on target. (2) Network connectivity between source and target ILOM. (3) Both servers running same or compatible LDom Manager version: ldm --version. (4) Verify live migration is supported (both servers must have same SPARC generation).

Migration command: ldm migrate-domain -n guestA ldoms@<target-ILOM-IP>
The -n flag means non-interactive (no OS suspend) — this is a live migration with the guest OS running.

Migration process: LDom Manager iteratively copies memory pages from source to target while the guest keeps running. Remaining dirty pages are copied. At the final moment, the guest is suspended for a few milliseconds (typically <1 second), final state is transferred, and it resumes on the target. Guest OS and applications see no interruption (TCP connections remain established).

Monitor migration: ldm list on both servers — the guest shows "migrating" state.

Post-migration: ldm list on target — guest shows "active". Verify application health. Remove guest definition from source: it is automatically removed on successful migration.
REF-01

SPARC Quick Reference — Key Commands Cheat Sheet

TaskCommand / Location
Access ILOM CLIssh root@<ILOM-IP>
Access XSCF CLI (M Series)ssh platadm@<XSCF-IP>
Show system health (ILOM)→ show /System
Show faults (ILOM)→ show -level all /SP/faultmgmt/shell
Show hardware config (XSCF)XSCF> showhardconf
Show domain status (XSCF)XSCF> showdomainstatus -a
OBP boot verboseok> boot disk0 -v
OBP scan SCSI devicesok> probe-scsi-all
OBP single user modeok> boot disk0 -s
Show CPU topologypsrinfo -pv
Show memory configprtconf | grep Memory
Show full hardwareprtdiag -v
Show FRU serialsprtfru
Show active faultsfmadm faulty
Fault detailfmdump -V -u <UUID>
FMA statisticsfmstat
Mark fault repairedfmadm repaired <UUID>
Retire a CPU corepsradm -f <cpu-id>
Bring CPU back onlinepsradm -n <cpu-id>
DR — show boardscfgadm -al
DR — unconfigure boardcfgadm -c unconfigure SB0
DR — configure new boardcfgadm -c configure SB2
Show NUMA topologylgrpinfo -T
Show LDom listldm list
LDom live migrateldm migrate-domain -n guestA ldoms@<target>
LDom resource utilisationldm list-util
ZFS pool statuszpool status
ZFS pool scrubzpool scrub <pool>
Solaris boot environmentsbeadm list
SMF service statussvcs -x