Cluster Server 8.0 Application Note: Dynamic Reconfiguration for Oracle Servers - Solaris
- Dynamic reconfiguration of Oracle servers
- Supported software and hardware
- Scenarios requiring a VCS shutdown
- Stopping and starting VCS
- Performing dynamic reconfiguration on Oracle SunFire (s6800; e12K/15K/ e25K)
Performing dynamic reconfiguration on PCI cards on I/O boards
A card containing an HBA can be removed and replaced on an I/O board. If a failed HBA has been used with other adapters on separate cards in a Dynamic Multi-Pathing (DMP) configuration, I/O can proceed through the alternate path and VCS need not be stopped.
To determine the status of the card you are unconfiguring
- Log in to the domain as the administrator. For the following example, the I/O board is in the dom1 domain.
- Check the status of the boards. Use the cfgadm command.
cougar# cfgadm
The output resembles:
Ap_Id Type Receptacle Occupant Condition IO4 HPCI connected configured ok IO4_C3V0 fibre/hp connected configured ok IO4_C3V1 pci-pci/hp connected configured ok IO4_C5V0 pci-pci/hp connected configured ok IO4_C5V1 fibre/hp connected configured ok SB7 CPU connected configured ok SB8 CPU connected configured ok c0 scsi-bus connected configured unknown c1 scsi-bus connected unconfigured unknown c2 fc connected unconfigured unknown c3 fc connected unconfigured unknown c4 fc-fabric connected configured unknown c5 fc connected unconfigured unknown cougar# uname -a SunOS cougar 5.10 Generic_118833-17 sun4u sparc SUNW,Sun-Fire-15000 cougar#
In case of Solaris, the reporting of I/O board slot names makes it somewhat easier to discover the relationship between physical and logical devices because slots on the I/O boards are also numbered using the C[35]V[01] notation.
To remove a PCI card
- Disable the controllers on the I/O system card using the vxdmpadm command:
# vxdmpadm disable ctlr=c3
If the card has more than one controller, repeat this command for each controller on the card.
- Disconnect the card:
# cfgadm -v -c disconnect pcisch1:sg8slot0
- Check the states and the condition of the card using the cfgadm command:
# cfgadm
The disconnected card must have the following states and condition:
Receptacle state: disconnected
Occupant state: unconfigured
Condition: unknown
- Remove the disconnected card only if it is powered off.
To add a card
- Verify that the slot you selected can accept a device, such as a PCI card.
To accept a device, the slot must have the following states and condition:
Receptacle state: empty or disconnected
Occupant state: unconfigured
Condition: unknown
Verify this by using the cfgadm command to list all of the system boards, as in the following example:
The output resembles:
cougar# cfgadm
Ap_Id Type Receptacle Occupant Condition IO4 HPCI connected configured ok IO4_C3V0 fibre/hp connected configured ok IO4_C3V1 pci-pci/hp connected configured ok IO4_C5V0 pci-pci/hp connected configured ok IO4_C5V1 fibre/hp connected configured ok SB7 CPU connected configured ok SB8 CPU connected configured ok c0 scsi-bus connected configured unknown c1 scsi-bus connected unconfigured unknown c2 fc connected unconfigured unknown c3 fc connected unconfigured unknown c4 fc-fabric connected configured unknown c5 fc connected unconfigured unknown cougar# uname -a SunOS cougar 5.10 Generic_118833-17 sun4u sparc SUNW,Sun-Fire-15000 cougar#
In case of Sol 10, the reporting of I/O board slot names makes it somewhat easier to discover the relationship between physical and logical devices because slots on the I/O boards are also numbered using the C[35]V[01] notation.
- Add the replacement PCI card to the empty card slot.
- To configure the new card, use the cfgadm command. For example:
For s6800:
# cfgadm -c configure pcisch1:sg8slot0
For e12K/15K:
# cfgadm -c configure pcisch1:e15b1slot0
After the system configures and tests the board, it displays a message in the domain console log indicating the configuration of the components.
- Check the states and the condition of the board using the cfgadm command; it must be "connected," "configured," and "ok."
- Enable the controller for the HBA:
# vxdmpadm enable ctlr=c3
Note:
This command succeeds if the controller is accessible to the domain and I/O can be performed on it.