Cluster Server 8.0 Application Note: Dynamic Reconfiguration for Oracle Servers - Solaris

Last Published:
Product(s): InfoScale & Storage Foundation (8.0)
Platform: Solaris

Performing dynamic reconfiguration on PCI cards on I/O boards

A card containing an HBA can be removed and replaced on an I/O board. If a failed HBA has been used with other adapters on separate cards in a Dynamic Multi-Pathing (DMP) configuration, I/O can proceed through the alternate path and VCS need not be stopped.

To determine the status of the card you are unconfiguring

  1. Log in to the domain as the administrator. For the following example, the I/O board is in the dom1 domain.
  2. Check the status of the boards. Use the cfgadm command.

    cougar# cfgadm

    The output resembles:

    Ap_Id Type Receptacle Occupant Condition
    IO4 HPCI connected configured ok
    IO4_C3V0 fibre/hp connected configured ok
    IO4_C3V1 pci-pci/hp connected configured ok
    IO4_C5V0 pci-pci/hp connected configured ok
    IO4_C5V1 fibre/hp connected configured ok
    SB7 CPU connected configured ok
    SB8 CPU connected configured ok
    c0 scsi-bus connected configured unknown
    c1 scsi-bus connected unconfigured unknown
    c2 fc connected unconfigured unknown
    c3 fc connected unconfigured unknown
    c4 fc-fabric connected configured unknown
    c5 fc connected unconfigured unknown
    cougar# uname -a
    SunOS cougar 5.10 Generic_118833-17 sun4u sparc
    SUNW,Sun-Fire-15000
    cougar#

    In case of Solaris, the reporting of I/O board slot names makes it somewhat easier to discover the relationship between physical and logical devices because slots on the I/O boards are also numbered using the C[35]V[01] notation.

To remove a PCI card

  1. Disable the controllers on the I/O system card using the vxdmpadm command:

    # vxdmpadm disable ctlr=c3

    If the card has more than one controller, repeat this command for each controller on the card.

  2. Disconnect the card:

    # cfgadm -v -c disconnect pcisch1:sg8slot0

  3. Check the states and the condition of the card using the cfgadm command:

    # cfgadm

    The disconnected card must have the following states and condition:

    • Receptacle state: disconnected

    • Occupant state: unconfigured

    • Condition: unknown

  4. Remove the disconnected card only if it is powered off.

To add a card

  1. Verify that the slot you selected can accept a device, such as a PCI card.

    To accept a device, the slot must have the following states and condition:

    • Receptacle state: empty or disconnected

    • Occupant state: unconfigured

    • Condition: unknown

    Verify this by using the cfgadm command to list all of the system boards, as in the following example:

    The output resembles:

    cougar# cfgadm

    Ap_Id Type Receptacle Occupant Condition
    IO4 HPCI connected configured ok
    IO4_C3V0 fibre/hp connected configured ok
    IO4_C3V1 pci-pci/hp connected configured ok
    IO4_C5V0 pci-pci/hp connected configured ok
    IO4_C5V1 fibre/hp connected configured ok
    SB7 CPU connected configured ok
    SB8 CPU connected configured ok
    c0 scsi-bus connected configured unknown
    c1 scsi-bus connected unconfigured unknown
    c2 fc connected unconfigured unknown
    c3 fc connected unconfigured unknown
    c4 fc-fabric connected configured unknown
    c5 fc connected unconfigured unknown
    cougar# uname -a
    SunOS cougar 5.10 Generic_118833-17 sun4u sparc
    SUNW,Sun-Fire-15000
    cougar#

    In case of Sol 10, the reporting of I/O board slot names makes it somewhat easier to discover the relationship between physical and logical devices because slots on the I/O boards are also numbered using the C[35]V[01] notation.

  2. Add the replacement PCI card to the empty card slot.
  3. To configure the new card, use the cfgadm command. For example:

    For s6800:

    # cfgadm -c configure pcisch1:sg8slot0

    For e12K/15K:

    # cfgadm -c configure pcisch1:e15b1slot0

    After the system configures and tests the board, it displays a message in the domain console log indicating the configuration of the components.

  4. Check the states and the condition of the board using the cfgadm command; it must be "connected," "configured," and "ok."
  5. Enable the controller for the HBA:

    # vxdmpadm enable ctlr=c3

    Note:

    This command succeeds if the controller is accessible to the domain and I/O can be performed on it.