Cluster Server 7.4.1 Administrator's Guide - Linux
- Section I. Clustering concepts and terminology
- Introducing Cluster Server
- About Cluster Server
- About cluster control guidelines
- About the physical components of VCS
- Logical components of VCS
- Types of service groups
- About resource monitoring
- Agent classifications
- About cluster control, communications, and membership
- About security services
- Components for administering VCS
- About cluster topologies
- VCS configuration concepts
- Introducing Cluster Server
- Section II. Administration - Putting VCS to work
- About the VCS user privilege model
- Administering the cluster from the command line
- About administering VCS from the command line
- About installing a VCS license
- Administering LLT
- Starting VCS
- Stopping the VCS engine and related processes
- Logging on to VCS
- About managing VCS configuration files
- About managing VCS users from the command line
- About querying VCS
- About administering service groups
- Modifying service group attributes
- About administering resources
- Enabling and disabling IMF for agents by using script
- Linking and unlinking resources
- About administering resource types
- About administering clusters
- Configuring applications and resources in VCS
- VCS bundled agents for UNIX
- Configuring NFS service groups
- About NFS
- Configuring NFS service groups
- Sample configurations
- About configuring the RemoteGroup agent
- About configuring Samba service groups
- About testing resource failover by using HA fire drills
- Predicting VCS behavior using VCS Simulator
- Section III. VCS communication and operations
- About communications, membership, and data protection in the cluster
- About cluster communications
- About cluster membership
- About membership arbitration
- About membership arbitration components
- About server-based I/O fencing
- About majority-based fencing
- About the CP server service group
- About secure communication between the VCS cluster and CP server
- About data protection
- Examples of VCS operation with I/O fencing
- About cluster membership and data protection without I/O fencing
- Examples of VCS operation without I/O fencing
- Administering I/O fencing
- About the vxfentsthdw utility
- Testing the coordinator disk group using the -c option of vxfentsthdw
- About the vxfenadm utility
- About the vxfenclearpre utility
- About the vxfenswap utility
- About administering the coordination point server
- About configuring a CP server to support IPv6 or dual stack
- About migrating between disk-based and server-based fencing configurations
- Migrating between fencing configurations using response files
- Controlling VCS behavior
- VCS behavior on resource faults
- About controlling VCS behavior at the service group level
- About AdaptiveHA
- Customized behavior diagrams
- About preventing concurrency violation
- VCS behavior for resources that support the intentional offline functionality
- VCS behavior when a service group is restarted
- About controlling VCS behavior at the resource level
- VCS behavior on loss of storage connectivity
- Service group workload management
- Sample configurations depicting workload management
- The role of service group dependencies
- About communications, membership, and data protection in the cluster
- Section IV. Administration - Beyond the basics
- VCS event notification
- VCS event triggers
- Using event triggers
- List of event triggers
- Virtual Business Services
- Section V. Veritas High Availability Configuration wizard
- Introducing the Veritas High Availability Configuration wizard
- Administering application monitoring from the Veritas High Availability view
- Administering application monitoring from the Veritas High Availability view
- Administering application monitoring from the Veritas High Availability view
- Section VI. Cluster configurations for disaster recovery
- Connecting clusters–Creating global clusters
- VCS global clusters: The building blocks
- About global cluster management
- About serialization - The Authority attribute
- Prerequisites for global clusters
- Setting up a global cluster
- About IPv6 support with global clusters
- About cluster faults
- About setting up a disaster recovery fire drill
- Test scenario for a multi-tiered environment
- Administering global clusters from the command line
- About global querying in a global cluster setup
- Administering clusters in global cluster setup
- Setting up replicated data clusters
- Setting up campus clusters
- Connecting clusters–Creating global clusters
- Section VII. Troubleshooting and performance
- VCS performance considerations
- How cluster components affect performance
- How cluster operations affect performance
- VCS performance consideration when a system panics
- About scheduling class and priority configuration
- VCS agent statistics
- About VCS tunable parameters
- Troubleshooting and recovery for VCS
- VCS message logging
- Gathering VCS information for support analysis
- Troubleshooting the VCS engine
- Troubleshooting Low Latency Transport (LLT)
- Troubleshooting Group Membership Services/Atomic Broadcast (GAB)
- Troubleshooting VCS startup
- Troubleshooting issues with systemd unit service files
- Troubleshooting service groups
- Troubleshooting resources
- Troubleshooting sites
- Troubleshooting I/O fencing
- Fencing startup reports preexisting split-brain
- Troubleshooting CP server
- Troubleshooting server-based fencing on the VCS cluster nodes
- Issues during online migration of coordination points
- Troubleshooting notification
- Troubleshooting and recovery for global clusters
- Troubleshooting licensing
- Licensing error messages
- Troubleshooting secure configurations
- Troubleshooting wizard-based configuration issues
- Troubleshooting issues with the Veritas High Availability view
- VCS message logging
- VCS performance considerations
- Section VIII. Appendixes
Cluster attributes
Table: Cluster attributes lists the cluster attributes.
Cluster Attributes | Definition |
---|---|
AdministratorGroups (user-defined) | List of operating system user account groups that have administrative privileges on the cluster. This attribute applies to clusters running in secure mode.
|
Administrators (user-defined) | Contains list of users with Administrator privileges.
|
AutoClearQ (System use only) | Lists the service groups scheduled to be auto-cleared. It also indicates the time at which the auto-clear for the group will be performed. |
AutoStartTimeout (user-defined) | If the local cluster cannot communicate with one or more remote clusters, this attribute specifies the number of seconds the VCS engine waits before initiating the AutoStart process for an AutoStart global service group.
|
AutoAddSystemtoCSG (user-defined) | Indicates whether the newly joined or added systems in cluster become part of the SystemList of the ClusterService service group if the service group is configured. The value 1 (default) indicates that the new systems are added to SystemList of ClusterService. The value 0 indicates that the new systems are not added to SystemList of ClusterService.
|
BackupInterval (user-defined) | Time period in minutes after which VCS backs up the configuration files if the configuration is in read-write mode. The value 0 indicates VCS does not back up configuration files. Set this attribute to at least 3.
|
CID (system defined) | The CID provides universally unique identification for a cluster. VCS populates this attribute once the engine passes an hacf-generated snapshot to it. This happens when VCS is about to go to a RUNNING state from the LOCAL_BUILD state. Once VCS receives the snapshot from the engine, it reads the file /etc/vx/.uuids/clusuuid file. VCS uses the file's contents as the value for the CID attribute. The clusuuid file's first line must not be empty. If the file does not exists or is empty VCS then exits gracefully and throws an error. A node that joins a cluster in the RUNNING state receives the CID attribute as part of the REMOTE_BUILD snapshot. Once the node has joined completely, it receives the snapshot. The node reads the file /etc/vx/.uuids/clusuuid to compare the value that it received from the snapshot with value that is present in the file. If the value does not match or if the file does not exist, the joining node exits gracefully and does not join the cluster. To populate the /etc/vx/.uuids/clusuuid file, run the /opt/VRTSvcs/bin/uuidconfig.pl utility. See Configuring and unconfiguring the cluster UUID value. You cannot change the value of this attribute with the haclus - modify command.
|
ClusState (system use only) | Indicates the current state of the cluster.
|
ClusterAddress (user-defined) | Specifies the cluster's virtual IP address (used by a remote cluster when connecting to the local cluster).
|
ClusterLocation (user-defined) | Specifies the location of the cluster.
|
ClusterName (user-defined) | The name of cluster.
|
ClusterOwner (user-defined) | This attribute used for VCS notification. VCS sends notifications to persons designated in this attribute when an event occurs related to the cluster. Note that while VCS logs most events, not all events trigger notifications. Make sure to set the severity level at which you want notifications to be sent to ClusterOwner or to at least one recipient defined in the SmtpRecipients attribute of the NotifierMngr agent.
|
ClusterRecipients (user-defined) | This attribute is used for VCS email notification. VCS sends email notification to persons designated in this attribute when events related to the cluster occur and when the event's severity level is equal to or greater than the level specified in the attribute. Make sure to set the severity level at which you want notifications to be sent to ClusterRecipients or to at least one recipient defined in the SmtpRecipients attribute of the NotifierMngr agent.
|
ClusterTime (system use only) | The number of seconds since January 1, 1970. This is defined by the lowest node in running state.
|
ClusterUUID (system use only) | Unique ID assigned to the cluster by Availability Manager.
|
CompareRSM (system use only) | Indicates if VCS engine is to verify that replicated state machine is consistent. This can be set by running the hadebug command.
|
ConnectorState (system use only) | Indicates the state of the wide-area connector (wac). If 0, wac is not running. If 1, wac is running and communicating with the VCS engine.
|
CounterInterval (user-defined) | Intervals counted by the attribute GlobalCounter indicating approximately how often a broadcast occurs that will cause the GlobalCounter attribute to increase. The default value of the GlobalCounter increment can be modified by changing CounterInterval. If you increase this attribute to exceed five seconds, consider increasing the default value of the ShutdownTimeout attribute.
|
CounterMissAction (user-defined) | Specifies the action that must be performed when the GlobalCounter is not updated for CounterMissTolerance times the CounterInterval. Possible values are LogOnly and Trigger. If you set CounterMissAction to LogOnly, the system logs the message in Engine Log and Syslog. If you set CounterMissAction to Trigger, the system invokes a trigger which has default action of collecting the comms tar file.
|
CounterMissTolerance (user-defined) | Specifies the time interval that can lapse since the last update of GlobalCounter before VCS reports an issue. If the GlobalCounter does not update within CounterMissTolerance times CounterInterval, VCS reports the issue. Depending on the CounterMissAction.value, appropriate action is performed.
|
CredRenewFrequency (user-defined) | The number of days after which the VCS engine renews its credentials with the authentication broker. For example, the value 5 indicates that credentials are renewed every 5 days; the value 0 indicates that credentials are not renewed.
|
DeleteOnlineResource (user-defined) | Defines whether you can delete online resources. Set this value to 1 to enable deletion of online resources. Set this value to 0 to disable deletion of online resources. You can override this behavior by using the -force option with the hares -delete command.
|
DumpingMembership (system use only) | Indicates that the engine is writing or dumping the configuration to disk.
|
EngineClass (user-defined) | The scheduling class for the VCS engine (HAD). The attribute can take the following values: RT, TS where RT = realtime and TS = timeshare. For information on the significance of these values, see the operating system documentation.
|
EnableFFDC (user-defined) | Enables or disables FFDC logging. By default, FFDC logging is enabled.
|
EnableVMAutoDiscovery (user-defined) | Enables or disables auto discovery of virtual machines. By default, auto discovery of virtual machines is disabled.
|
EnablePBF (user-defined) | Enables or disables priority based failover. When set to 1 (one), VCS gives priority to the online of high priority service group, by ensuring that its Load requirement is met on the system.
|
EnginePriority (user-defined) | The priority in which HAD runs. Generally, a greater priority value indicates higher scheduling priority. A range of priority values is assigned to each scheduling class. For more information on the range of priority values, see the operating system documentation.
|
EngineShutdown (user-defined) | Defines the options for the hastop command. The attribute can assume the following values: Enable - Process all hastop commands. This is the default behavior. Disable - Reject all hastop commands. DisableClusStop - Do not process the hastop -all command; process all other hastop commands. PromptClusStop - Prompt for user confirmation before running the hastop -all command; process all other hastop commands. PromptLocal - Prompt for user confirmation before running the hastop -local command; reject all other hastop commands. PromptAlways - Prompt for user confirmation before running any hastop command.
|
FipsMode (system use only) | Indicates whether FIPS mode is enabled for the cluster. The value depends on the mode of the broker on the system. If FipsMode is set to 1, FIPS mode is enabled. If FipsMode is set to 0, FIPS mode is disabled.
You can verify the value of FipsMode as follows: # haclus -value FipsMode |
GlobalCounter (system use only) | This counter increases incrementally by one for each counter interval. It increases when the broadcast is received. VCS uses the GlobalCounter attribute to measure the time it takes to shut down a system. By default, the GlobalCounter attribute is updated every five seconds. This default value, combined with the 600-second default value of the ShutdownTimeout attribute, means if system goes down within 120 increments of GlobalCounter, it is treated as a fault. Change the value of the CounterInterval attribute to modify the default value of GlobalCounter increment.
|
Guests (user-defined) | List of operating system user accounts that have Guest privileges on the cluster. This attribute is valid clusters running in secure mode.
|
GuestGroups (user-defined) | List of operating system user groups that have Guest privilege on the cluster.
|
DefaultGuestAccess (user-defined) | Indicates whether any authenticated user should have guest access to the cluster by default. The default guest access can be:
|
GroupLimit (user-defined) | Maximum number of service groups.
|
HacliUserLevel (user-defined) | This attribute has two, case-sensitive values: NONE - hacli is disabled for all users regardless of role. COMMANDROOT - hacli is enabled for root only. Note: The command haclus -modify HacliUserLevel can be executed by root only.
|
HostAvailableMeters (System use only) | Lists the meters that are available for measuring system resources. You cannot configure this attribute in the main.cf file.
|
HostMeters (user-defined) | Indicates the parameters (CPU, Mem, or Swap) that are currently metered in the cluster.
|
LockMemory (user-defined) | Controls the locking of VCS engine pages in memory. This attribute has the following values. Values are case-sensitive: ALL: Locks all current and future pages. CURRENT: Locks current pages. NONE: Does not lock any pages.
|
LogClusterUUID (user-defined) | Enables or disables logging of the cluster UUID in each log message. By default, cluster UUID is not logged.
|
LogSize (user-defined) | Indicates the size of engine log files in bytes. Minimum value is = 65536 (equal to 64KB) Maximum value = 134217728 (equal to 128MB)
|
MeterControl (user-defined) | Indicates the intervals at which metering and forecasting for the system attribute AvailableCapacity are done for the keys specified in HostMeters.
You can configure this attribute in main.cf. You cannot modify the value at run time. The values of MeterInterval and ForecastCycle apply to all keys of HostMeters. |
MeterUnit | Represents units for parameters that are metered.
You can configure this attribute in main.cf; if configured in main.cf, then it must contain units for all the keys as specified in HostMeters. You cannot modify the value at run time. When Statistics is set to Enabled then service group attribute Load, and the following system attributes are represented in corresponding units for parameters such as CPU, Mem, or Swap:
The values of keys such as Mem and Swap can be represented in MB or GB, and CPU can be represented in CPU, MHz or GHz. |
MeterWeight (user-defined) | Indicates the default meter weight for the service groups in the cluster. You can configure this attribute in the main.cf file, but you cannot modify the value at run time. If the attribute is defined in the main.cf file, it must have at least one key defined. The weight for the key must be in the range of 0 to 10. Only keys from HostAvailableMeters are allowed in this attribute.
|
Notifier (system use only) | Indicates the status of the notifier in the cluster; specifically: State - Current state of notifier, such as whether or not it is connected to VCS. Host - The host on which notifier is currently running or was last running. Default = None Severity - The severity level of messages queued by VCS for notifier. Values include Information, Warning, Error, and SevereError. Default = Warning Queue - The size of queue for messages queued by VCS for notifier.
|
OpenExternalCommunicationPort (user-defined) | Indicates whether communication over the external communication port for VCS is allowed or not. By default, the external communication port for VCS is 14141.
Note: When the external communication port for VCS is not open, RemoteGroup resources created by the RemoteGroup agent cannot access VCS. |
OperatorGroups (user-defined) | List of operating system user groups that have Operator privileges on the cluster. This attribute is valid clusters running in secure mode.
|
Operators (user-defined) | List of users with Cluster Operator privileges.
|
PanicOnNoMem (user-defined) | Indicate the action that you want VCS engine (HAD) to take if it cannot receive messages from GAB due to low-memory.
|
PreferredFencingPolicy | The I/O fencing race policy to determine the surviving subcluster in the event of a network partition. Valid values are Disabled, System, Group, or Site. Disabled: Preferred fencing is disabled. The fencing driver favors the subcluster with maximum number of nodes during the race for coordination points. System: The fencing driver gives preference to the system that is more powerful than others in terms of architecture, number of CPUs, or memory during the race for coordination points. VCS uses the system-level attribute FencingWeight to calculate the node weight. Group: The fencing driver gives preference to the node with higher priority service groups during the race for coordination points. VCS uses the group-level attribute Priority to determine the node weight. Site: The fencing driver gives preference to the node with higher site priority during the race for coordination points. VCS uses the site-level attribute Preference to determine the node weight.
|
PrintMsg (user-defined) | Enables logging TagM messages in engine log if set to 1.
|
ProcessClass (user-defined) | Indicates the scheduling class processes created by the VCS engine. For example, triggers.
|
ProcessPriority (user-defined) | The priority of processes created by the VCS engine. For example triggers.
|
ReadOnly (user-defined) | Indicates that cluster is in read-only mode.
|
ResourceLimit (user-defined) | Maximum number of resources.
|
SecInfo256 (user-defined) | Enables creation of secure passwords when this attribute is added to the
|
IV256 (user-defined) | Enables creation of secure passwords when this attribute is added to the
|
SecInfoLevel (user-defined) | Denotes the password encryption privilege level.
|
SecureClus (user-defined) | Indicates whether the cluster runs in secure mode. The value 1 indicates the cluster runs in secure mode. This attribute cannot be modified when VCS is running.
|
SiteAware (user-defined) | Indicates whether sites are configured for a cluster or not.
You can configure a site from Veritas InfoScale Operations Manager . This attribute will be automatically set to 1 when configured using Veritas InfoScale Operations Manager. If site information is not configured for some nodes in the cluster, those nodes are placed under a default site that has the lowest preference. See Site attributes. |
SourceFile (user-defined) | File from which the configuration is read. Do not configure this attribute in main.cf. Make sure the path exists on all nodes before running a command that configures this attribute.
|
Statistics (user-defined) | Indicates if statistics gathering is enabled and whether the FailOverPolicy can be set to BiggestAvailable.
|
Stewards (user-defined) | The IP address and hostname of systems running the steward process.
|
SystemRebootAction (user-defined) | Determines whether frozen service groups are ignored on system reboot.
If the SystemRebootAction value is IgnoreFrozenGroup, VCS ignores service groups that are frozen (TFrozen and Frozen) and takes the remaining service groups offline. If the frozen service groups have firm dependencies or hard dependencies on any other service groups which are not frozen, VCS gives an error. If the SystemRebootAction value is "", VCS tries to take all service groups offline. Because VCS cannot be gracefully stopped on a node where a frozen service group is online, applications on the node might get killed. Note: The SystemRebootAction attribute applies only on system reboot and system shutdown. |
TypeLimit (user-defined) | Maximum number of resource types.
|
UseFence (user-defined) | Indicates whether the cluster uses SCSI-3 I/O fencing. The value SCSI3 indicates that the cluster uses either disk-based or server-based I/O fencing. The value NONE indicates it does not use either.
|
UserNames (user-defined) | List of VCS users. The installer uses admin as the default user name.
|
VCSFeatures (system use only) | Indicates which VCS features are enabled. Possible values are: 0 - No features are enabled (VCS Simulator) 1 - L3+ is enabled 2 - Global Cluster Option is enabled Even though the VCSFeatures is an integer attribute, when you query the value with the haclus -value command or the haclus -display command, it displays as the string L10N for value 1 and DR for value 2.
|
VCSMode (system use only) | Denotes the mode for which VCS is licensed. Even though the VCSMode is an integer attribute, when you query the value with the haclus -value command or the haclus -display command, it displays as the string UNKNOWN_MODE for value 0 and VCS for value 7.
|
WACPort (user-defined) | The TCP port on which the wac (Wide-Area Connector) process on the local cluster listens for connection from remote clusters. Type and dimension: integer-scalar
|