InfoScale™ 9.0 Release Notes - Linux

Last Published:
Product(s): InfoScale & Storage Foundation (9.0)
Platform: Linux
  1. Introduction and product requirements
    1.  
      About this document
    2.  
      VCS system requirements
    3. Supported Linux operating systems
      1.  
        Required Linux RPMs for InfoScale
    4.  
      Storage Foundation for Databases features supported in database environments
    5.  
      Storage Foundation memory requirements
    6.  
      Supported database software
    7.  
      Supported hardware and software
    8.  
      VMware Environment
    9.  
      Number of nodes supported
  2. Changes introduced in this release
    1.  
      Bunker replication support for shared disk groups in a Cluster Server environment
    2.  
      Secure file system (SecureFS) support for PostgreSQL
    3.  
      New attribute SetFSPrimary for PostgreSQL secure file system (SecureFS) support
    4.  
      New attribute SetFSPrimary replaces FsSetPriD daemon for Oracle secure file system (SecureFS) support
    5.  
      New secure configuration file format for storing SecureFS configuration data
    6.  
      Single Click Recovery to improve SecureFS recovery mechanism
    7.  
      New attribute EnableSingleWriter to enhance replication performance for single node failover applications
    8.  
      Application monitoring on single-node clusters in VMware environments
    9.  
      Encryption of LLT data
    10.  
      Veritas High Availability Configuration wizard is no longer available
    11.  
      Upgraded OpenSSL and TLS versions for enhanced security
    12.  
      Ability to delete stale keys of encrypted objects from KMS
    13.  
      Online volume encryption at rest
    14.  
      Ability to attach regional disks in read-only mode in GCP environments
    15.  
      New attributes cache and cachesize added to the vradmin startrep command
    16.  
      YUM support for performing InfoScale upgrades
    17.  
      File System (VxFS) deduplication no longer available
    18.  
      Support for online data migration from Ext4 or XFS to VxFS over NFS v4
    19.  
      Support for dynamic LUN expansion in FSS environments
    20.  
      Cloud-based Key Management Server
    21.  
      Event logging with key-value pairs
  3. Fixed issues
    1.  
      Issues fixed in this release
  4. Limitations
    1. Virtualization software limitations
      1.  
        Paths cannot be enabled inside a KVM guest if the devices have been previously removed and re-attached from the host
      2.  
        Application component fails to come online [3489464]
    2. Storage Foundation software limitations
      1. Dynamic Multi-Pathing software limitations
        1.  
          DMP settings for NetApp storage attached environment
        2.  
          LVM volume group in unusable state if last path is excluded from DMP (1976620)
      2. InfoScale Volume Manager software limitations
        1.  
          Snapshot configuration with volumes in shared disk groups and private disk groups is not supported (2801037)
        2.  
          SmartSync is not supported for Oracle databases running on raw VxVM volumes
        3.  
          InfoScale does not support thin reclamation of space on a linked mirror volume (2729563)
        4.  
          Cloned disks operations not supported for FSS disk groups
        5.  
          Thin reclamation requests are not redirected even when the ioship policy is enabled (2755982)
      3. File System (VxFS) software limitations
        1.  
          Online migration from Ext4 to VxFS is not supported on RHEL 8.1
        2.  
          Limitations while managing Docker containers
        3.  
          Linux I/O Scheduler for Database Workloads
        4.  
          Recommended limit of number of files in a directory
        5.  
          The vxlist command cannot correctly display numbers greater than or equal to 1 EB
        6.  
          Limitations with delayed allocation for extending writes feature
        7.  
          Compressed files that are backed up using NetBackup 7.1 or prior become uncompressed when you restore the files
        8.  
          On SUSE, creation of a SmartIO cache of VxFS type hangs on Fusion-io device (3200586)
        9.  
          A NetBackup restore operation on VxFS file systems does not work with SmartIO writeback caching
        10.  
          VxFS file system writeback operation is not supported with volume level replication or array level replication
      4. SmartIO software limitations
        1.  
          Cache is not online after a reboot
        2.  
          Writeback caching limitations
        3.  
          The sfcache operations may display error messages in the caching log when the operation completed successfully (3611158)
    3. Replication software limitations
      1.  
        Bunker replication configuration limitations
      2.  
        VVR support for replicating across InfoScale Storage versions
      3.  
        Softlink access and modification times are not replicated on RHEL5 for VFR jobs
      4.  
        VVR Replication in a shared environment
      5.  
        VVR IPv6 software limitations
    4. Cluster Server software limitations
      1. Limitations related to bundled agents
        1.  
          GoogleIP service group comes online even though OverlayIP resource is already online outside the cluster
        2.  
          Programs using networked services may stop responding if the host is disconnected
        3.  
          Volume agent clean may forcibly stop volume resources
        4.  
          False concurrency violation when using PidFiles to monitor application resources
        5.  
          Share agent limitations
        6.  
          Volumes in a disk group start automatically irrespective of the value of the StartVolumes attribute in VCS [2162929]
        7.  
          Application agent limitations
        8.  
          Campus cluster fire drill does not work when DSM sites are used to mark site boundaries [3073907]
        9.  
          Mount agent reports resource state as OFFLINE if the configured mount point does not exist [3435266]
        10.  
          Limitation of VMwareDisks agent to communicate with the vCenter Server [3528649]
        11.  
          NFSRestart agent: In NFSv3, lock recovery is not supported with multiple NFS share service groups
      2. Limitations related to VCS engine
        1.  
          Loads fail to consolidate and optimize when multiple groups fault [3074299]
        2.  
          Preferred fencing ignores the forecasted available capacity [3077242]
        3.  
          Failover occurs within the SystemZone or site when BiggestAvailable policy is set [3083757]
        4.  
          Load for Priority groups is ignored in groups with BiggestAvailable and Priority in the same group[3074314]
      3. Arctera cluster configuration wizard limitations
        1.  
          Wizard fails to configure VCS resources if storage resources have the same name [3024460]
        2.  
          Environment variable used to change log directory cannot redefine the log path of the wizard [3609791]
      4. Limitations related to the VCS database agents
        1.  
          DB2 RestartLimit value [1234959]
        2.  
          Sybase agent does not perform qrmutil based checks if Quorum_dev is not set (2724848)
        3.  
          Pluggable database (PDB) online may timeout when started after container database (CDB) [3549506]
      5.  
        Security-Enhanced Linux is not supported on SLES distributions
      6.  
        Systems in a cluster must have same system locale setting
      7.  
        VxVM site for the disk group remains detached after node reboot in campus clusters with fire drill [1919317]
      8.  
        Limitations with DiskGroupSnap agent [1919329]
      9.  
        System reboot after panic
      10.  
        Host on RHEV-M and actual host must match [2827219]
      11. Cluster Manager (Java console) limitations
        1.  
          VCS Simulator does not support I/O fencing
        2.  
          Using the KDE desktop
      12. Limitations related to LLT
        1.  
          Limitation related to LLT on RHEL [3983163]
        2.  
          Limitation of LLT support over UDP or RDMA using alias IP [3622175]
      13. Limitations related to I/O fencing
        1.  
          Preferred fencing limitation when VxFEN activates RACER node re-election
        2.  
          Stopping systems in clusters with I/O fencing configured
        3.  
          Uninstalling VRTSvxvm causes issues when VxFEN is configured in SCSI3 mode with dmp disk policy (2522069)
        4.  
          Node may panic if HAD process is stopped by force and then node is shut down or restarted [3640007]
      14.  
        Limitations related to global clusters
      15.  
        Clusters must run on VCS 6.0.5 and later to be able to communicate after upgrading to 2048 bit key and SHA256 signature certificates [3812313]
    5. Storage Foundation Cluster File System High Availability software limitations
      1.  
        cfsmntadm command does not verify the mount options (2078634)
      2.  
        Obtaining information about mounted file system states (1764098)
      3.  
        Stale SCSI-3 PR keys remain on disk after stopping the cluster and deporting the disk group
      4.  
        Unsupported FSS scenarios
    6. Storage Foundation for Oracle RAC software limitations
      1.  
        Supportability constraints for normal or high redundancy ASM disk groups with CVM I/O shipping and FSS (3600155)
      2.  
        Limitations of CSSD agent
      3.  
        Oracle Clusterware/Grid Infrastructure installation fails if the cluster name exceeds 14 characters
      4.  
        Policy-managed databases not supported by CRSResource agent
      5.  
        Health checks may fail on clusters that have more than 10 nodes
      6.  
        Cached ODM not supported in InfoScale environments
    7. Storage Foundation for Databases (SFDB) tools software limitations
      1.  
        Parallel execution of vxsfadm is not supported (2515442)
      2.  
        Creating point-in-time copies during database structural changes is not supported (2496178)
      3.  
        Oracle Data Guard in an Oracle RAC environment
  5. Known issues
    1. Issues related to installation, licensing, upgrade, and uninstallation
      1.  
        Error while upgrading from InfoScale 7.4.1 using yum (4186339)
      2.  
        Oracle service group fails to come online after an InfoScale and OS upgrade (4188821)
      3.  
        Installer fails to mount the shared volumes on new node during addnode post-start operation and fails (4117155)
      4.  
        If -makeresponsefile is used with Vxfs file system mounted, installer gives an error.(4117011)
      5.  
        VCS Azure Agents go into UNKNOWN/FAULTED state during the upgrade process. (4115166)
      6.  
        Security-Enhanced Linux (SELinux) installation on SLES releases. (4112805)
      7.  
        Enabling compression on VxFS filesystems, especially under heavy load might lead to filesystem corruption. (4108374)
      8.  
        Unmount may hang if run while a CFS rolling upgrade is in progress (4088238)
      9.  
        Rolling upgrade from InfoScale 7.4.1 to 8.0 gets stuck during phase 1 (4037913)
      10.  
        Switch fencing in enable or disable mode may not take effect if VCS is not reconfigured [3798127]
      11.  
        During an upgrade process, the AMF_START or AMF_STOP variable values may be inconsistent [3763790]
      12.  
        Stopping the installer during an upgrade and then resuming the upgrade might freeze the service groups (2574731)
      13.  
        NetBackup 6.5 or older version is installed on a VxFS file system (2056282)
      14.  
        Error messages in syslog (1630188)
      15.  
        Ignore certain errors after an operating system upgrade - after a product upgrade with encapsulated boot disks (2030970)
      16.  
        After a locale change restart the vxconfig daemon (2417547, 2116264)
      17.  
        Dependency may get overruled when uninstalling multiple RPMs in a single command [3563254]
    2. REST API known issues
      1.  
        Inaccurate information messages appear in case of operations on service groups using REST API (4034737)
      2.  
        State change operation may not occur on node named any (4055639)
      3.  
        Configuration change leads to REST server getting orphaned (4111774)
      4.  
        RVG GET detail API is failing, when tried to fetch information from secondary host instead of primary host (4115468)
    3. Storage Foundation known issues
      1. Dynamic Multi-Pathing known issues
        1.  
          kdump functionality does not work when DMP Native Support is enabled on Linux platform [3754715]
        2.  
          On SLES machine, after you enable the switch ports, some paths may not get enabled automatically [3782724]
      2. InfoScale Volume Manager known issues
        1.  
          Resizing of LVM disk or any other OS disk may result in failures
        2.  
          NVMe ASLs may return mismatched UDIDs (4046786)
        3.  
          Issues with host prefix values in case of NVME disks (4017022)
        4.  
          vradmin delsec fails to remove a secondary RVG from its RDS (3983296)
        5.  
          FSS disk group creation fails for clusters with eight or more nodes that have several directly attached disks (3986110)
        6.  
          Kernel-level warnings may appear in system logs during direct I/O to underlying device (3990118, 3998171)
        7.  
          Multiple Issues with Root Disk Encapsulation on RHEL
        8.  
          Core dump issue after restoration of disk group backup (3909046)
        9.  
          Failed verifydata operation leaves residual cache objects that cannot be removed (3370667)
        10.  
          LUNs claimed but not in use by VxVM may report "Device Busy" when it is accessed outside VxVM (3667574)
        11.  
          If the disk with CDS EFI label is used as remote disk on the cluster node, restarting the vxconfigd daemon on that particular node causes vxconfigd to go into disabled state (3873123)
        12.  
          Unable to set master on the secondary site in VVR environment if any pending I/O's are on the secondary site (3874873)
        13.  
          After installing DMP 6.0.1 on a host with the root disk under LVM on a cciss controller, the system is unable to boot using the vxdmp_kernel command [3599030]
        14.  
          VRAS verifydata command fails without cleaning up the snapshots created [3558199]
        15.  
          SmartIO VxVM cache invalidated after relayout operation (3492350)
        16.  
          VxVM fails to create volume by the vxassist(1M) command with maxsize parameter on Oracle Enterprise Linux 6 Update 5 (OEL6U5) [3736647]
        17.  
          Performance impact when a large number of disks are reconnected (2802698)
        18.  
          Machine fails to boot after root disk encapsulation on servers with UEFI firmware (1842096)
        19.  
          device.map must be up to date before doing root disk encapsulation (2202047)
        20.  
          Volume Manager (VxVM) might report false serial split brain under certain scenarios (1834513)
        21.  
          VxVM starts before OS device scan is done (1635274)
        22.  
          DMP disables subpaths and initiates failover when an iSCSI link is failed and recovered within 5 seconds. (2100039)
        23.  
          During system boot, some VxVM volumes fail to mount (2622979)
        24.  
          Removing an array node from an IBM Storwize V7000 storage system also removes the controller (2816589)
        25.  
          Continuous trespass loop when a CLARiiON LUN is mapped to a different host than its snapshot (2761567)
        26.  
          Disk group import of BCV LUNs using -o updateid and -ouseclonedev options is not supported if the disk group has mirrored volumes with DCO or has snapshots (2831658)
        27.  
          After devices that are managed by EMC PowerPath lose access to storage, Volume Manager commands are delayed (2757198)
        28.  
          vxresize does not work with layered volumes that have multiple plexes at the top level (3301991)
        29.  
          Running the vxdisk disk set clone=off command on imported clone disk group luns results in a mix of clone and non-clone disks (3338075)
        30.  
          vxunroot cannot encapsulate a root disk when the root partition has XFS mounted on it (3614362)
        31.  
          Restarting the vxconfigd daemon on the slave node after a disk is removed from all nodes may cause the disk groups to be disabled on the slave node (3591019)
        32.  
          DMP panics if a DDL device discovery is initiated immediately after loss of connectivity to the storage (2040929)
        33.  
          Failback to primary paths does not occur if the node that initiated the failover leaves the cluster (1856723)
        34.  
          Issues if the storage connectivity to data disks is lost on a CVM slave node while vxconfigd was not running on the node (2562889)
        35.  
          The vxcdsconvert utility is supported only on the master node (2616422)
        36.  
          Re-enabling connectivity if the disks are in local failed (lfailed) state (2425977)
        37.  
          Issues with the disk state on the CVM slave node when vxconfigd is restarted on all nodes (2615680)
        38.  
          Plex synchronization is not completed after resuming synchronization on a new master when the original master lost connectivity (2788077)
        39.  
          A master node is not capable of doing recovery if it cannot access the disks belonging to any of the plexes of a volume (2764153)
        40.  
          CVM fails to start if the first node joining the cluster has no connectivity to the storage (2787713)
        41.  
          CVMVolDg agent may fail to deport CVM disk group when CVMDeportOnOffline is set to 1
        42.  
          cvm_clus resource goes into faulted state after the resource is manually panicked and rebooted in a 32 node cluster (2278894)
        43.  
          DMP uses OS device physical path to maintain persistence of path attributes from 6.0 [3761441]
        44.  
          The vxsnap print command shows incorrect value for percentage dirty [2360780]
        45.  
          Systems may panic after GPT disk resize operation (3930664)
        46.  
          If LVM volume group has mirror volume, the conversion operation to VxVM fails (3930536)
        47.  
          If recovery of columns on EC volumes fails, recovery of other columns on the other volumes also fails (3930435)
        48.  
          Restarting vxconfigd during relayout operation causes the volume to go in an intermediate state.(3959429)
        49.  
          Volume Manager package (VRTSvxvm) fails to install on Oracle Linux 9 (4113004)
        50.  
          Full upgrade failed while performing InfoScale + OS upgrade from IS742 + Latest patch to IS802 (OS upgrade RHEL8U5 to RHEL8U6) (4114992)
      3. File System (VxFS) known issues
        1.  
          On an SELinux-enabled RHEL 7.7 or later system with DLV 10 or earlier, the mount operation on the filesystem fails after the upgrade (3992626)
        2.  
          On CFS, if delayed allocation and delayed extending write are both enabled on an Inode, data behaviour becomes unpredictable on that Inode (3982121)
        3.  
          Cluster may hang if CFS is FCL-enabled and its DLV is greater than or equal to 14 (4002222)
        4.  
          Docker does not recognize VxFS backend file system
        5.  
          On RHEL7 onwards, Pluggable Authentication Modules(PAM) related error messages for Samba daemon might occur in system logs [3765921]
        6.  
          Delayed allocation may be turned off automatically when one of the volumes in a multi-volume file system nears 100%(2438368)
        7.  
          XFS file system is not supported for RDE
        8.  
          The command tab auto-complete fails for the /dev/vx/ file tree; specifically for RHEL 7 (3602082)
        9.  
          A restored volume snapshot may be inconsistent with the data in the SmartIO VxFS cache (3760219)
        10.  
          When in-place and relocate compression rules are in the same policy file, file relocation is unpredictable (3760242)
        11.  
          The file system may hang when it has compression enabled (3331276)
      4. Virtualization known issues
        1.  
          Configuring application for high availability with storage using VCS wizard may fail on a VMware virtual machine which is configured with more than two storage controllers [3640956]
        2.  
          Host fails to reboot when the resource gets stuck in ONLINE|STATE UNKNOWN state [2738864]
        3.  
          VM state is in PAUSED state when storage domain is inactive [2747163]
        4.  
          Switching KVMGuest resource fails due to inadequate swap space on the other host [2753936]
        5.  
          Policies introduced in SLES 11SP2 may block graceful shutdown if a VM in SUSE KVM environment [2792889]
        6.  
          Load on libvirtd may terminate it in SUSE KVM environment [2824952]
        7.  
          Offline or switch of KVMGuest resource fails if the VM it is monitoring is undefined [2796817]
        8.  
          Increased memory usage observed even with no VM running [2734970]
        9.  
          Resource faults when it fails to ONLINE VM beacuse of insufficient swap percentage [2827214]
        10.  
          Migration of guest VM on native LVM volume may cause libvirtd process to terminate abruptly (2582716)
        11.  
          Virtual machine may return the not-responding state when the storage domain is inactive and the data center is down (2848003)
        12.  
          Guest virtual machine may fail on RHEL 6.1 if KVM guest image resides on CVM-CFS [2659944]
        13.  
          System panics after starting KVM virtualized guest or initiating KVMGuest resource online [2337626]
        14.  
          CD ROM with empty file vmPayload found inside the guest when resource comes online [3060910]
        15.  
          VCS fails to start virtual machine on another node if the first node panics [3042806]
        16.  
          VM fails to start on the target node if the source node panics or restarts during migration [3042786]
        17.  
          High Availability tab does not report LVMVolumeGroup resources as online [2909417]
        18.  
          Cluster communication breaks when you revert a snapshot in VMware environment [3409586]
        19.  
          VCS may detect the migration event during the regular monitor cycle due to the timing issue [2827227]
    4. Replication known issues
      1.  
        Replication is stuck when the Single Writer feature is disabled during ongoing I/O operations (4181131)
      2.  
        Replication status on the secondary may display stale information after a reboot or a change in logowner node (4113138)
      3.  
        Switching the VVR logowner to another node causes the replication to pause (4114096)
      4.  
        Secondary RVG creation using addsec command fails with a hostname not responding error (4113218)
      5.  
        Syslog gets flooded with vxconfigd daemon V-5-1-15599 error messages (4115620)
      6.  
        vradmin delpri command may hang (4111667)
      7.  
        vradmin verify data operation fails when replication is in DCM mode (4112686)
      8.  
        Unable to resize VVR data volumes when replication is in DCM mode (4112690)
      9.  
        vradmind and vxcommands hang about 40 minutes after replication starts in CVR configurations (4050516)
      10.  
        RVG goes into secondary log error state after secondary site reboot in CVR environments (4046182)
      11.  
        The secondary vradmind may appear hung and the vradmin commands may fail (3940842,3944301)
      12.  
        Data corruption may occur if you perform a rolling upgrade of InfoScale Storage or InfoScale Enterprise from 7.3.1 or earlier to 7.4 or later during replication (3951527)
      13.  
        vradmind may appear hung or may fail for the role migrate operation (3968642, 3968641)
      14.  
        After the product upgrade on secondary site, replication may fail to resume with "Secondary SRL missing" error [3931763]
      15.  
        vradmin repstatus command reports secondary host as "unreachable"(3896588)
      16.  
        RVGPrimary agent operation to start replication between the original Primary and the bunker fails during failback (2036605)
      17.  
        A snapshot volume created on the Secondary, containing a VxFS file system may not mount in read-write mode and performing a read-write mount of the VxFS file systems on the new Primary after a global clustering site failover may fail [3761497]
      18.  
        In an IPv6-only environment RVG, data volumes or SRL names cannot contain a colon (1672410, 1672417, 1825031)
      19.  
        vradmin functionality may not work after a master switch operation [2158679]
      20.  
        Cannot relayout data volumes in an RVG from concat to striped-mirror (2129601)
      21.  
        vradmin verifydata may report differences in a cross-endian environment (2834424)
      22.  
        vradmin verifydata operation fails if the RVG contains a volume set (2808902)
      23.  
        Plex reattach operation fails with unexpected kernel error in configuration update (2791241)
      24.  
        Bunker replay does not occur with volume sets (3329970)
      25.  
        SmartIO does not support write-back caching mode for volumes configured for replication by Volume Replicator (3313920)
      26.  
        During moderate to heavy I/O, the vradmin verifydata command may falsely report differences in data (3270067)
      27.  
        While vradmin commands are running, vradmind may temporarily lose heartbeats (3347656, 3724338)
      28.  
        Write I/Os on the primary logowner may take a long time to complete (2622536)
      29.  
        DCM logs on a disassociated layered data volume results in configuration changes or CVM node reconfiguration issues (3582509)
      30.  
        After performing a CVM master switch on the secondary node, both rlinks detach (3642855)
      31.  
        vradmin -g dg repstatus rvg displays the following configuration error: vradmind not reachable on cluster peer (3648854)
      32.  
        The RVGPrimary agent may fail to bring the application service group online on the new Primary site because of a previous primary-elect operation not being run or not completing successfully (3761555, 2043831)
      33.  
        A snapshot volume created on the Secondary, containing a VxFS file system may not mount in read-write mode and performing a read-write mount of the VxFS file systems on the new Primary after a global clustering site failover may fail (1558257)
      34.  
        DCM plex becomes inaccessible and goes into DISABLED(SPARSE) state in case of node failure. (3931775)
      35.  
        Initial autosync operation takes a long time to complete for data volumes larger than 3TB (3966713)
    5. Cluster Server known issues
      1. Operational issues for VCS
        1.  
          LVM SG transition fails in all paths disabled status (2081430)
        2.  
          SG goes into Partial state if Native LVMVG is imported and activated outside VCS control
        3.  
          Switching service group with DiskGroup resource causes reservation conflict with UseFence set to SCSI3 and powerpath environment set (2749136)
        4.  
          Stale NFS file handle on the client across failover of a VCS service group containing LVMLogicalVolume resource (2016627)
        5.  
          NFS cluster I/O fails when storage is disabled (2555662)
        6.  
          VVR configuration may go in a primary-primary configuration when the primary node crashes and restarts (3314749)
        7.  
          CP server does not allow adding and removing HTTPS virtual IP or ports when it is running (3322154)
        8.  
          VCS fails to stop volume due to a transaction ID mismatch error (3292840)
        9.  
          Some VCS components do not work on the systems where a firewall is configured to block TCP traffic (3545338)
      2. Issues related to the VCS engine
        1.  
          Invalid argument message in the message log due to Red Hat Linux bug (3872083)
        2.  
          Extremely high CPU utilization may cause HAD to fail to heartbeat to GAB [1744854]
        3.  
          The hacf -cmdtocf command generates a broken main.cf file [1919951]
        4.  
          Trigger does not get executed when there is more than one leading or trailing slash in the triggerpath [2368061]
        5.  
          Service group is not auto started on the node having incorrect value of EngineRestarted [2653688]
        6.  
          Group is not brought online if top level resource is disabled [2486476]
        7.  
          NFS resource goes offline unexpectedly and reports errors when restarted [2490331]
        8.  
          Parent group does not come online on a node where child group is online [2489053]
        9.  
          Cannot modify temp attribute when VCS is in LEAVING state [2407850]
        10.  
          Service group may fail to come online after a flush and a force flush operation [2616779]
        11.  
          Elevated TargetCount prevents the online of a service group with hagrp -online -sys command [2871892]
        12.  
          Auto failover does not happen in case of two successive primary and secondary cluster failures [2858187]
        13.  
          GCO clusters remain in INIT state [2848006]
        14.  
          The ha commands may fail for non-root user if cluster is secure [2847998]
        15.  
          Running -delete -keys for any scalar attribute causes core dump [3065357]
        16.  
          InfoScale enters into admin_wait state when Cluster Statistics is enabled with load and capacity defined [3199210]
        17.  
          Agent reports incorrect state if VCS is not set to start automatically and utmp file is empty before VCS is started [3326504]
        18.  
          VCS crashes if feature tracking file is corrupt [3603291]
        19.  
          RemoteGroup agent and non-root users may fail to authenticate after a secure upgrade [3649457]
        20.  
          Global Cluster Option (GCO) require NIC names in specific format [3641586]
        21.  
          If you disable security before upgrading VCS to version 7.0.1 or later on secured clusters, the security certificates will not be upgraded to 2048 bit SHA2 [3812313]
        22.  
          Java console and CLI do not allow adding VCS user names starting with '_' character (3870470)
      3. Issues related to the bundled agents
        1.  
          Partial log entries for service group offline operations in case of application monitoring on single-node clusters (4188474)
        2.  
          Irrelevant INFO message about corrective action for a faulted service group (4178969)
        3.  
          Failover of a VMwareDisks resource fails when cluster node reboots (4034115)
        4.  
          Mounting an NFSv4 volume on the NFS client side fails
        5.  
          If multiple Mount resources uses the same block or volume, one of the resources may go into the OFFLINE or the UNKNOWN state (4001585)
        6.  
          KVMGuest resource fails to work on VCS agent for RHEV3.5 (3873800)
        7.  
          LVM Logical Volume will be auto activated during I/O path failure [2140342]
        8.  
          KVMGuest monitor entry point reports resource ONLINE even for corrupted guest or with no OS installed inside guest [2394235]
        9.  
          Concurrency violation observed during migration of monitored virtual machine [2755936]
        10.  
          KVMGuest resource comes online on failover target node when started manually [2394048]
        11.  
          IMF registration fails for Mount resource if the configured MountPoint path contains spaces [2442598]
        12.  
          DiskGroup agent is unable to offline the resource if volume is unmounted outside VCS
        13.  
          RemoteGroup agent does not failover in case of network cable pull [2588807]
        14.  
          VVR setup with FireDrill in CVM environment may fail with CFSMount Errors [2564411]
        15.  
          CoordPoint agent remains in faulted state [2852872]
        16.  
          RVGsnapshot agent does not work with volume sets created using vxvset [2553505]
        17.  
          No log messages in engine_A.log if VCS does not find the Monitor program [2563080]
        18.  
          KVMGuest agent fails to recognize paused state of the VM causing KVMGuest resource to fault [2796538]
        19.  
          Concurrency violation observed when host is moved to maintenance mode [2735283]
        20.  
          Logical volume resources fail to detect connectivity loss with storage when all paths are disabled in KVM guest [2871891]
        21.  
          Resource does not appear ONLINE immediately after VM appears online after a restart [2735917]
        22.  
          Unexpected behavior in VCS observed while taking the disk online [3123872]
        23.  
          LVMLogicalVolume agent clean entry point fails to stop logical volume if storage connectivity is lost [3118820]
        24.  
          VM goes into paused state if the source node loses storage connectivity during migration [3085214]
        25.  
          Virtual machine goes to paused state during migration if the public network cable is pulled on the destination node [3080930]
        26.  
          NFS client reports I/O error because of network split brain [3257399]
        27.  
          Manual configuration of RHEVMInfo attribute of KVMGuest agent requires all its keys to be configured [3277994]
        28.  
          SambaServer agent may generate core on Linux if LockDir attribute is changed to empty value while agent is running [3339231]
        29.  
          Independent Persistent disk setting is not preserved during failover of virtual disks in VMware environment [3338702]
        30.  
          LVMLogicalVolume resource goes in UNABLE TO OFFLINE state if native LVM volume group is exported outside VCS control [3606516]
        31.  
          DiskGroup resource online may take time if it is configured along with VMwareDisks resource [3638242]
        32.  
          SFCache Agent fails to enable caching if cache area is offline [3644424]
        33.  
          RemoteGroup agent may stop working on upgrading the remote cluster in secure mode [3648886]
        34.  
          VMwareDisks agent may fail to start or storage discovery may fail if SELinux is running in enforcing mode [3106376]
      4. Issues related to the VCS database agents
        1.  
          Unsupported startup options with systemD enabled [3901204]
        2.  
          VCS ASMDG resource status does not match the Oracle ASMDG resource status (3962416)
        3.  
          ASMDG agent does not go offline if the management DB is running on the same (3856460)
        4.  
          ASMDG on a particular does not go offline if its instances is being used by other database instances (3856450)
        5.  
          Sometimes ASMDG reports as offline instead of faulted (3856454)
        6.  
          The ASMInstAgent does not support having pfile/spfile for the ASM Instance on the ASM diskgroups
        7.  
          VCS agent for ASM: Health check monitoring is not supported for ASMInst agent
        8.  
          NOFAILOVER action specified for certain Oracle errors
        9.  
          Oracle agent fails to offline pluggable database (PDB) resource with PDB in backup mode [3592142]
        10.  
          Clean succeeds for PDB even as PDB staus is UNABLE to OFFLINE [3609351]
        11.  
          Second level monitoring fails if user and table names are identical [3594962]
        12.  
          Monitor entry point times out for Oracle PDB resources when CDB is moved to suspended state in Oracle 12.1.0.2 [3643582]
        13.  
          Oracle agent fails to come online and monitor Oracle instance if threaded_execution parameter is set to true (3644425)
      5. Issues related to the agent framework
        1.  
          The agent framework does not detect if service threads hang inside an entry point [1442255]
        2.  
          IMF related error messages while bringing a resource online and offline [2553917]
        3.  
          Delayed response to VCS commands observed on nodes with several resources and system has high CPU usage or high swap usage [3208239]
        4.  
          CFSMount agent may fail to heartbeat with VCS engine and logs an error message in the engine log on systems with high memory load [3060779]
        5.  
          Logs from the script executed other than the agent entry point goes into the engine logs [3547329]
        6.  
          VCS fails to process the hares -add command resource if the resource is deleted and subsequently added just after the VCS process or the agent's process starts (3813979)
      6. Cluster Server agents for Volume Replicator known issues
        1.  
          fdsetup cannot correctly parse disk names containing characters such as "-" (1949294)
        2.  
          Stale entries observed in the sample main.cf file for RVGLogowner and RVGPrimary agent [2872047]
      7. Issues related to Intelligent Monitoring Framework (IMF)
        1.  
          AMF notifications are not sent when an NFS file system is mounted (4049118)
        2.  
          Registration error while creating a Firedrill setup [2564350]
        3.  
          IMF does not provide notification for a registered disk group if it is imported using a different name (2730774)
        4.  
          Direct execution of linkamf displays syntax error [2858163]
        5.  
          Error messages displayed during reboot cycles [2847950]
        6.  
          Error message displayed when ProPCV prevents a process from coming ONLINE to prevent concurrency violation does not have I18N support [2848011]
        7.  
          AMF displays StartProgram name multiple times on the console without a VCS error code or logs [2872064]
        8.  
          Core dump observed when amfconfig is run with set and reset commands simultaneously [2871890]
        9.  
          VCS engine shows error for cancellation of reaper when Apache agent is disabled [3043533]
        10.  
          Terminating the imfd daemon orphans the vxnotify process [2728787]
        11.  
          Agent cannot become IMF-aware with agent directory and agent file configured [2858160]
        12.  
          ProPCV fails to prevent a script from running if it is run with relative path [3617014]
      8. Issues related to global clusters
        1.  
          GCO configuration fails if virtual hostname is configured as the virtual IP (4113391)
        2.  
          The engine log file receives too many log messages on the secure site in global cluster environments [1919933]
        3.  
          Application group attempts to come online on primary site before fire drill service group goes offline on the secondary site (2107386)
      9. Issues related to the Cluster Manager (Java Console)
        1.  
          Cluster Manager (Java Console) may display an error while loading templates (1433844)
        2.  
          Some Cluster Manager features fail to work in a firewall setup [1392406]
      10. LLT known issues
        1.  
          LLT connections are not formed when a vlan is configured on a NIC (2484856)
        2.  
          Rolling upgrade from earlier version to InfoScale 7.4.2 may fail for LLT over UDP configuration in FSS environment (3981917)
        3.  
          If you manually re-plumb (change) the IP address on a network interface card (NIC) which is used by LLT, then LLT may experience heartbeat loss and the node may panic (3188950)
        4.  
          A network restart of the network interfaces may cause heartbeat loss for the NIC interfaces used by LLT
        5.  
          Performance degradation occurs when RDMA connection between nodes is down [3877863]
        6.  
          After configuring LLT over UDP using IPV6, one of the configured link may show DOWN status for lltstat command [3916374]
        7.  
          When using FSS over RDMA links during heavy IO, LLT may face link fluctuations [3907179]
        8.  
          The LLT window may drop to a very low value in CVM/FSS or CFS environment [3914954]
        9.  
          When using response files for LLT configuration over UDP, the nodes become unresponsive (3946836)
        10.  
          LLT causes node to panic during TCP connection failure when incomplete packets are received (3944294)
      11. I/O fencing known issues
        1.  
          Online fencing migration from custom to SCSI3 mode might fail (4189051, 4189048)
        2.  
          Fencing port b is visible for few seconds even if cluster nodes have not registered with CP server (2415619)
        3.  
          The cpsadm command fails if LLT is not configured on the application cluster (2583685)
        4.  
          The vxfenswap utility does not detect failure of coordination points validation due to an RSH limitation (2531561)
        5.  
          The vxfenswap utility deletes comment lines from the /etc/vxfemode file, if you run the utility with hacli option (3318449)
        6.  
          The vxfentsthdw utility may not run on systems installed with partial SFHA stack [3333914]
        7.  
          When a client node goes down, for reasons such as node panic, I/O fencing does not come up on that client node after node restart (3341322)
        8.  
          VCS fails to take virtual machines offline while restarting a physical host in RHEV and KVM environments (3320988)
        9.  
          Fencing may panic the node while shut down or restart when LLT network interfaces are under Network Manager control [3627749]
        10.  
          The vxfenconfig -l command output does not list Coordinator disks that are removed using the vxdmpadm exclude dmpnodename=<dmp_disk/node> command [3644431]
        11.  
          The CoordPoint agent faults after you detach or reattach one or more coordination disks from a storage array (3317123)
    6. Storage Foundation and High Availability known issues
      1.  
        Cache area is lost after a disk failure (3158482)
      2.  
        Installer exits upgrade to 5.1 RP1 with Rolling Upgrade error message (1951825, 1997914)
      3.  
        In an IPv6 environment, db2icrt and db2idrop commands return a segmentation fault error during instance creation and instance removal (1602444)
      4.  
        Process start-up may hang during configuration using the installer (1678116)
      5.  
        Not all the objects are visible in the VIOM GUI (1821803)
      6.  
        An error message is received when you perform off-host clone for RAC and the off-host node is not part of the CVM cluster (1834860)
      7.  
        A volume's placement class tags are not visible in the Arctera Enterprise Administrator GUI when creating a dynamic storage tiering placement policy (1880081)
      8.  
        VVR logowner change command failed with error (4114512)
      9.  
        Handle planned change of secondary logowner (4114764)
      10.  
        RVG logowner is not following the CVM master when it is switched to a higher priority node in the cluster (4074251)
      11.  
        Vxptint -Pl command on secondary is showing incorrect IP after configuring fresh replication (4113240)
      12.  
        VxVM is unable to detect the controller during a physical cable pull scenario even it is connected to host (4114190)
    7. Storage Foundation Cluster File System High Availability known issues
      1.  
        During disk group creation with '-o same_enckey=yes', disk reattach fails if a disk comes online after losing connectivity (4003890)
      2.  
        Transaction hangs when multiple plex-attach or add-mirror operations are triggered on the same volume (3969500)
      3.  
        In an FSS environment, creation of mirrored volumes may fail for SSD media [3932494]
      4.  
        Mount command may fail to mount the file system (3913246)
      5.  
        After the local node restarts or panics, the FSS service group cannot be online successfully on the local node and the remote node when the local node is up again (3865289)
      6.  
        In the FSS environment, if DG goes to the dgdisable state and deep volume monitoring is disabled, successive node joins fail with error 'Slave failed to create remote disk: retry to add a node failed' (3874730)
      7.  
        DG creation fails with error "V-5-1-585 Disk group punedatadg: cannot create: SCSI-3 PR operation failed" on the VSCSI disks (3875044)
      8.  
        CVMVOLDg agent is not going into the FAULTED state. [3771283]
      9.  
        On CFS, SmartIO is caching writes although the cache appears as nocache on one node (3760253)
      10.  
        tail -f run on a cluster file system file only works correctly on the local node [3741020]
      11.  
        CFS commands might hang when run by non-root (3038283)
      12.  
        The fsappadm subfilemove command moves all extents of a file (3258678)
      13.  
        Certain I/O errors during clone deletion may lead to system panic. (3331273)
      14.  
        Panic due to null pointer de-reference in vx_bmap_lookup() (3038285)
      15.  
        In a CFS cluster, that has multi-volume file system of a small size, the fsadm operation may hang (3348520)
    8. Storage Foundation for Oracle RAC known issues
      1. Oracle RAC known issues
        1.  
          Oracle Grid Infrastructure installation may fail with internal driver error
        2.  
          During installation or system startup, Oracle Grid Infrastructure may fail to start
      2. Storage Foundation Oracle RAC issues
        1.  
          Oracle database or grid installation using the product installer fails (4004808)
        2.  
          ASM configuration fails if OCR and voting disk volumes are configured on VxFS or CFS for Oracle 19c during the grid installation (4003844)
        3.  
          CSSD configuration fails if OCR and voting disk volumes are located on Oracle ASM (3914497)
        4.  
          When you upgrade to SF Oracle RAC 7.1, VxFS may fail to stop (3872605)
        5.  
          ASM disk groups configured with normal or high redundancy are dismounted if the CVM master panics due to network failure in FSS environment or if CVM I/O shipping is enabled (3600155)
        6.  
          PrivNIC and MultiPrivNIC agents not supported with Oracle RAC 11.2.0.2 and later versions
        7.  
          CSSD agent forcibly stops Oracle Clusterware if Oracle Clusterware fails to respond (3352269)
        8.  
          Intelligent Monitoring Framework (IMF) entry point may fail when IMF detects resource state transition from online to offline for CSSD resource type (3287719)
        9.  
          Node fails to join the SF Oracle RAC cluster if the file system containing Oracle Clusterware is not mounted (2611055)
        10.  
          The vxconfigd daemon fails to start after machine reboot (3566713)
        11.  
          Health check monitoring fails with policy-managed databases (3609349)
        12.  
          CVMVolDg agent may fail to deport CVM disk group
        13.  
          Rolling upgrade not supported for upgrades from SF Oracle RAC 5.1 SP1 with fencing configured in dmpmode.
        14.  
          "Configuration must be ReadWrite : Use haconf -makerw" error message appears in VCS engine log when hastop -local is invoked (2609137)
        15.  
          Volume Manager cannot identify Oracle Automatic Storage Management (ASM) disks (2771637)
        16.  
          vxdisk resize from slave nodes fails with "Command is not supported for command shipping" error (3140314)
        17.  
          CVR configurations are not supported for Flexible Storage Sharing (3155726)
        18.  
          CVM requires the T10 vendor provided ID to be unique (3191807)
        19.  
          SG_IO ioctl hang causes disk group creation, CVM node joins, and storage connects/disconnects, and vxconfigd to hang in the kernel (3193119)
        20.  
          vxdg adddisk operation fails when adding nodes containing disks with the same name (3301085)
        21.  
          FSS Disk group creation with 510 exported disks from master fails with Transaction locks timed out error (3311250)
        22.  
          vxconfigrestore is unable to restore FSS cache objects in the pre-commit stage (3461928)
        23.  
          Change in naming scheme is not reflected on nodes in an FSS environment (3589272)
        24.  
          Intel SSD cannot be initialized and exported (3584762)
        25.  
          VxVM may report false serial split brain under certain FSS scenarios (3565845)
    9. Storage Foundation for Databases (SFDB) tools known issues
      1.  
        Clone operations fail for instant mode snapshot (3916053)
      2.  
        Sometimes SFDB may report the following error message: SFDB remote or privileged command error (2869262)
      3.  
        SFDB commands do not work in IPV6 environment (2619958)
      4.  
        When you attempt to move all the extents of a table, the dbdst_obj_move(1M) command fails with an error (3260289)
      5.  
        Attempt to use SmartTier commands fails (2332973)
      6.  
        Attempt to use certain names for tiers results in error (2581390)
      7.  
        Clone operation failure might leave clone database in unexpected state (2512664)
      8.  
        Clone command fails if PFILE entries have their values spread across multiple lines (2844247)
      9.  
        Clone command errors in a Data Guard environment using the MEMORY_TARGET feature for Oracle 11g (1824713)
      10.  
        Clone fails with error "ORA-01513: invalid current time returned by operating system" with Oracle 11.2.0.3 (2804452)
      11.  
        Data population fails after datafile corruption, rollback, and restore of offline checkpoint (2869259)
      12.  
        Flashsnap clone fails under some unusual archivelog configuration on RAC (2846399)
      13.  
        In the cloned database, the seed PDB remains in the mounted state (3599920)
      14.  
        Cloning of a container database may fail after a reverse resync commit operation is performed (3509778)
      15.  
        If one of the PDBs is in the read-write restricted state, then cloning of a CDB fails (3516634)
      16.  
        Cloning of a CDB fails for point-in-time copies when one of the PDBs is in the read-only mode (3513432)
      17.  
        If a CDB has a tablespace in the read-only mode, then the cloning fails (3512370)
      18.  
        SFDB commands fail when an SFDB installation with authentication configured is upgraded to InfoScale 9.0 (3644030)
      19.  
        Benign message displayed upon execution of vxsfadm -a oracle -s filesnap -o destroyclone (3901533)
    10. Application isolation feature known Issues
      1.  
        Addition of an Oracle instance using Oracle GUI (dbca) does not work with Application Isolation feature enabled
      2.  
        Auto reattach of detached plexes may not happen for FSS disk groups when auto-mapping feature is used (3902004)
      3.  
        CPI is not supported for configuring the application isolation feature (3902023)
      4.  
        Thin reclamation does not happen for remote disks if the storage node or the disk owner does not have the file system mounted on it (3902009)
    11. Cloud deployment known issues
      1.  
        Systems in GCP may get stuck in the LEAVING state when multiple nodes are restarted a cascaded manner
      2.  
        An error occurs during VVR or CVR configuration when alias IPs are assigned to GCP VM instances (3965275)
      3.  
        In an Azure environment, the systems under InfoScale control may panic due to CPU soft lockup [3929534]
      4.  
        In an Azure environment, an InfoScale cluster node may panic if any of the node is rebooted using Azure portal [3930926]
      5.  
        If you disable a public IP from the Azure portal, the corresponding AzureIP resource goes into UNKNOWN state [3928222]
      6.  
        After rolling upgrade phase 1, xprtld service fails to start on AWS instances (4004450)
      7. Issues related to Arctera InfoScale Storage in Amazon Web Services cloud environments
        1.  
          Incorrect media type displayed for AWS EC2 volumes
        2.  
          Inconsistencies in instance store volumes
        3.  
          Stale remote disks on some nodes after failure of vxdisk unexport operation
        4.  
          UDID of AWS volumes not updated after migration
        5.  
          Partial detachment of volumes from AWS console
        6.  
          Crash dump logs not available when EC2 instances crash
        7.  
          vxcloudd daemon fails with a core dump when the bucket name on the target exceeds 32 characters (3916980)
        8.  
          Migration of data to cloud volumes using S3 Connector fails with core dump (3915555)

Ability to delete stale keys of encrypted objects from KMS

So far, when volume encryption was secured by using a Key Management Server, Volume Manager copied the encryption key (KEK) of the volume and used it for the corresponding snapshot volumes.

Also, when Volume Manager deleted an encrypted object, it did not delete the associated KEK. Over time, many such unused keys would get accumulated on the KMS, which would probably incur costs.

To address these inefficiencies, Volume Manager has been enhanced as follows:

  • It uses separate KEKs for volumes and their snapshots.

  • When a volume or any of its snapshots is deleted, it also deletes the associated KEK from the KMS.

  • It provides a new tunable, delete_stale_kms_keys, which you can use to enable or disable the deletion of the associated KEK when an encrypted object is deleted. This feature is disabled by default.

Consideration for upgrade scenarios

You might have volumes and their snapshots created by earlier versions of Volume Manager in your environment, which share the same KEK. In such a scenario, if you enable the deletion of the associated KEK along with the encrypted object, the shared KEK will be deleted. Consequently, the other objects that shared the KEK will be rendered unusable, because Volume Manager will not be able to decrypt them.

For details, refer to the following documents as applicable to your environment:

  • Storage Foundation 9.0 Administrator's Guide - Linux

  • Storage Foundation Cluster File System High Availability 9.0 Administrator's Guide - Linux