Veritas InfoScale™ for Kubernetes Environments 8.0.220 - Linux

Last Published:
Product(s): InfoScale & Storage Foundation (8.0.220)
Platform: Linux
  1. Overview
    1.  
      Introduction
    2.  
      Features of InfoScale in Containerized environment
    3.  
      CSI Introduction
    4.  
      I/O fencing
    5.  
      Disaster Recovery
    6.  
      Licensing
    7.  
      Encryption
  2. System requirements
    1.  
      Introduction
    2.  
      Supported platforms
    3.  
      Disk space requirements
    4.  
      Hardware requirements
    5.  
      Number of nodes supported
    6.  
      DR support
  3. Preparing to install InfoScale on Containers
    1. Setting up the private network
      1.  
        Guidelines for setting the media speed for LLT interconnects
      2.  
        Guidelines for setting the maximum transmission unit (MTU) for LLT
    2.  
      Synchronizing time settings on cluster nodes
    3.  
      Securing your InfoScale deployment
    4.  
      Configuring kdump
  4. Installing Veritas InfoScale on OpenShift
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Additional Prerequisites for Azure RedHat OpenShift (ARO)
    4.  
      Considerations for configuring cluster or adding nodes to an existing cluster
    5. Installing InfoScale on a system with Internet connectivity
      1. Installing from OperatorHub by using web console
        1.  
          Adding Nodes to an InfoScale cluster by using OLM
        2.  
          Undeploying and uninstalling InfoScale
      2. Installing from OperatorHub by using Command Line Interface (CLI)
        1.  
          Configuring cluster
        2.  
          Adding nodes to an existing cluster
        3.  
          Undeploying and uninstalling InfoScale by using CLI
      3. Installing by using YAML
        1.  
          Configuring cluster
        2.  
          Adding nodes to an existing cluster
        3.  
          Undeploying and uninstalling InfoScale
    6. Installing InfoScale in an air gapped system
      1.  
        Prerequisites to install by using YAML or OLM
      2.  
        Additional prerequisites to install by using yaml
      3.  
        Installing from OperatorHub by using web console
      4.  
        Installing from OperatorHub by using Command Line Interface (CLI)
      5.  
        Installing by using YAML
    7.  
      Removing and adding back nodes to an Azure RedHat OpenShift (ARO) cluster
  5. Installing Veritas InfoScale on Kubernetes
    1.  
      Introduction
    2. Prerequisites
      1.  
        Installing Node Feature Discovery (NFD) Operator and Cert-Manager on Kubernetes
    3. Tagging the InfoScale images on Kubernetes
      1.  
        Downloading side car images
    4.  
      Applying licenses
    5.  
      Tech Preview: Installing InfoScale on an Azure Kubernetes Service(AKS) cluster
    6.  
      Considerations for configuring cluster or adding nodes to an existing cluster
    7. Installing InfoScale on Kubernetes
      1.  
        Configuring cluster
      2.  
        Adding nodes to an existing cluster
    8.  
      Installing InfoScale by using the plugin
    9.  
      Undeploying and uninstalling InfoScale
  6. Configuring KMS-based Encryption on an OpenShift cluster
    1.  
      Introduction
    2.  
      Adding a custom CA certificate
    3.  
      Configuring InfoScale to enable transfer of keys
    4.  
      Enabling rekey for an encrypted Volume
  7. Configuring KMS-based Encryption on a Kubernetes cluster
    1.  
      Introduction
    2.  
      Adding a custom CA certificate
    3.  
      Configuring InfoScale to enable transfer of keys
    4.  
      Enabling rekey for an encrypted Volume
  8. InfoScale CSI deployment in Container environment
    1.  
      CSI plugin deployment
    2.  
      Raw block volume support
    3.  
      Static provisioning
    4. Dynamic provisioning
      1.  
        Reclaiming provisioned storage
    5.  
      Resizing Persistent Volumes (CSI volume expansion)
    6. Snapshot provisioning (Creating volume snapshots)
      1.  
        Dynamic provisioning of a snapshot
      2.  
        Static provisioning of an existing snapshot
      3.  
        Using a snapshot
      4.  
        Restoring a snapshot to new PVC
      5.  
        Deleting a volume snapshot
      6.  
        Creating snapshot of a raw block volume
    7. Managing InfoScale volume snapshots with Velero
      1.  
        Setting up Velero with InfoScale CSI
      2.  
        Taking the Velero backup
      3.  
        Creating a schedule for a backup
      4.  
        Restoring from the Velero backup
    8. Volume cloning
      1.  
        Creating volume clones
      2.  
        Deleting a volume clone
    9.  
      Using InfoScale with non-root containers
    10.  
      Using InfoScale in SELinux environments
    11.  
      CSI Drivers
    12.  
      Creating CSI Objects for OpenShift
  9. Installing and configuring InfoScale DR Manager on OpenShift
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Creating Persistent Volume for metadata backup
    4.  
      External dependencies
    5. Installing InfoScale DR Manager by using OLM
      1.  
        Installing InfoScale DR Manager by using web console
      2.  
        Configuring InfoScale DR Manager by using web console
      3.  
        Installing from OperatorHub by using Command Line Interface (CLI)
    6. Installing InfoScale DR Manager by using YAML
      1.  
        Configuring Global Cluster Membership (GCM)
      2.  
        Configuring Data Replication
      3.  
        Additional requirements for replication on Cloud
      4.  
        Configuring DNS
      5.  
        Configuring Disaster Recovery Plan
  10. Installing and configuring InfoScale DR Manager on Kubernetes
    1.  
      Introduction
    2.  
      Prerequisites
    3.  
      Creating Persistent Volume for metadata backup
    4.  
      External dependencies
    5. Installing InfoScale DR Manager
      1.  
        Configuring Global Cluster Membership (GCM)
      2.  
        Configuring Data Replication
      3.  
        Additional requirements for replication on Cloud
      4.  
        Configuring DNS
      5.  
        Configuring Disaster Recovery Plan
  11. Disaster Recovery scenarios
    1.  
      Migration
    2.  
      Takeover
  12. Configuring InfoScale
    1.  
      Logging mechanism
    2.  
      Configuring Veritas Oracle Data Manager (VRTSodm)
    3.  
      Enabling user access and other pod-related logs in Container environment
  13. Administering InfoScale on Containers
    1.  
      Adding Storage to an InfoScale cluster
    2.  
      Managing licenses
  14. Upgrading InfoScale
    1.  
      Prerequisities
    2.  
      On a Kubernetes cluster
    3.  
      On an OpenShift cluster
  15. Troubleshooting
    1.  
      Collecting logs by using SORT Data Collector
    2.  
      Known Issues
    3.  
      Limitations

Adding nodes to an existing cluster

Complete the following steps to add nodes to an existing InfoScale cluster-

  1. Ensure that you add the worker nodes to the OCP cluster.

    Note:

    You must add all OpenShift worker nodes to the InfoScale cluster.

  2. Run the following command on the bastion node to check whether the newly added node is Ready.

    oc get nodes -A

    Review output similar to the following

    NAME                  STATUS ROLES  AGE VERSION
    ocp-cp-1.lab.ocp.lan  Ready  master 54d v1.22.1+d8c4430
    ocp-cp-2.lab.ocp.lan  Ready  master 54d v1.22.1+d8c4430
    ocp-cp-3.lab.ocp.lan  Ready  master 54d v1.22.1+d8c4430
    ocp-w-1.lab.ocp.lan   Ready  worker 54d v1.22.1+d8c4430
    ocp-w-2.lab.ocp.lan   Ready  worker 54d v1.22.1+d8c4430
    ocp-w-3.lab.ocp.lan   Ready  worker 54d v1.22.1+d8c4430
    ocp-w-4.lab.ocp.lan   Ready  worker 54d v1.22.1+d8c4430 
    
  3. To add new nodes to an existing cluster, the cluster must be in a running state. Run the following command on the bastion node to verify.

    oc get infoscalecluster

    See the State in the output similar to the following -

    NAME                 NAMESPACE      VERSION STATE   AGE
    infoscalecluster-dev infoscale-vtas 8.0.220 Running 1m15s
    
  4. Edit clusterInfo section of the sample /YAML/OpenShift/cr.yaml to add information about the new nodes.

    In this example, worker-node-1 and worker-node-2 exist. worker-node-3 is being added.

    Note:

    The number of IP addresses must be same for all nodes.

       
    apiVersion: infoscale.veritas.com/v1
    kind: InfoScaleCluster
    metadata:
    name: infoscalecluster-dev
    
    spec:
    clusterID: <Optional- Enter an ID for this cluster>
    isSharedStorage: true 
      clusterInfo:
      - nodeName: "worker-node-1"
        ip:
        - "<IP address of worker-node-1>"
      - nodeName: "worker-node-2"
        ip:
        - "<IP address of worker-node-2>"
      - nodeName: "worker-node-3"
        ip:
        - "<IP address of worker-node-3>"
        excludeDevice:
        - /dev/sdm
        - /dev/sdn
        
    .
    .                                               
     
     YOU CAN ADD UP TO 16 NODES.
    
     fencingDevice: ["<Hardware path to the first fencing device>",
                      "<Hardware path to the second fencing device>",    
                      "<Hardware path to the third fencing device>", ]
      encrypted: false
      sameEnckey: false
        
     
     
  5. Run the following command on the bastion node to initiate add node workflow.

    oc apply -f /YAML/OpenShift/cr.yaml

  6. You can run the following commands on the bastion node when node addition is in progress.

    a. oc get infoscalecluster

    See the State in the output as under. ProcessingAddNode indicates node is getting added.

     
    NAME                   NAMESPACE        VERSION   STATE             AGE
    infoscalecluster-dev   infoscale-vtas   8.0.220   ProcessingAddNode 26m
          
     
    

    b. oc describe infoscalecluster -n infoscale-vtas

    Output similar to following indicates the cluster status during add node. The cluster is Degraded when node addition is in progress.

    Cluster Name:  infoscalecluster-dev
      Cluster Nodes:
        Exclude Device:
          /dev/sdm
          /dev/sdn
        Node Name:  worker-node-1
        Role:       Joined,Master
        Node Name:  worker-node-2
        Role:       Joined,Slave
        Node Name:  worker-node-3
        Role:         Out of Cluster
       Cluster State:  Degraded
       enableScsi3pr:  false
       Images:
        Csi:
          Csi External Attacher Container:      csi-attacher:v3.1.0
    
  7. Run the following command on the bastion node to verify if pods are created successfully. It may take some time for the pods to be created.

    oc get pods -n infoscale-vtas

    Output similar to the following indicates a successful creation.

    NAME                                 READY STATUS  RESTARTS AGE
    infoscale-csi-controller-1234-0      5/5   Running 0        19h
    infoscale-csi-node-1234-gf9pf        2/2   Running 0        19h
    infoscale-csi-node-1234-gg5dq        2/2   Running 0        18h
    infoscale-csi-node-1234-nmt85        2/2   Running 0        18h
    infoscale-csi-node-1234-r6jv8        2/2   Running 0        19h
    infoscale-csi-node-1234-w5bln        2/2   Running 2        19h
    infoscale-fencing-controller-
                    234-864468775c-4sbxw 1/1   Running 0        18h
    infoscale-fencing-enabler-1234-8b65z 1/1   Running 0        19h
    infoscale-fencing-enabler-1234-bkbbh 1/1   Running 3 (18h ago) 18h
    infoscale-fencing-enabler-1234-jvzjk 1/1   Running 5 (18h ago) 18h
    infoscale-fencing-enabler-1234-pxfmt 1/1   Running 4 (18h ago) 19h
    infoscale-fencing-enabler-1234-qmjrv 1/1   Running 0        19h
    infoscale-sds-1234-e383247e62b56585-
                                   2xxvh 1/1   Running 1        19h
    infoscale-sds-1234-e383247e62b56585-
                                   cnvkg 1/1   Running 0        18h
    infoscale-sds-1234-e383247e62b56585-
                                   l5z7m 1/1   Running 0        19h
    infoscale-sds-1234-e383247e62b56585-
                                   xlkf8 1/1   Running 0        18h
    infoscale-sds-1234-e383247e62b56585-
                                   zkpgt 1/1   Running 0        19h
    infoscale-sds-operator-bb55cfc4d- 
                                   pclt5 1/1   Running 0        18h
    infoscale-licensing-operator
                      -5fd897f68f-7p2f7  1/1   Running 0        18h
    nfd-controller-manager-6bbf6df4d9-
                                   dbxgl 2/2   Running 2        20h
    nfd-master-2h7x6                     1/1   Running 0        19h
    nfd-master-kclkq                     1/1   Running 0        19h
    nfd-master-npjzm                     1/1   Running 0        19h
    nfd-worker-8q4lz                     1/1   Running 0        19h
    nfd-worker-cvkqp                     1/1   Running 0        19h
    nfd-worker-js7tt                     1/1   Running 1        19h
    special-resource-controller-manager-
                            86b6c7-wv2tc 2/2   Running 0        20h
    
    
  8. Run the following command on the bastion node to verify if the cluster is 'Running'

    oc get infoscalecluster

    See the State in the output similar to the following -

    NAME                 NAMESPACE      VERSION STATE   AGE
    infoscalecluster-dev infoscale-vtas 8.0.220 Running 1m15s
    
  9. Run the following command on the bastion node to verify whether the cluster is 'Healthy'.

    oc describe infoscalecluster

    Check the Cluster State in the output similar to the following-

    Status:
      Cluster Name:  infoscalecluster-dev
      Cluster Nodes:
        Node Name:    worker-node-1
        Role:         Joined,Master
        Node Name:    worker-node-2
        Role:         Joined,Slave
        Node Name:    worker-node-3
        Role:         Joined,Slave
      Cluster State:  Healthy