NetBackup IT Analytics Data Collector Installation and Configuration Guide for Veritas NetBackup

Last Published:
Product(s): NetBackup IT Analytics (11.5)
  1. Introduction
    1.  
      Overview
    2.  
      Distributed Data Collector (recommended for NetBackup)
    3.  
      Centralized Data Collector
    4.  
      Collection of backup and restore data
    5.  
      Data Collection Policies
  2. Configure a NetBackup IT Analytics Distributed Data Collector on a NetBackup Primary Server
    1.  
      Overview
    2. Configure Data Collector on non-clustered NetBackup 10.4 and later primary server
      1.  
        Manage Data Collector installation on NetBackup primary server
    3.  
      Configuration workflow for NetBackup 10.1.1, 10.2, 10.2.01, 10.3 or 10.3.0.1 on a non-clustered NetBackup primary server
    4. Configure Data Collector on non-clustered NetBackup 10.1.1, 10.2, 10.2.01, 10.3 or 10.3.0.1 primary server
      1.  
        Manage Data Collector installation on NetBackup (install/remove)
    5.  
      Configuration workflow for NetBackup versions lower than 10.1.1
    6.  
      Configure Data Collector on NetBackup primary with version lower than 10.1.1
  3. Configure a Veritas NetBackup Data Collector Policy
    1.  
      Veritas NetBackup Data Collector policy configuration prerequisites
    2.  
      Create NetBackup Data Collector Role, Service Account, and API Key
    3.  
      Add a Veritas NetBackup Data Collector policy
    4.  
      Add/Edit NetBackup Primary Servers within the Data Collector policy
    5. Configuring file analytics in NetBackup Data Collector policy
      1.  
        Prerequisites to configure File Analytics for NetBackup
      2.  
        Data Collector and Portal sizing guidelines for File Analytics
      3.  
        Configure File Analytics
      4.  
        Export File Analytics data
  4. Installing the Data Collector software
    1.  
      Introduction
    2.  
      Considerations to install Data Collector on non-English systems
    3.  
      Install Data Collector Software on Windows
    4.  
      Install Data Collector software on Linux
    5.  
      Deploy Data Collector in native Kubernetes environment
    6.  
      Configure Data Collector manually for Veritas NetBackup
    7.  
      Install Data Collector binaries on Windows (without configuration)
    8.  
      Install Data Collector binaries on Linux host (without configuration)
    9.  
      Override default Java Heap memory (XMX) value for Data Collector utilities
  5. Configure SSL
    1.  
      SSL/TLS certificate configuration
    2.  
      SSL implementation overview
    3.  
      Obtain an SSL certificate
    4.  
      Update the web server configuration to enable SSL on the Portal server
    5.  
      Enable / Disable SSL for a Data Collector
    6.  
      Enable / Disable SSL for emailed reports
    7.  
      Test and troubleshoot SSL configurations
    8.  
      Keystore file locations on the Data Collector server
    9.  
      Import a certificate into the Data Collector Java keystore
    10.  
      Keystore on the portal server
    11.  
      Add a virtual interface to a Linux server
    12.  
      Add a virtual / secondary IP address on Windows
  6. Centralized Data Collector for NetBackup - Prerequisites, Installation, and Configuration
    1.  
      Overview
    2. Step-1: Choose operating system and complete prerequisites
      1.  
        Factors impacting Data Collector performance and memory requirements
      2.  
        Data Collector supported operating systems
      3.  
        Data Collector server memory and CPU guidelines
      4.  
        Additional prerequisites
      5.  
        Linux Data Collector Prerequisites: Changing the Linux Temporary Directory for Collection
    3.  
      Step-2: HTTPS requirement
    4.  
      Step-3: Add Data Collector on NetBackup IT Analytics Portal
    5.  
      Step-4: Create NetBackup Data Collector Role, Service Account, and API Key
    6. Step-5: SSH/WMI
      1.  
        Linux Centralized Data Collector: SSH
      2. Windows Data Collector: WMI Connectivity
        1.  
          Testing WMI connectivity
        2.  
          Installing the WMI Proxy Service (Windows Host Resources only)
    7.  
      Step-6: Install the Data Collector
    8.  
      Step-7: Configure Data Collector
    9.  
      Step-8: Verify the Data Collector is online from the Portal
    10.  
      Step-9: Confirm that the Data Collector is updated
    11.  
      Step-10: Configure the data collection policy
    12.  
      Step-11: Confirm that the NetBackup data collection policy is collecting data
  7. Upgrading Data Collector Locally
    1.  
      Overview
    2.  
      Verification of upgrade bundle available on Data Collector server
    3.  
      Upgrade the Upgrade Manager component
    4.  
      Upgrade the Data Collector component which is the aptare.jar file
    5.  
      Upgrade the Upgrade Manager and Data Collector components together
    6.  
      Upgrade logs and upgrade related database views
    7.  
      Resolve file lock issue on Windows host during Data Collector upgrade
  8. Clustering Data Collectors with VCS and Veritas NetBackup (RHEL)
    1.  
      Clustering Data Collectors with VCS and Veritas NetBackup (RHEL)
    2.  
      Prerequisites
    3.  
      Getting started with Data Collector clustering
    4.  
      Configuring the Data Collector
    5.  
      Upgrading a clustered Data Collector
    6.  
      Considerations when Data Collector is pointing to Alta Domain Management
  9. Clustering Data Collectors with VCS and Veritas NetBackup (Windows)
    1.  
      Clustering Data Collectors with VCS and Veritas NetBackup (Windows)
    2.  
      Prerequisites
    3.  
      Getting Started with Data Collector Clustering
    4.  
      Main.cf
    5.  
      Upgrading a Clustered Data Collector
    6.  
      Manage cluster configuration during NetBackup upgrade (Windows)
    7.  
      Uninstall cluster Data Collector
  10. Install and configure NetBackup IT Analytics Data Collector on MSCS environment
    1.  
      Cluster Data Collectors with MSCS on Windows
    2.  
      Perform cluster configurations
    3.  
      Upgrade NetBackup IT Analytics Data Collector in MSCS
    4.  
      Uninstall NetBackup IT Analytics Data Collector
    5.  
      Steps to perform before and after NetBackup upgrade
  11. Data Collector Policy Migration
    1.  
      Migrate NetBackup data collection policy from centralized to distributed Data Collector
  12. Pre-Installation setup for Veritas NetBackup appliance
    1.  
      Overview
    2.  
      Prerequisites for adding Data Collectors (Veritas NetBackup appliance)
    3.  
      Installation Overview (Veritas NetBackup Appliance)
    4.  
      Adding a Veritas NetBackup Appliance Data Collector policy
  13. Pre-installation setup for Veritas Flex Appliance
    1.  
      Pre-Installation setup for Veritas Flex Appliance
    2.  
      Prerequisites for adding Data Collectors (Veritas Flex Appliance)
    3.  
      Installation overview (Veritas Flex Appliance)
    4.  
      Add a Veritas Flex Appliance policy
    5.  
      Troubleshoot Veritas Flex Appliance policy configuration
  14. Data Collector Troubleshooting
    1.  
      Resolving Data Collectors connections issues - Linux specific
    2.  
      Resolving Data Collectors connections issues - Windows specific
    3.  
      Portal upgrade performance issues
    4.  
      Configuring web proxy updates
    5.  
      Host resources troubleshooting
    6.  
      Host resources: Check the status of the WMI proxy server
    7.  
      Host resources: Post-Installation verification
    8. Host resources: Check host connectivity using standard SSH
      1.  
        Checking Paths for SSH
      2.  
        Environment setting for bash users
    9.  
      Host resources: Check host connectivity
    10.  
      Host resources: Check host connectivity using Host Resource Configuration file
    11. Host resources: Generating host resource configuration files
      1.  
        Sample lines in an input file
    12.  
      Host resources: Check the execution of a command on a remote server
    13.  
      Host resources Data Collection
    14.  
      Host resources: Collection in stand-alone mode
    15. Configuring parameters for SSH
      1.  
        Configure channelWaitTime
      2.  
        Configure singleChannelSession
      3.  
        Configure sudoWithPassword
    16.  
      Identifying Windows file system access errors (File Analytics)
    17.  
      Collect from remote shares (File Analytics)
    18.  
      Adding a certificate to the Java keystore
    19.  
      Override default Java Heap memory (XMX) value for Data Collector utilities
  15. Appendix A. Configure Appliances
    1.  
      Configure NetBackup Appliances for Data Collection
    2.  
      Configure NetBackup Flex Appliances for Data Collection
  16. Appendix B. Load historic events
    1.  
      Introduction
    2.  
      Load Commvault Simpana events
    3.  
      Load EMC Avamar events
    4.  
      Load EMC NetWorker events
    5.  
      Load HP Data Protector events
    6.  
      Load IBM Spectrum Protect (TSM) events
    7.  
      Load Oracle Recovery Manager (RMAN) events
    8.  
      Load Veeam Backup & Replication events
    9. Load Veritas NetBackup events
      1.  
        Load events for individual NetBackup clients
      2.  
        Load events for a group of NetBackup clients
    10.  
      Load Veritas Backup Exec events
    11.  
      Corrections in duplication of clients
    12.  
      Cohesity
    13.  
      Dell EMC NetWorker Backup & Recovery
  17. Appendix C. Firewall configuration: Default ports
    1.  
      Firewall configuration: Default ports
  18. Appendix D. CRON Expressions for Policy and Report Schedules
    1.  
      CRON expressions for policy probe schedules
    2.  
      CRON expressions for scheduling reports
  19. Appendix E. Maintenance Scenarios for Message Relay Server Certificate Generation
    1.  
      Regenerate authentication certificate nearing expiry (or already expired)
    2.  
      Recover inadvertently deleted aptare.ks file
    3.  
      Authenticate new database with existing SSL certificates
    4.  
      SSL certificate authentication for a new data collector

Step-7: Configure Data Collector

Step-7A: Configure Data Collector for NetBackup 10.4 or later from its Web UI

The Data Collector reports NetBackup information to NetBackup IT Analytics or to Veritas Alta View. The Data Collector is installed along with a NetBackup installation or upgrade.

For NetBackup 10.4 or higher, you can register their Data Collector directly from the NetBackup Web UI by adding a .json file.

To register the Data Collector from the NetBackup Web UI:

  1. On the top right corner within the NetBackup Web UI, click the Cog icon and select Data Collector Registration.
  2. Click Register with Veritas NetBackup IT Analytics.
  3. Click Choose file to select the registration file (JSON) that you have created earlier.
  4. If required, click the Proxy server option to specify Proxy server settings.
  5. Click Register.
Step-7B: Configure NetBackup IT Analytics Data Collector manually for earlier versions of NetBackup

This section details the steps required to manually configure the Data Collector using a .key file. This configuration requires editing a response file to configure the distributed Data Collector, installed by default on the non-clustered NetBackup primary. The Veritas NetBackup primary server installation will deploy NetBackup IT Analytics Data Collector binaries automatically on Windows ( C:\Program Files\Veritas\AnalyticsCollector) and Linux (/usr/openv/analyticscollector).

The NetBackup IT Analytics Portal must be already installed in your data center and a Data Collector entry must be added via the Collector Administration screen of the portal for each NetBackup primary server before you perform this configuration.

See Step-3: Add Data Collector on NetBackup IT Analytics Portal.

To configure the Data Collector manually on Windows using key file:

  1. Create a response file as a batch script responsefile.cmd with the contents shown. These are the responses to the user input required to configure the Data Collector. A sample response file is also available in the installer media in x64\ITA_DC\responsefile.cmd.
    SET DATACOLLECTOR_NAME=name_of_the_data_collector 
    SET DATACOLLECTOR_PASSCODE=passcode_for_the_data_collector 
    SET DATARECEIVER_URL=data_receiver_URL 
    SET DATACOLLECTOR_KEY_FILE_PATH=path_to_the_key_file 
    SET HTTP_PROXY_CONF=N 
    SET PROXY_HTTP_URL= 
    SET PROXY_HTTP_PORT= 
    SET PROXY_HTTPS_URL= 
    SET PROXY_HTTPS_PORT= 
    SET PROXY_USERID= 
    SET PROXY_PASSWORD= 
    SET PROXY_NOT_FOR= 
  2. Update the value for each field with appropriate data. A sample response file is also available in the installer media in x64\ITA_DC\responsefile.cmd.
  3. Run the command shown:
    "C:\ProgramData\Veritas\NetBackup IT Analytics\DC\configure.cmd" 
    
    \RESPFILE:response_file_path \INSTALL_TYPE:CONFIG 
  4. Validate the Data Collector integration with NetBackup IT Analytics by going to C:\Program Files\Veritas\analyticscollector\mbs\bin\ and running this command: checkinstall.bat.

    If the Data Collector is configured with the Portal, the response is displayed as  SUCCESSFUL.

    Note:

    If there is a version mismatch of aptare.jar between the Data Collector and the Portal, execution of the checkinstall.bat command starts an auto-update of the Data Collector.

To configure the Data Collector manually on Linux using key file:

  1. Create a response file with the contents shown. These are the responses to the user input required to configure the Data Collector:
    COLLECTOR_NAME=name_of_the_data_collector 
    COLLECTOR_PASSCODE=passcode_for_the_data_collector 
    DR_URL=data_receiver_URL 
    COLLECTOR_KEY_PATH=path_to_the_key_file 
    HTTP_PROXY_CONF=N 
    HTTP_PROXY_ADDRESS= 
    HTTP_PROXY_PORT= 
    HTTPS_PROXY_ADDRESS= 
    HTTPS_PROXY_PORT= 
    PROXY_USERNAME= 
    PROXY_PASSWORD= 
    PROXY_EXCLUDE=
  2. Update the value for each field with appropriate data. A sample response file is available on the install media and from /usr/openv/analyticscollector/installer/responsefile.sample on the primary server.
  3. Run the command:
    /usr/openv/analyticscollector/installer/dc_installer.sh -c responsefile_path 
  4. Validate the Data Collector integration with NetBackup IT Analytics by navigating to /usr/openv/analyticscollector/mbs/bin/ and running ./checkinstall.sh. If the Data Collector is able to communicate with the NetBackup IT Analytics Portal, the response is displayed as  SUCCESSFUL.

    Note:

    If there is a version mismatch of aptare.jar between the Data Collector and the Portal, execution of the checkinstall.bat command starts an auto-update of the Data Collector.

Step-7C: Configure Data Collector for NetBackup Appliances (including Flex appliance)

You can configure a Data Collector on the primary server pod using the following steps. From NetBackup version 10.3 Cloud Scale release, Data Collector on primary server pod is supported. The below steps to configure the Data Collector on a primary server must be performed as a root user. On a Flex appliance, connect to the primary server pod first and then switch to the root user using sudo. On a NetBackup Appliance, access shell by creating NetBackup CLI user.

To configure NetBackup IT Analytics for NetBackup deployment:

  1. Create a DNS server entry in such a way that IP of the Portal must be resolvable to a single FQDN. IP of the NetBackup IT Analytics Portal must be resolved to:
    itanalyticsagent.<yourdomain> 

    Note the following:

    • If the Portal URL is itanalyticsportal.<yourdomain>, then ensure to add the DNS entries for the following hostnames: itanalyticsagent.<yourdomain>

    • If the Portal URL is aptareportal.<yourdomain>, then ensure to add the DNS entries for the following hostnames: aptareagent.<yourdomain>

  2. Depending upon the Data Collector version, collect the <your-collector-name>.key or <your-collector-name>.json  file for the new Data Collector by accessing the Portal link and creating a collector. Copy it to the host machine from where NetBackup primary is deployed.

    For more information, refer to the  Data Collector Encryption section in NetBackup IT Analytics User Guide.

  3. Create a new folder analyticscollector at persisted location (for example, /mnt/nbdata/) using the following commands:
    cd "/mnt/nbdata/" 
    mkdir analyticscollector 
  4. Copy the  <your-collector-name>.key file to /mnt/nbdata/analyticscollector  inside the NetBackup primary host or container.
  5. Exit from the container and copy the <your-collector-name>.json  inside the NetBackup primary host or container.
  6. In case if the data-receiver is configured with self-signed certificate (https), user must add the certificate in the Data Collector.
  7. Connect to the NetBackup primary host or the container.
  8. Navigate to /usr/openv/analyticscollector/installer/ location and perform the following.
    • Open the responsefile.sample and add the following parameters:

      If the Data Collector is lower than 11.3, create the response file with the following contents.

      COLLECTOR_NAME=<your-collector-name>
      COLLECTOR_PASSCODE=<your-password>
      DR_URL=<http>/<https>://itanalyticsagent.<yourdomain> 
      COLLECTOR_KEY_PATH=<path to your-collector-name.key> 
      HTTP_PROXY_CONF=N 
      HTTP_PROXY_ADDRESS=
      HTTP_PROXY_PORT=
      HTTPS_PROXY_ADDRESS= 
      HTTPS_PROXY_PORT= 
      PROXY_USERNAME= 
      PROXY_PASSWORD= 
      PROXY_EXCLUDE=

      If the Data Collector version is 11.3 or later, create the response file with the following contents.

      COLLECTOR_REGISTRATION_PATH=<path to .json file> 
      HTTP_PROXY_CONF=N 
      HTTP_PROXY_ADDRESS=
      HTTP_PROXY_PORT=
      HTTPS_PROXY_ADDRESS=
      HTTPS_PROXY_PORT=
      PROXY_USERNAME=
      PROXY_PASSWORD=
      PROXY_EXCLUDE=
  9. Configure the Data Collector with the NetBackup IT Analytics Portal as follows.

    Note:

    If the Data Collector installed is of a lower version than the Portal, wait for the Data Collector auto-upgrade to finish before you proceed.

    For NetBackup Appliance version 5.3 or later:

    • Run the following command as a NetBackup CLI user:

      /usr/openv/analyticscollector/installer/dc_installer.sh -c /usr/openv/analyticscollector/installer/responsefile.sample
    • To verify the Data Collector integration with NetBackup IT Analytics Portal, run:

      /usr/openv/analyticscollector/mbs/bin/checkinstall.sh

    For NetBackup Appliance version 5.1.1:

    • Run the following command as a NetBackup CLI user:

      sudo /usr/openv/analyticscollector/installer/dc_installer.sh -c /usr/openv/analyticscollector/installer/responsefile.sample
    • To verify the Data Collector integration with NetBackup IT Analytics Portal, run:

      sudo /usr/openv/analyticscollector/mbs/bin/checkinstall.sh

    If you are on Flex Appliance:

    • Connect to the primary server container and then switch to root user using sudo and run:

      /usr/openv/analyticscollector/installer/dc_installer.sh -c /usr/openv/analyticscollector/installer/responsefile.sample
    • To verify the Data Collector integration with NetBackup IT Analytics Portal, run:

      /usr/openv/analyticscollector/mbs/bin/checkinstall.sh 

    If the Data Collector is configured with the Portal, it will display SUCCESSFUL.

    Note:

    If there is a version mismatch of aptare.jar between Data Collector and Portal, execution of checkinstall.sh command will trigger an auto-update of the Data Collector.

  10. Check the Data Collector services status by running the following command and ensure that the following Data Collector services are up and running:
    /usr/openv/analyticscollector/mbs/bin/aptare_agent status 

    Output of the above command:

    IT Analytics WatchDog is running (pid: 13312). 
    IT Analytics MetaDataCollector is stopped.
    IT Analytics EventDataCollector is stopped.
    IT Analytics DataCollector process is running (pid: 13461).
    IT Analytics On-demand process is running (pid: 13463). 

For more information about the Data Collector policy, see NetBackup IT Analytics User Guide.

Step-7D: Configure NetBackup IT Analytics for NetBackup deployment on Kubernetes

You can configure Data Collector on the primary server. Following are the steps for respective configurations. From NetBackup version 10.3 Cloud Scale release, Data Collector on primary server is supported. The following steps to configure the NetBackup IT Analytics Data Collector need to be performed as root user. Connect to the primary server pod and then switch to root user using sudo.

To configure NetBackup IT Analytics for NetBackup deployment

  1. Create a DNS server entry in such a way that IP of the NetBackup IT Analytics Portal must be resolvable to a single FQDN. IP of the NetBackup IT Analytics Portal must be resolved to:
    itanalyticsagent.<yourdomain>
    

    Note the following:

    • If the Portal URL is itanalyticsportal.<yourdomain>, then ensure to add the DNS entries for the following hostnames:

      itanalyticsagent.<yourdomain> 
      
    • If the Portal URL is aptareportal.<yourdomain>, then ensure to add the DNS entries for the following hostnames:

      aptareagent.<yourdomain>
      
  2. Collect <your-collector-name>.key for the new Data Collector by accessing the Portal link and creating a collector and copy it to the host machine from where Kubernetes cluster is accessed. For more information, see Data Collector Encryption section in NetBackup IT AnalyticsUser Guide.
  3. Copy the <your-collector-name>.key to /mnt/nbdata/analyticscollector inside the NetBackup primary pod using the command:
    kubectl cp <keyfile-name> <namespace>/<primary-pod-name>:/mnt/nbdata/analyticscollector
  4. In case if the data-receiver is configured with self-signed certificate (https), you must add the certificate in the data collector.
  5. Execute the following command on the primary server pod:
    kubectl exec -it -n <namespace> <primaryServer-pod-name> -- bash
  6. Navigate to /usr/openv/analyticscollector/installer/ location and perform the following:
    • Open the responsefile.sample and add the following parameters:

      COLLECTOR_REGISTRATION_PATH=<path to the .json file> 
      HTTP_PROXY_CONF=N 
      HTTP_PROXY_ADDRESS= 
      HTTP_PROXY_PORT= 
      HTTPS_PROXY_ADDRESS= 
      HTTPS_PROXY_PORT= 
      PROXY_USERNAME= 
      PROXY_PASSWORD= 
      PROXY_EXCLUDE=
      
    • Run  this  command to configure Data Collector with Portal.

      /usr/openv/analyticscollector/installer/dc_installer.sh -c /usr/openv/analyticscollector/installer/responsefile.sample
  7. Validate Data Collector integration with NetBackup IT Analytics by performing the following:
    • Go to usr/openv/analyticscollector/mbs/bin/.

    • Run the command:

      ./checkinstall.sh 

    If Data Collector is configured with the Portal, it will display as SUCCESSFUL.

    Note:

    If there is a version mismatch of aptare.jar between Data Collector and Portal, execution of checkinstall.sh command will trigger an auto-update of the Data Collector.

  8. Check the Data Collector services status by running the following command and ensure that the following Data Collector services are up and running:

    /usr/openv/analyticscollector/mbs/bin/aptare_agent status

    Output of the above command:

    IT Analytics WatchDog is running (pid: 13312).
    IT Analytics MetaDataCollector is stopped.
    IT Analytics EventDataCollector is stopped.
    IT Analytics DataCollector process is running (pid: 13461).
    IT Analytics On-demand process is running (pid: 13463).
    IT Analytics Message Relay Server process is running (pid: 13471)
    

For more information about the Data Collector policy, see  NetBackup IT Analytics User Guide.