NetBackup IT Analytics Data Collector Installation Guide for the Cloud

Last Published:
Product(s): NetBackup IT Analytics (11.0)
  1. Pre-Installation Setup for Amazon Web Services (AWS)
    1.  
      Pre-Installation setup for Amazon Web services (AWS)
    2.  
      Prerequisites for adding Data Collectors (Amazon Web services)
    3.  
      Prerequisite Amazon Web services (AWS) configurations
    4.  
      Configure an S3 bucket to receive billing reports
    5.  
      Select cost allocation tags
    6. Create an AWS IAM user
      1.  
        Example of a custom AWS policy for NetBackup IT Analytics AWS collection
    7. Link AWS accounts for Collection of consolidated billing data
      1.  
        Create a role for NetBackup IT Analytics Data Collection
      2.  
        Add the role to the IAM user
    8.  
      Installation overview (Amazon Web Services - AWS)
    9.  
      Add an Amazon Web Services (AWS) policy
  2. Pre-installation setup for Google Cloud Platform
    1.  
      Overview
    2.  
      Pre-installation setup for GCP
    3.  
      Prerequisites for adding Data Collectors (GCP)
    4.  
      Installation GCP
    5.  
      Adding policy
    6.  
      Testing the collection
    7.  
      Creating an IAM role
    8.  
      Billing Data Access Role
    9.  
      Cloud API
    10.  
      Project access
  3. Pre-Installation Setup for OpenStack Ceilometer
    1.  
      Pre-Installation setup for OpenStack Ceilometer
    2.  
      Prerequisites for adding Data Collectors (OpenStack Ceilometer)
    3.  
      Installation Overview (OpenStack Ceilometer)
    4.  
      Adding an OpenStack Ceilometer Data Collector policy
  4. Pre-Installation Setup for OpenStack Swift
    1.  
      Pre-Installation setup for OpenStack Swift
    2.  
      Prerequisites for adding Data Collectors (OpenStack Swift)
    3.  
      Installation overview (OpenStack Swift)
    4.  
      Adding an OpenStack Swift Data Collector policy
  5. Pre-Installation Setup for Microsoft Azure
    1.  
      Pre-Installation setup for Microsoft Azure
    2.  
      Setting up credentials for Microsoft Azure Data Collection
    3.  
      Install the Azure PowerShell client on a Windows computer
    4.  
      Find your tenant and subscription ID
    5.  
      Register a new application for the Data Collector
    6.  
      Create a principal and assign role to the application
    7.  
      Prerequisites for Adding Data Collectors (Microsoft Azure)
    8.  
      Installation overview (Microsoft Azure)
    9.  
      Add a Microsoft Azure Data Collector policy
  6. Installing the Data Collector Software
    1.  
      Introduction
    2.  
      Installing the WMI Proxy service (Windows host resources only)
    3.  
      Testing WMI connectivity
    4.  
      Install Data Collector Software on Windows
    5.  
      Install Data Collector software on Linux
    6.  
      Install Data Collector in containerized environment
  7. Validating Data Collection
    1.  
      Validation methods
    2.  
      Data Collectors: Vendor-Specific validation methods
    3. Working with on-demand Data Collection
      1.  
        View real-time logging during an on-demand collection
      2.  
        Generating debug level logs during an on-demand collection
    4.  
      Using the CLI check install utility
    5.  
      List Data Collector configurations
  8. Uninstalling the Data Collector
    1.  
      Uninstall the Data Collector on Linux
    2.  
      Uninstall the Data Collector on Windows
  9. Manually Starting the Data Collector
    1.  
      Introduction
  10. Appendix A. Firewall Configuration: Default Ports
    1.  
      Firewall configuration: Default ports

Install Data Collector in containerized environment

This procedure provides the steps to install Data Collector using a container image, which is a lightweight, standalone executable, on Linux hosts. This method enables efficient Data Collector installation using a single container image and reduces the human errors caused during manual or ISO-based installations. Since this installation using a container image requires minimal user input, this installation is also termed as silent installation.

Prerequisites and dependencies

System requirements and installation dependencies for the system on which Data Collector will be installed are listed below:

  • Docker or Podman must be pre-installed on the system.

  • Assume root role on the host system.

  • Create a directory structure in the host system where data from the container will be persisted. Ensure that the file system supporting the /data directory has enough free space as recommended in the NetBackup IT Analytics Certified Configurations Guide for Data Collector. The /data directory in the host system will be mounted inside the container as /opt/aptare.

    mkdir -p /data/install/conf
  • Create a configuration file named conf-file.

    The format of configuration conf-file must be as follows:

    COLLECTOR_NAME=Name of the Data Collector as defined in the 
    portal. 
    COLLECTOR_PASSWORD=Passcode assigned to the Data Collector 
    during its creation. 
    DR_URL=Data receiver URL 
    example:-<http://aptareagent.domainName> 
    COLLECTOR_KEY_PATH=/data/aptare/conf/<keyname.key>  
    HTTP_PROXY_CONF=N [Y-yes/N-no whether we are using proxy of not] 
    HTTP_PROXY_ADDRESS=Provide HTTP proxy address, if proxy 
    configuration is Yes.
    HTTP_PROXY_PORT=Provide HTTP proxy port, if proxy 
    configuration is Yes.
    HTTPS_PROXY_ADDRESS=Provide HTTPS proxy address, if 
    proxy configuration is Yes.
    HTTPS_PROXY_PORT=Provide HTTPS proxy port, if proxy 
    configuration is Yes. 
    PROXY_USERNAME=Provide Proxy userName  
    PROXY_PASSWORD=Provide Proxy password. 
    PROXY_EXCLUDE=Provide exclude

    Example: A sample conf-file content looks like:

    COLLECTOR_NAME=testdc
    COLLECTOR_PASSWORD=testdc@123
    DR_URL=http://itanalyticsagent.domain
    COLLECTOR_KEY_PATH=/data/aptare/conf/testdc.key
    HTTP_PROXY_CONF=N
    HTTP_PROXY_ADDRESS=
    HTTP_PROXY_PORT=
    HTTPS_PROXY_ADDRESS=
    HTTPS_PROXY_PORT=
    PROXY_USERNAME=
    PROXY_PASSWORD=
    PROXY_EXCLUDE=
  • Save the Data Collector key file and configuration conf-file on the Data Collector host at /data/install/conf. Both the files must be at the same location on the host. If the location of the files is changed, you must update the Docker run command accordingly with the new location.

  • Obtain the URL of the Docker image registry in your environment.

Install the Data Collector using the container image

Once you have the prerequisites in place, you must push the Docker image to your registry and initiate the installation.

To install through a container:

  1. Add execute permission to setup_vtas_registry.sh script.
    #chmod 744 setup_vtas_registry.sh
  2. Push the Docker image present in the itanalytics_images.tar to the registry in your environment:
    # setup_vtas_registry.sh -c <container registry URL> 
    -t <itanalytics_images.tar file path>

    Where:

    • <container registry URL> is the URL of the Docker image registry in your environment.

    • <itanalytics_images.tar file path> is the path to itanalytics_images.tar file.

    You can use docker images or podman images command depending on the platform you are on to verify the Docker image availability within your registry.

    In systems that use Podman, you may have to update the container registry configuration file /etc/containers/registries.conf to trust the <container registry URL>. For this, update the unqualified-search-registries setting in /etc/containers/registries.conf and restart the Podman service.

    In systems that use Docker, create the file /etc/docker/daemon.json and add the below content to it and restart the Docker service to make the change effective.

    {
        "insecure-registries" : [ "<container registry URL>:<port>" ]
    }
    
  3. Run the installation command for the container image.

    Note:

    Use Podman instead of command docker if you are on the system that supports Podman.

    # docker pull <Container registry URL>/
    itanalytics_datacollector_linux_<version>
    # docker run -d -v /sys/fs/cgroup/:/sys/fs/cgroup:ro 
    -v <path-to-location-of-config-and-key>:/data/aptare/conf 
    -v <path-to -data-location>:/opt/aptare 
    --add-host aptareportal.<DOMAIN>:<portal-IP> 
    --add-host aptareagent.<DOMAIN>:<Portal-IP> 
    --cap-add SYS_ADMIN 
    --name=<container-name> 
    <Container registry URL>/itanalytics_datacollector_linux_<version>

    Replace everything inside <> with values as indicated in the sample below.

    Example:

    # docker pull localhost:5000/itanalytics_datacollector_linux_11000
    # docker run -d -v /sys/fs/cgroup/:/sys/fs/cgroup:ro 
    -v /data/install/conf:/data/aptare/conf 
    -v /data:/opt/aptare 
    --add-host aptareportal.domain_name:10.1.5.6 
    --add-host aptareagent.domain_name:10.1.5.6 
    --cap-add SYS_ADMIN 
    --name=dc-container1 
    localhost:5000/itanalytics_datacollector_linux_11000 

After a successful installation, verify whether the Data Collector status appears Online on the NetBackup IT Analytics Portal. Note that the Data Collector is running inside a Docker Container and remains online as long as he container status is running.

Connect to container instance

Run this command to connect to the container instance and also to facilitate debugging when required.

# docker exec -it <image id> bash