NetBackup IT Analytics User Guide
- Introduction
- Understand the Portal
- About the Admin tab
- Explore your inventory
- Hierarchy toolbar to organize your data
- Show objects
- Use attributes to organize your data
- Pin reports - saving reports with inventory objects
- Assign attributes in the inventory list view
- Get acquainted with reports
- About badging
- Generate and maintain reports
- Select Report Scope
- Group hosts by attributes
- Search for hosts in the report Scope Selector
- Backup Manager advanced scope selector settings
- Solution reports scope selector settings
- Units of Measure in Reports
- Customize report filter logic
- Sort columns in reports
- Convert tabular report to chart
- Distribute, share, schedule, and alert
- Scheduling Exported Reports and Dashboards
- Organize reports
- Work with the dynamic template designer
- Dynamic Template Designer Quick Start
- Converting to a Homogeneous, Product-Specific Template
- Dynamic Template Function Configurations
- Create Fields with the Field Builder
- Scope Selector Component - Custom Filter
- Configure a Bar Chart Dynamic Template
- Steps to Create a Bar Chart Dynamic Template
- Configure an Area/Stacked Area Chart Dynamic Template
- Line Charts for Performance Metrics
- Line Chart Field Requirements
- One Object Per Line Chart, One or More Metrics Per Chart
- Multiple Objects Per Line Chart, One Metric Per Chart
- Example of a Stacked Bar Chart Dynamic Template
- Create a Sparkline Chart in a Tabular Dynamic Template
- Adding or Editing Methods
- Validate and Save a Method
- Work with the SQL template designer
- Database Published Views
- Create a SQL Template
- Configure SQL Template Scope Selector Components
- Sample SQL Queries
- Configure SQL Template Scope Selector Components
- Format the SQL Template Output
- Configure a Table in the SQL Template Designer
- Advanced SQL Report Template Options
- Export/Import SQL Templates
- Pipelined functions for report query building
- APTlistOfDates
- aptStringConcat
- getServerAttributeValue
- getObjectAttributeValue
- getChildServerGroupContextById
- getServerGroupContextById
- secsToHoursMinSecs
- APTgetTapeDriveStatusName
- getFullPathname
- listJobSummaryAfterRestart
- listJobSummaryAfterRestartNBW
- listJobSummaryAfterRestart for NetWorker Backup Jobs
- listOfBackupWindowDates
- listChargebackCatByVOLSDetail
- listChargebackCatByNcVolDetail
- listChargebackCatByFSDetail (for HNAS)
- listChargebackCatByFSDetail (for EMC Isilon)
- listChargebackByLUNSummary
- listChargebackByLUNDetail
- listChargebackCatByLUNSummary
- listChargebackCatByLUNDetail
- Alert configuration
- Manage hosts, backup servers, and host groups
- Manage attributes and objects
- Provide Portal access and user privileges
- Setting / Resetting passwords
- Managing user group home pages (Administrator)
- Configure master schedules and backup windows
- Add, edit, and move policies
- Add/Edit a threshold policy
- Capacity Chargeback policy types
- Solutions administration
- Manage and monitor data collection
- About data collection tasks
- Add/Edit data collectors
- Review collectors and collection status
- Upgrade Data Collectors
- Work with Capacity Manager host data collection
- Host Access Privileges, Sudo Commands, Ports, and WMI Proxy Requirements
- Host access requirements
- Manage credentials
- Configure host discovery policies to populate the host discovery and collection view
- Discovery processes
- Validate host connectivity
- Search and export in host discovery and collection
- Propagate probe settings: Copy probes, paste probes
- Discovery policies for Veritas NetBackup
- About Discovery types
- View and manage system notifications
- Customize with advanced parameters
- Use cases for advanced parameters
- Access control advanced parameters
- General Data Collection advanced parameters
- Cloud data collection advanced parameters
- Host discovery and collection advanced parameters
- Backup Manager advanced parameters
- Capacity Manager advanced parameters
- File Analytics advanced parameters
- Virtualization Manager advanced parameters
- Manage your Portal environment
- Analyze files
- Troubleshoot the Portal
- Retrieving log files
- Debug
- Attribute inheritance overrides
- Understanding report data caching
Configure Storage Optimization rules
A set of storage optimization rules are provided to assess areas within your enterprise that offer candidates for optimization. These rules include parameters that can be configured to isolate specific conditions relevant for your environment. You can also associate costs with rules. Cost sources may related to Chargeback values or you can set your own custom value. For example, the Unallocated LUNs rule can be configured to exclude LUNs less than a certain size. While various use cases drive how you configure a rule, the goal is to have analytics that help you identify storage optimization candidates and trends that require attention. This on-going process should periodically assess trends and codify business practices.
See Storage Optimization solution overview.
See Enable Storage Optimization rules.
See Report Reference Guide for details on Storage Optimization Solution Reports.
Once configured, a scheduled process gathers historical data for these categories so that you can identify areas that require further scrutiny. Accompanying reports present data that can be monitored over time, enabling an actionable process to maintain an optimized storage environment.
Best Practice
When configuring values for parameters, be as liberal as possible, initially. Then, over time, change parameters to produce a narrower actionable list. For optimal data comparisons, avoid frequent parameter modifications.
To edit a storage optimization rule
If optimization rules are not modified, the historical data process uses an active rule's default settings to collect the historical data.
- Select Admin > Solutions > Storage Optimization.
Rule
Rules are listed within relevant categories, such as Cloud and Storage.
Availability
If a particular type of collection is not licensed or collected, storage optimization data will not be available, regardless of how a rule is configured. In some cases, a Portal may have the necessary license, but collection may not have been enabled and/or completed.
Cloud does not require a specific license in order to deploy a data collector.
Data Protection requires Protection or Complete Suite license.
File Analytics requires a Complete Suite license.
Storage requires Storage or Complete Suite license.
Virtualization requires Protection or Complete Suite license.
Description
The full description of the Storage Optimization rule can be viewed by placing your mouse over the description.
Notes
Enter operational notes for future reference.
Status
Green check mark indicates successful collection of storage optimization historical data for enabled rules.
Red X indicates failed historical data collection. It could be that collection is attempting to access data for a product module that is not in your Portal environment. Click the red icon to view the Database Error Aggregation report.
A non-colored circle indicates that the storage optimization process did not run, typically because the rule is not enabled.
State
Indicates if the rule is Enabled or Disabled.
Last Run
The date and time that the Storage Optimization process ran and evaluated the collected data against the rule's configured parameters.
- Select a rule in the Storage Optimization grid and click Edit. Or, simply double-click the rule to access the edit dialog.
See Storage optimization rule prerequisites and logic.
Storage Optimization Rule
Description
Cloud Rules
AWS Orphan Snapshots
Amazon Web Services orphaned snapshots that are consuming storage may be impacting costs. This rule identifies snapshots for EC2 instances that no longer exist. When an EC2 instance is deleted, its snapshots need to be reviewed and its volumes brought back into the pool of usable storage. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For actionable information, see the Storage Optimization detail reports.
AWS Orphan Volumes
Amazon Web Services orphaned volumes that are consuming storage may be impacting costs. This rule identifies volumes for EC2 instances that no longer exist. When an EC2 instance is deleted, its snapshots need to be reviewed and its volumes brought back into the pool of usable storage. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For actionable information, see the Storage Optimization reports.
Data Protection Rules
Sources Backed Up by Multiple Servers
Sources backed up by multiple servers may be wasting storage and increasing maintenance costs. This rule identifies sources backed up by more than one server within a specific number of days (default is 7 days). If a source is moved from one backup system to another backup system, this rule would identify those changes too.
This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. The cost is calculated based on the number of different servers minus 1, times the average job size in GiB. For example, if a source is backed up by 3 different servers, the average size of these jobs is 200 GiB, and $0.25 for each GiB, then the saving might be: (3-1) * 200 GiB * $0.25 = $100
Data Domain File Compression
Compression metrics for the last 30 days are evaluated for inefficient storage usage and compression ratios for Data Domain clients. A low compression ratio may indicate a storage optimization opportunity or it may warrant a move of low compression clients to less expensive storage. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the Data Domain NetBackup File Compression Summary report.
High Backup Retention Jobs
Backups retained for too many days may be wasting storage and increasing maintenance costs. This rule identifies backups with a high number of retention days. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports.
File Analytics Rules
File Type Usage
File types that are consuming storage can be reviewed. The filename extension identifies a file type, such as iso, log, and cab. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. This File Type rule is relevant only if File Analytics data collection is enabled. For a list of file types that are relevant for your environment, see the File Types report.
Inactive Large Files
Large files consuming storage can be considered when making tiered storage migration decisions. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. This rule is relevant only if File Analytics data collection is enabled. For additional details, see the Largest Files report.
Storage Rules
Inactive LUNs
LUNs that have no I/O activity collected in the last 30 days, or the collected value during that time period is zero, are candidates for storage reclamation.
This rule explicitly examines 30 days of collected LUN performance data. This rule can filter the data by RAID type. The format for RAID type specification is specific to storage vendors. For a list of RAID types in your environment, run the LUN Utilization Summary report. This rule also allows you to set a Cost Source for displaying associated costs in the generated reports. Choose from Chargeback values or add a custom value. If you have set up Chargeback rules, those are more granular and can provide greater cost accuracy.
Overprovisioned Hosts
File system usage can help identify overprovisioned file systems and hosts. For additional information, run the Host Utilization Summary report and the Host Filesystem Reclamation Candidates cloud report. This rule also allows you to set a Cost Source for displaying associated costs in the generated reports. Choose from Chargeback values or add a custom value. If you have set up Chargeback rules, those are more granular and can provide greater cost accuracy.
Unallocated LUNs
Storage associated with LUNs that have not been allocated to hosts can be considered for storage optimization. This rule also allows you to set a Cost Source for displaying associated costs in the generated reports. Choose from Chargeback values or add a custom value. If you have set up Chargeback rules, those are more granular and can provide greater cost accuracy.
This rule can filter the data by RAID type. The format for RAID type specification is specific to storage vendors. For a list of RAID types in your environment, run the LUN Utilization Summary or the Unallocated LUNs report. In addition, the Reclamation Summary report can reveal potential reclamation categories.
Undiscovered LUNs
LUNs that have been assigned to a host, but have not been discovered and therefore are not seen on the host side, indicate a reclamation opportunity. The storage in these orphaned LUNs is not available for mounting file systems. This rule also allows you to set a Cost Source for displaying associated costs in the generated reports. Choose from Chargeback values or add a custom value. If you have set up Chargeback rules, those are more granular and can provide greater cost accuracy.
This rule can filter the data by RAID type. The format for RAID type specification is specific to storage vendors. For a list of RAID types in your environment, run the LUN Utilization Summary report. In addition, the Reclamation Summary report illustrates potential reclamation categories.
Unused LUNs
Unused LUNs could be considered for reclamation. These are LUNs that have been assigned to a host, but the host has not been placed into a volume group, or a partition has not been created. This rule also allows you to set a Cost Source for displaying associated costs in the generated reports. Choose from Chargeback values or add a custom value. If you have set up Chargeback rules, those are more granular and can provide greater cost accuracy.
This rule can filter the data by RAID type. The format for RAID type specification is specific to storage vendors. For a list of RAID types in your environment, run the LUN Utilization Summary report. In addition, the Reclamation Summary report illustrates potential reclamation categories.
Virtualization Rules
Non-VM Files
VM storage that is being consumed by files that are unknown VM file types can be considered for storage optimization. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the Datastore Usage Breakdown and the VM Files Summary reports.
VMs Aged Snapshots
VM snapshots have storage associated with them, but these snapshots have been forgotten for some time. Aged snapshots present a reclamation opportunity. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the VM Snapshot Summary.
VMs Low CPU
VMs where the average CPU utilization is low for last 24 hours and CPU usage is less than 5%, may provide a storage optimization opportunity.
Filter your actionable list by guest size and guest state, for example, including only running large guests. This rule allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the VM Summary report.
VMs Not in VM Inventory
VMs that are not in the VM inventory may be consuming storage. When a VM is removed from the inventory, it doesn't necessarily mean that the associated storage is returned to the storage pool. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the Datastore Usage Breakdown and the VM Files Summary reports.
VMs Powered Off
VMs that have been powered off may have storage associated with them. For additional details, see the VM Summary report. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports.
VMs Undiscovered Disks
VMs that have been provisioned storage, but that storage is not being used by the VMs, may indicate a storage optimization opportunity. This rule also allows you to set a custom value for Cost per GiB for the purpose of displaying costs in the generated reports. For additional details, see the Physical Disk Utilization report.
- Click in a parameter field to view the green help text at the bottom of the dialog and then use those details to configure parameters. Each rule includes parameters unique to the data that is being evaluated.