NetBackup 3.1.2,3.2 & 3.2 Maintenance Release 1 Appliance Upgrade Pre-Upgrade Tests incorrectly detects Active Jobs if JobID's are over 999,999 and aborts
Problem
If the current JobID's being used by NetBackup are 1 million or higher then the Pre-Upgrade Self-Test will incorrectly flag that there are Active jobs even when none are running.
Error Message
The patch output will display the following:
[Warning] The upgrade process has detected active jobs and is now paused. You must press 'q' to exit from this window and cancel the upgrade attempt. After you have stopped all active jobs and canceled all scheduled jobs, try the upgrade again.
The Appliance Unified Logs (Product ID 409, OID's 8 and 20) will show:
19/11/19 22:29:51.270 [Application] NBAPP 409 NBAPP_RUNCMD 20 PID:144338 TID:140426171426624 File ID:20 [No context] [Info] [142386] cmd:" LC_ALL=C LC_TIME=C /usr/openv/netbackup/bin/admincmd/bpdbjobs -report -t 11/18/2019 17:29:51 2>/dev/null | grep -E "^([[:digit:]]|[[:space:]])[[:space:]]" | grep -vE "Image[[:space:]]Delete" | grep -E "Active[[:space:]]" | wc -l"( 0 )
stdout: 1
endcmd:
19/11/19 22:29:51.285 [Application] NBAPP 409 NBAPP_PATCH 8 PID:144340 TID:139693499316032 File ID:8 [No context] [Info] [142386] Found 1 active jobs on appliance
19/11/19 22:29:51.299 [Application] NBAPP 409 NBAPP_PATCH 8 PID:144342 TID:139764663854912 File ID:8 [No context] [Info] [142386] Avtive jobs detected !
Cause
The output from the bpdbjobs command will pad the beginning of the header line with two spaces when the JobID's are 7-digits to right align the columns. This has the result of the line being picked up and counted as a running Job due to the work Active being in that line.
Solution
The workaround is to update the /usr/openv/netbackup/bp.conf file (after taking a backup) on the Appliance which is being upgraded and add the following lines which modifies the output from the bpdbjobs command to avoid this issue. Note that there is no need to cycle any services after adding the entries:
BPDBJOBS_COLDEFS = JOBID 5 false
BPDBJOBS_COLDEFS = TYPE
BPDBJOBS_COLDEFS = STATE
BPDBJOBS_COLDEFS = STATUS 6
BPDBJOBS_COLDEFS = POLICY
BPDBJOBS_COLDEFS = SCHEDULE 8
BPDBJOBS_COLDEFS = CLIENT
BPDBJOBS_COLDEFS = DSTMEDIA_SERVER 14
BPDBJOBS_COLDEFS = ACTPID 10
BPDBJOBS_COLDEFS = FATPipe 7
Once the upgrade has completed, these lines can be removed. These have no impact on the running of NetBackup and only modifies the output from the bpdbjobs command.
This issue is currently being considered by Veritas Technologies LLC to be addressed in the next major revision of the product. There are no plans to address this issue by way of a patch or hotfix in the current or previous versions of the software at the present time. Please note that Veritas Technologies LLC reserves the right to remove any fix from the targeted release if it does not pass quality assurance tests or introduces new risks to overall code stability. Veritas’ plans are subject to change and any action taken by you based on the above information or your reliance upon the above information is made at your own risk.