Veritas Bug ID: ET 4047040

Version:  NetBackup 9.1.0.1

Installation Location:  Server (Master or Media) and Client

If client side deduplication is used, this EEB should be installed on the client and MSDP server. All servers that are MSDP storage pools or can write to a MSDP storage pool should also have this EEB installed.

Problem Description: This Hotfix contains multiple Emergency Engineering Binaries which fix problems with MSDP Servers.

Fixes Included in earlier versions:

ET 4053266: soft link returned error    
ET 4052988: handle SQL VLD cannot find boundary issue    
ET 4051777: IA-Ora-Copilot]files on snapshot corrupt with incorrect lmdb size    
ET 4051777: [IA-Ora-Copilot]files on snapshot corrupt with incorrect lmdb size    
ET 4051431: fix vpfs mon detects incorrect status    
ET 4051681: Remove the command option 'keydictutil --refresh    
ET 4048714: [PICASSO_V3][Immutability][RShell] Run 'dcscan -a' hang.        
ET 4050311: Cachedb integrity check return error in case the db is busy    
ET 4049897: Universal Share Backup Error 40 - suspecting MSDP issue    
ET 4050140: [FLEX appliance] vpfsd hang in user space after several rounds of dump/backup test        
ET 4050954: universal share crash after upgrade to 8.3.0.2    
ET 4046228: [MSDP][Ushare]The Ushare backup failed while dumping data to Ushare, and there are lots of ERRORs in vpfsd log.
ET 4048644: Enable compaction check dispite refdb state    
ET 4044194: Work around for the kms hang issue.

ET 4062585: [AKS MSDPX]Log ERR 'CRTaskRefOpProcess: failed to protect DO xxx for dsid 3'
ET 4061671: Check the catalog retention lock for cloud WORM image.
ET 4054341: Disable VLD when Oracle Stream Handler is enabled.
ET 4059625: fix the corner case in __process_refop_batch() for we should exit the entire loop when we hit the batch delimiter
ET 4045989: Enhance crstats history to support cloud lsu stats
ET 4058092: handle create file group exception
ET 4056494: Tlog processing hangs after every 2 days on newly deployed 5250 Appliance running on 4.1 release.
ET 4057843: not a valid utf8 char error for the delete reference
ET 4055933: Convert ushare metadata from 8.2 to 8.3
ET 4055303: fix set utimes failue and caused the create file failure
ET 4056402: fix US IA delete issue with multiple instance enabled
ET 4056373: fix a potential and very rare data loss issue for NBFS, aka 
ET SpoolerProtectAllDCs does not always protect all DCs as expected on multi-node setup
ET 4050705: [Flex Universal Share] Error in mounting few vpfs shares using loop devices.
ET 4062823: If dc is owned by vpfsd, spoold shouldn't convert it
Remove feature toggle FTO_ENCRYPTION_CRAWLER.

ET 4064340: NFS Time out Errors For unviersal Shares on the client
ET 4058267: Porting catalog upload improvement to mainline
ET 4060495: Fix podb.journal multiple versions issue in worm
ET 4064005: Fix the bug in DR for cloud immutable storage when object has delete marker.
ET 4065924: Import not running causing high number of pending EVENTS and hence repliction is not working for over month period now.[TBA]: Import not running causing high number of pending EVENTS and hence repliction is not working for over month period now.
ET 4066564: Fix the wrong progress info of replication job
ET 4065291: extract lsu from login param before mapping

ET 4066657: Check the storage WORM type when expire image
ET 4064614: VM become unavailable intermittently after instant access restore successfully
ET 4067149: Don't return and just log an error if shadow file is corrupt
ET 4067425: disable dcoffset for non-generic mode
ET 4040344: Split the online checking result into small part and send it to spad
ET 4042622: Fixed the buffer size overrun caused by large amount of input data
ET 4056713: Modify vpfs configuration script to use a CA address registered in contentrouter.cfg instead of hostname.
ET 4067336: when a SO can't not be found and container size is bigger than the value in memory that means spoold append new SO into the data container vpfsd need reload bhd file to read new added SO
ET 4051604: Avoid calling chown on data filesystems whenever the MSDP WORM container is launched
ET 4067818: Spad memory usage exceeds 100 GB
ET 4068220: switch to writer lock to handle reloading bhd
ET 4067678: Add image deletion log in history/imagedeletion from spad side Add configurable parameters to add PO/image deletion log on pdplugin side.
ET 4067678: Add image deletion log in MSDP history directory 
Check and lookup recent successful full backup from PO database if the __dofpcache__ contains no successful full images
ET 4060776: fix empty image name in jobstats
ET 4065036: rebase for replication to cloud lsu.
ET 4056256: Disk volume with the specified name already exists
ET 4068537: High memory utilization more than 90% on the Windows MSD after upgrade to 9.1 and performance degraded

ET 4056713: Modify vpfs configuration script to use a CA address registered in contentrouter.cfg instead of hostname
ET 4073781: Lookup the local catalog first then search the cloud catalog for cloud WORM volume
ET 4073806: Fix the cloud WORM volume PO retention bug

ET 4079058: PVM-1104 SPWS does not check vpshere certificate
ET 4075400: Get image retention should get retention from cloud at first for cloud WORM storage
ET 4071213: Unable to collect MSDP-Config from WORM container v16.0
ET 4063757: MSDP Cloud - Seedutil - Poor performance, low dedupe rate for new clients Select
ET 4076512: Remove the shorter retention until date from the spad cache
ET 4078880: [WORM]Failed to apply WORM lock for backup/duplicate images.[WORM]Failed to apply WORM lock for backup/duplicate images
ET 4078436: fix 'Spad threads waiting in Flex because of slow check in IsLocalBrowseEnable()'
ET 4076511: fix potentail missing files for ushare backup    
ET 4080396: [MSDPC WORM] expect get_image_worm_prop to fail with STS_ENOENT when it was deleted
ET 4081678: NBA 5.0 vpfsd core dumping by ushare backup
ET 4081598: don't do backfill dcoffset when snapshot is running
ET 4082935: 5.0 potential vpfsd core dumping
ET 4083403: checkpoint exception handling for vpfsd
ET 4041652: Fix prefetch lock leak
fix logical for full backup detect
ET 4078904: Unable to duplicate some images back to MSDP from DD
ET 4083906: don't continue to do back fill if the data container is missing
ET 4086815: Potential file corruption when enlarge a small file to a big file in universal share
ET 4088425: Use more work threads in recovery mode
ET 4082779: don't lock the whole vpfsd operations when umount backup snapshot
ET 4089240: Compaction check hang in case of data error
ET 4080388: handle xfs dirty log and enhancement for executing command error message
ET 4086602: Unable to configure 2nd replication target to same storage server in a multi-domain config
ET 4086352: Add headers attributes to ensure HSTS response
ET 4092807: fix DO writing issue
ET 4092028: read loop dev flag from env file
ET 4093558: change NFS world-readable vulnerability for UShare in Flex

ET 4098213: Universal share conf file wiped if a hostname is added to allowed list but cant be resolved
ET 4097535: See lock contention between the Backfill thread and the fuse_do_work thread
ET 4098505: Dir track list is too big caused the performance issue and backup failure
ET 4096253: Ushare created before apply EEB backup failed at second time retry meet error network connection broken

ET 4100110: enhancement for mssql vld segmentation
ET 4097542: Instant access VM cannot power on after worm container relocate to another node
ET 4078154: ushare rename issue while in snapshot state
ET 4110248: Use big compaction check batch size to improve performance
ET 4099245: Add runtime permission check and refuse to work in case of incorrect permissions
ET 4089931: fix overlapped extent issue caused by XFS mapping
ET 4109502: file rename operation is not handled correctly for rsync
Porting fix of ET4107549, make startpoint always be first connection
Porting fix of ET4106732, in vpfsd some place doesn't flush bin file after writing SO
ET 4103846: Add the config to enable/disable cloud download cache file verfiy
ET 4108120: write error is not correctly handled for the bloom filter
ET 4106538: empty POs were not deleted for vpfsd and it caused file leak
ET 4056246: fix getlastimage multiple calls for multiple fragments
ET 4112849: vpfsd reported EEROR message: Failed to open env for db
ET 4112641: vpfs writes file reported IO error
ET 4111955: Forced compaction doesn't work if there are a lot of data in MSDP
ET 4111708: malware scan 50 millions files hang due to cata2map hang with race condition of background space monitor thread

ET 4107282: Upload the podb.journal instead of po.db when set image retention.
ET 4114274: fail to mount vpfs may reset the file change list
ET 4114934: enable direct IO with bdev for rhel8+ and all container based platforms
ET 4112745: Load the config for cloud WORM storage before check the status.
ET 4116660: Port of fixes there in
ET 4118349: backup and background task deadlock
ET 4118684: Add proper error handling if copying file group has issue

ET 4120242: cleanup ushare backup snapshot copies may cause memory leak
ET 4118121: add try catch for file system release
ET 4104646: MSDP - WORM - Orphan Image Cleanup - Compliance Mode
ET 4110234: Orphan image could not be cleaned up with bpstsinfo cmd
ET 4099214: MSDP WORM images not identifiable as IMMUTEABLE after close, prior to setting INDELIBLE
ET 4130738: file path may be missing while rename a file in UShare
ET 4130976: Close the DC iterator when all entries are accessed
ET 4131754: If users touch compaction.all in mount point and trigger force full compaction, add a log message to indicate the full compaction has been started.
ET 4118234: Close dc data file to clean up the open files and free memory.

ET 4113606: Use meta ctx block size instead of blockSize
ET 4113395: Ignore the verification on ctx->buf
ET 4139748: chdir() should not be called from DeleteTree()
ET 4153102: fix boost interprocess issue. use programdata folder

Version 31 Adds:

ET 4065643: replay vpfs data journal memory corrupted
ET 4181754: Fix the issue of incorrect marking PO as corrupt when DO is too big to load
ET 4175374: fix chown for folder: if user or group is not provided, just keep original value.
ET 4161572: MSDP - UShares - SQL - mount slow