NBServerMigrator: Migration fails in crosscheck_catalog module with missingdbfiles.txt or missingfiles.txt

Problem

Migration fails in crosscheck_catalog module

Error Message

------------------------------------
[START] crosscheck_catalog
------------------------------------
[INFO] Checking that all files from source are on the target
[INFO] Changing directory /usr/openv/netbackup/tempdb/source
[WARN] db/mds.db is not on the target
[WARN] db/rb.db is not on the target
[WARN] db/jobs/pempersist2 is not on the target
[WARN]
##################################
# A C T I O N    R E Q U I R E D #
##################################
[WARN] There are files missing in the target folder /usr/openv/netbackup/tempdb/source.
The file <nbsm_dir_path>/missingdbfiles.txt lists missing files in target
[WARN] missingfile db exists.. Exiting

Cause

The warnings may indicate missing files or files being in a corrupt or unexpected state.

Solution

1. Open and inspect the file: missingdbfiles.txt. If the contents are:

•      db/mds.db
•      db/mds.db-journal
•      db/rb.db
•      db/rb.db-journal
•      db/jobs/pempersist2

These files will get created on the Target Primary server once the NetBackup operations are started, so these missing files can be ignored.

Perform the following:
    a. Delete the file: missingdbfiles.txt
    b. Create a touchfile named SKIP_crosscheck_catalog in the path for the corresponding version of utility being used:

• For NBServerMigrator 2.5:  <nbsm_folder_path>/temp/
• For NBServerMigrator 2.6: <nbsm_folder_path>/nbsmstaging/

    c. Resume the migration/data_transfer by running the appropriate command:

• For migration: nbsm_target -overwrite -keep_src_cert -resume
• For data_transfer: nbsm_target -data_transfer -resume

2. If the content of the missingdbfiles.txt is anything apart from the files mentioned in point 1, then the NBServerMigrator logs should be inspected.

The following steps should be taken:
    a. Manually copy the missing db files from the Source Primary server to the appropriate path in the Target Primary server.
    b. Delete the file: missingdbfiles.txt.
    c. Re-initiate the data_transfer from the Target Primary server.

Note: 
A similar issue occurs when missingfiles.txt is created during the crosscheck_catalog module:
1. Check the contents of the file and see if the files mentioned are 0KB in size on the source primary server, or if they are not accessible on the source primary server.
If yes to either condition, perform the following:
    a. Delete the file missingfiles.txt
    b. Create a touch file named SKIP_crosscheck_catalog in the path:

• For NBServerMigrator 2.5:  <nbsm_folder_path>/temp/
• For NBServerMigrator 2.6: <nbsm_folder_path>/nbsmstaging/

    c. Resume the migration or data_transfer.

2. If the files mentioned inside missingfiles.txt are of size greater than 0KB on the source primary server and the files are accessible, then perform the following:
    a. Manually copy the missing files from the Source Primary server to the appropriate path in the Target Primary server.
    b. Delete the file: missingfiles.txt.
    c. Re-initiate the data_transfer from the Target Primary server.