NDMP backups fail with Status 99 and Error "connect error = -1004 (Timeout waiting for connected message from NDMP server)"

Problem

NDMP backups fail with  Status 99 and Error "connect error = -1004 (Timeout waiting for connected message from NDMP server)"

Error Message

Job details shows following error 

11/20/2014 6:10:45 PM - Info bptm(pid=1116) start backup
11/20/2014 6:10:45 PM - Error ndmpagent(pid=4708) ndmp_wait_for_any_msg: ndmp_process_messages failed
11/20/2014 6:10:45 PM - Error ndmpagent(pid=4708) failed to connect to NDMP server <server>, connect error = -1004 (Timeout waiting for connected message from NDMP server)
11/20/2014 6:10:45 PM - Error ndmpagent(pid=4708) NDMP backup failed, path = /root_vdm_2/Apps
11/20/2014 6:10:45 PM - begin writing
11/20/2014 6:10:52 PM - Info bptm(pid=1116) EXITING with status 99 <----------
11/20/2014 6:10:52 PM - end writing; write time: 00:00:07
11/20/2014 6:10:57 PM - Info ndmpagent(pid=0) done. status: 99: NDMP backup failure
NDMP backup failure(99)

Cause

This issue appears to be caused by a name resolution issue, or potentially by stale host cache entries on the related Servers.

Solution

1. Confirm forward and reverse lookup to the filer via the following commands:
   • tpautoconf -verify filer_ip_address
   • tpautoconf -verify filer_name
2. Add hosts file shortname and fqdn entries on both Server and Filer side, if required.
3. Confirm forward and reverse lookup (shortname & fqdn) works from both Server and Filer side.
4. Clear the NetBackup host cache on the Primary and Media Servers via the following command:
   • bpclncmd -clear_host_cache
5. Then, retry backup.