Views:

Summary



Network WAN optimization appliance (Riverbed, F5) may cause very low throughput or termination of backup jobs.

Symptoms



Job log displays the following errors:

  1. failed with exception: NDMPSessionException(0, transferBackup exception: cm_recv_rec failed, localPort (59930), peer (10.240.70.24:50236), rc (12004), description (cm_recv_rec reported 0-len read: peer module closed connection.), peerstring (ssndmpc 2.2/4.4 winx64 17:25:48 Mar 31 2016))
  2. SNBNCJ_103E Task 7 NDMP_LOG: id(1), type(NDMP_LOG_ERROR), text(could not read from socket)
  3. Task 7 NDMP_LOG: id(0), type(), text(NDMP_SVS_NOTIFY_CREATE_RELATIONSHIP operation failed. Error(542113795, NDMP_SV_RPL_NETWORK); Rseq(10))

You can also see very slow throughput during data transfer:

  1. 7/6/2016 8:40:33 am SNBSVH_234J Task 7 has transfered 44.3 GB
  2. 7/6/2016 3:53:00 pm SNBSVH_234J Task 7 has transfered 46 GB


Resolution



If backups are going through a WAN connection, and network WAN optimization appliance is used, turn off network optimization for the DPX backups as network optimization is known to cause backups to fail with the errors above and throttle data transfer to KB/ps

For block level backups to 7-mode filers or OSS, turn off network optimization on ports, 10000, 10566, 6123, and 3260

For Block level backups to CDOT using NOSB, method turn off optimization for NFS