Views:

Summary

After applying DPX 4.5.2, agentless backups start to fail with consolidation errors; certain jobs randomly showing suspended status and certain java processes are taking large amounts of memory and not cleaning up correctly.

 

Symptoms

  • Agentless backups fail with errors that VM snapshots need to be consolidated. 
  • When an agentless backup runs, an rmiserver process is initiated on the proxy server used for the backup. The process should terminate upon completion of the backup (success or failure). In this case, the process was not terminating and instead was accumulating.  See screenshot below: you will see multiple instances of ssrmi.bat process and the java process that it initiates. 

 

  • As in the above screenshot, running task manager on the proxy node will show multiple entries of:
java -DDMAUTL_JNI_DBG=9 -DSYNCPROVIDER_JNI_DBG=0 -cp ..\lib\vfl.jar;..\lib\rmiserver.jar;
  • In the DPX/bin directory on the agentless proxy server and master server, multiple  hs_err_pid*.mdmp and hs_err_pid*.log files will be found. the former being quite large and consuming a lot of space.
  • There may be a general degradation of performance on the proxy server or master server if the master serves as a proxy.

 

Resolution

This behavior has been addressed in a DPX Maintenance Update. The update can be automatically installed via the DPX Software Update System user interface or can be manually downloaded from the Catalogic Software Online Support site. Check the Software Update Release Notes for your DPX release referencing Issue ID DPSUST-4367, available within the following product patches:

  • DPX 4.5.3  patch 260

A hotfix for customer running DPX 4.5.2 is available which can be downloaded fromhttps://mysupport.catalogicsoftware.com/product.php/DPX452/DPSUST-4316.zip in case an update to DPX 4.5.3 is currently not possible.

To apply the hotfix: 
- Download the hotfix the above location
- Extract the compressed file. 
- Stop the DPX Services on each Windows agentless proxy server and the Master server running DPX 4.5.2
- Rename the vixjni.dll in DPX/lib to vixjni.dll.org 
- Copy in the new vixjni.dll to DPX/lib 
- Restart the DPX Services and run some agentless backup jobs, you should see that the rmui processes ( java process) stabilize and shutdown when not used.

If the issue continues to occur after applying the hotfix please contact  Catalogic Software Data Protection Technical Support for obtaining the required update referencing Issue ID DPSUST-4316.