VERIFIED SOLUTION i
X

Resolve issue with increasingly large Platform-job snapshot.pcl file in Spectrum

Issue

Platform-job snapshot.pcl file is gradually increasing and reached to a size of 55 GB. This resulted in rapid growth in Spectrum repository.

Cause

Platform-job snapshot.pcl file contains the execution history of all the jobs and its various stages. Whenever large numbers of files are processed through batch processing or Job Executor, huge execution history is created as the Job runs multiple times to execute each file. Increased frequencies of job/process execution from long time results in large execution history.

Resolution

UPDATED: August 29, 2017


The steps to be followed to reduce Spectrum repository size are -

1. Delete job execution history from Enterprise Designer (Optional)
2. Execute purge, restart Spectrum and perform cleanHistory, refer Purge and Archive Spectrum Transaction History
3. Stop Spectrum, clear g1Assemblies folder from C:\Users\user_name\AppData\Local\Temp (%temp%) and start Spectrum.

Consider merging smaller input files as a single input file. This method is proven to improve overall execution time and better management of execution history.
For example, instead of processing 30,000 input XML files each corresponding to individual customer record, processing a single input XML file with 30,000 customer records is a good approach.

 

Environment Details

Product Feature: Spectrum Server

Operating System: Windows Server 2012 R2


 

Downloads

  • No Downloads