VERIFIED SOLUTION i
X

Resolve performance issues due to requests to the database including SELECT * in Spectrum

Issue

Opening the options dialog for a Write to DB stage is extremely slow and causing out of memory. This is also causing Spectrum to be unresponsive. Canceling the options dialog produces a similar delay. This only happens for tables that contain significant data.

Cause

User is writing data to an existing table in PostgreSQL. The table currently has 130+ columns and over 600,000 rows of data. When the user opens the Write to DB stage for this table, Spectrum generates this error message:
 
Exception in thread "ActiveMQ Transport Server: nio://0.0.0.0:61616" java.lang.OutOfMemoryError: GC overhead limit exceeded

The user traced the issue to the fact that the stage is running a "SELECT *" query to populate the preview. It seems this much data is overwhelming his Spectrum server.
 

Resolution

UPDATED: April 21, 2017


The issue was identified as a bug and fixed in Spectrum 8.0 SP2. The Write to DB stage now shows 50 records in the preview.

Environment Details

Product Feature: Enterprise Designer

Operating System: Linux

Version: Spectrum 8 SP1

Downloads

  • No Downloads