Resolve performance issues due to requests to the database including SELECT * in Spectrum

Product Feature: Enterprise Designer

Operating System: Linux

Version: Spectrum 8 SP1


Opening the options dialog for a Write to DB stage is extremely slow and causing out of memory. This is also causing Spectrum to be unresponsive. Canceling the options dialog produces a similar delay. This only happens for tables that contain significant data.


User is writing data to an existing table in PostgreSQL. The table currently has 130+ columns and over 600,000 rows of data. When the user opens the Write to DB stage for this table, Spectrum generates this error message:
Exception in thread "ActiveMQ Transport Server: nio://" java.lang.OutOfMemoryError: GC overhead limit exceeded

The user traced the issue to the fact that the stage is running a "SELECT *" query to populate the preview. It seems this much data is overwhelming his Spectrum server.


UPDATED: April 21, 2017
The issue was identified as a bug and fixed in Spectrum 8.0 SP2. The Write to DB stage now shows 50 records in the preview.