VERIFIED SOLUTION i
X

Resolving hung Spectrum processes on Linux/Unix due to an upgrade and rollback

Issue

This article is for a specific situation where an upgrade has been performed to Spectrum™ v12.1 which has failed and a rollback done to v12.0. Rolling back has been done by NOT restoring from the backup but by running the uninstall scripts for the platform and modules, running the installer with the intention of starting with a clean repository.

Upon starting up the wrapper shows "Invocation of init method failed; nested exception is java.lang.RuntimeException: Timeout waiting for external Repository instance to start".
The next step would be to look at the Neo4j output log for an underlying cause which shows "ERROR Failed to start Neo4j: Starting Neo4j failed: Component 'org.neo4j.server.database.LifecycleManagingDatabase@7b0c2746' was successfully initialized, but failed to start. Please see the attached cause exception "Address already in use"
Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to: 0.0.0.0/0.0.0.0:6362".


 

Cause

There are a few  possibilities here:-
1. Another application is using port 6362
2. After an upgrade Spectrum crashes, upon rolling back to the previous version Spectrum's java is still holding on to the port preventing the current version of Spectrum from starting up.
3. On UNIX and Linux systems, acushare used bu UAM and ETM runs as a background server process. Acushare is running even after Spectrum has crashed.

 

Resolution

UPDATED: March 29, 2018


1.This can be verified by listing all the processes currently running on the system such as ps aux | less, running the netstat -antp | grep 6362 and ps -Aef | grep java commands which list the port and the process linked to that port.
The first command shows the PID listening on that port and if the it's a java process or not.
The second shows if the PID's belong to Spectrum's java processes i.e it will point to the location of Spectrum's java.
2. Kill all the processes belonging to Spectrum including acushare with  kill -9 PID.
3. Run the installer script.


 

Environment Details

Product Feature: Installation / Upgrade

Operating System: Red hat Linux

 

Downloads

  • No Downloads