JBoss ON storage node reported as running if its PID file exists even though no process ID is defined

Solution Unverified - Updated

Environment

  • Red Hat JBoss Operations Network (ON) 3.2, 3.3
  • JBoss ON storage node process id (PID) file exists and is empty -- <RHQ_SERVER_HOME>/rhq-storage/bin/cassandra.pid

Issue

  • Storage node is incorrectly reported as running:

      RHQ Storage Node               (pid        ) IS running
    
  • Storage node is reported as started:

      RHQ storage node (pid ) is running
    
  • Process ID is blank or empty

  • PID is not printed

Resolution

Remove the storage node's empty PID file:

rm "${RHQ_SERVER_HOME}/rhq-storage/bin/cassandra.pid"

Root Cause

The PID file for the storage node was created but no PID was written to it. This can occur in events where the process fails to start or due to insufficient disk space. If the file exists, the rhqctl process will assume the process is running regardless if the file contains a valid PID or is empty.

This content is not included.Red Hat Bugzilla 1155822 has been captured to identify this issue and will be addressed in a future release.

Diagnostic Steps

  • Does rhqctl status --storage report the storage node is running but prints a blank PID?

      23:07:26,163 INFO  [org.jboss.modules] JBoss Modules version 1.2.2.Final-redhat-1
      RHQ Storage Node               (pid        ) IS running
    

    If so, this issue most likely applies.

  • Does the file <RHQ_SERVER_HOME>/rhq-storage/bin/cassandra.pid exist? If it exists, is it empty? If so, this issue applies.

SBR
Category

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.