SOI Tech Tips: CA EI Event Management Service Stop

Document created by kluong Employee on Jul 17, 2014
Version 1Show Document
  • View in full screen mode

If you install EI Management from EI product and notice that the CA EI Event Management service stopping.

C

 

heck \CA\Event Integration\Logs\CA_EventManagement_wrapper.log

See if it is stopping due to a connection to the SOI Manager ActiveMQ connection.

You will see the following series of messages

 

INFO   | jvm 1    | 2014/07/15 09:37:58 | Jul 15, 2014 9:37:58 AM org.apache.activemq.transport.failover.FailoverTransport handleTransportFailure

INFO   | jvm 1    | 2014/07/15 09:37:58 | WARNING: Transport failed to tcp://x.x.x.x:61616 , attempting to automatically reconnect due to: java.io.EOFException

INFO   | jvm 1    | 2014/07/15 09:37:58 | Jul 15, 2014 9:37:58 AM org.apache.activemq.transport.failover.FailoverTransport handleTransportFailure

INFO   | jvm 1    | 2014/07/15 09:37:58 | WARNING: Transport failed to tcp://x.x.x.x:61616 , attempting to automatically reconnect due to: java.io.EOFException

INFO   | jvm 1    | 2014/07/15 09:48:30 | Jul 15, 2014 9:48:29 AM org.apache.activemq.transport.failover.FailoverTransport doReconnect

INFO   | jvm 1    | 2014/07/15 09:48:30 | SEVERE: Failed to connect to transport after: 31 attempt(s)

INFO   | jvm 1    | 2014/07/15 09:48:30 | Jul 15, 2014 9:48:29 AM org.apache.activemq.transport.failover.FailoverTransport doReconnect

INFO   | jvm 1    | 2014/07/15 09:48:30 | SEVERE: Failed to connect to transport after: 31 attempt(s)

INFO   | jvm 1    | 2014/07/15 09:48:30 | log4j:ERROR Could not publish message in JMSAppender [null].

INFO   | jvm 1    | 2014/07/15 09:48:30 | javax.jms.IllegalStateException: The Session is closed

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQSession.checkClosed(ActiveMQSession.java:717)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQSession.configureMessage(ActiveMQSession.java:705)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQSession.createObjectMessage(ActiveMQSession.java:361)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQTopicSession.createObjectMessage(ActiveMQTopicSession.java:183)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at com.ca.sam.ifw.api.logger.IFWAppender.append(IFWAppender.java:469)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.log4j.Category.callAppenders(Category.java:206)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.log4j.Category.forcedLog(Category.java:391)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.log4j.Category.error(Category.java:322)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at com.ca.eventmanager.framework.comm.ifw.IFWCommunicationImpl.onException(IFWCommunicationImpl.java:242)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQConnection$4.run(ActiveMQConnection.java:1809)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.lang.Thread.run(Thread.java:619)

INFO   | jvm 1    | 2014/07/15 09:48:30 | Connection refused: connect

INFO   | jvm 1    | 2014/07/15 09:48:30 | Jul 15, 2014 9:48:30 AM org.apache.activemq.ActiveMQMessageConsumer$4 run

INFO   | jvm 1    | 2014/07/15 09:48:30 | SEVERE: ID:luoki01-U122601-56040-1405431332803-0:0:1:1 failed to delivered acknowledgements

INFO   | jvm 1    | 2014/07/15 09:48:30 | javax.jms.JMSException: Connection refused: connect

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:62)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQConnection.doAsyncSendPacket(ActiveMQConnection.java:1245)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1237)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQSession.asyncSendPacket(ActiveMQSession.java:1857)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQSession.sendAck(ActiveMQSession.java:2022)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQMessageConsumer$4.run(ActiveMQMessageConsumer.java:703)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.util.concurrent.FutureTask.run(FutureTask.java:138)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.lang.Thread.run(Thread.java:619)

INFO   | jvm 1    | 2014/07/15 09:48:30 | Caused by: java.net.ConnectException: Connection refused: connect

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.PlainSocketImpl.socketConnect(Native Method)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.Socket.connect(Socket.java:519)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.tcp.TcpTransport.connect(TcpTransport.java:436)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.tcp.TcpTransport.doStart(TcpTransport.java:402)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.util.ServiceSupport.start(ServiceSupport.java:53)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:57)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:57)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.WireFormatNegotiator.start(WireFormatNegotiator.java:72)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.failover.FailoverTransport.doReconnect(FailoverTransport.java:726)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.failover.FailoverTransport$2.iterate(FailoverTransport.java:116)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  ... 3 more

INFO   | jvm 1    | 2014/07/15 09:48:30 | com.ca.sam.ifw.api.exceptions.MsgBusJMSException:

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at com.ca.sam.ifw.api.exceptions.ExceptionUtil.exceptionConv(ExceptionUtil.java:51)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at com.ca.sam.ifw.api.exceptions.ExceptionUtil.exceptionConv(ExceptionUtil.java:25)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at com.ca.sam.ifw.api.jms.JMSObject.ifwMsgBusCloseConnection(JMSObject.java:1648)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at com.ca.eventmanager.framework.comm.ifw.IFWCommunicationImpl.cleanup(IFWCommunicationImpl.java:373)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at com.ca.eventmanager.framework.comm.CommunicationManager.shutdown(CommunicationManager.java:97)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at com.ca.eventmanager.framework.comm.ifw.IFWCommunicationImpl.onException(IFWCommunicationImpl.java:244)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQConnection$4.run(ActiveMQConnection.java:1809)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.lang.Thread.run(Thread.java:619)

INFO   | jvm 1    | 2014/07/15 09:48:30 | Caused by: javax.jms.JMSException: Connection refused: connect

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:62)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQConnection.doSyncSendPacket(ActiveMQConnection.java:1318)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.ActiveMQConnection.close(ActiveMQConnection.java:638)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at com.ca.sam.ifw.api.jms.JMSObject.ifwMsgBusCloseConnection(JMSObject.java:1631)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  ... 7 more

INFO   | jvm 1    | 2014/07/15 09:48:30 | Caused by: java.net.ConnectException: Connection refused: connect

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.PlainSocketImpl.socketConnect(Native Method)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at java.net.Socket.connect(Socket.java:519)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.tcp.TcpTransport.connect(TcpTransport.java:436)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.tcp.TcpTransport.doStart(TcpTransport.java:402)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.util.ServiceSupport.start(ServiceSupport.java:53)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:57)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:57)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.WireFormatNegotiator.start(WireFormatNegotiator.java:72)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.failover.FailoverTransport.doReconnect(FailoverTransport.java:726)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.transport.failover.FailoverTransport$2.iterate(FailoverTransport.java:116)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  at org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)

INFO   | jvm 1    | 2014/07/15 09:48:30 |  ... 3 more

STATUS | wrapper  | 2014/07/15 09:48:32 | <-- Wrapper Stopped

 

By default the CA EI Event Management will try to reconnect to ActiveMQ every 20 seconds for 30 times and after that it will stop.

 

To increase the retry and timeout, edit \CA\Event Integration\Event\conf\eventManagerServerConfig.xml

Change the following lines

  <property name="reconnectAttempts" value="30"/>

  <property name="reconnectTime" value="20"/>

 

to

 

  <property name="reconnectAttempts" value="1500"/>

  <property name="reconnectTime" value="60"/>

 

Save the file and start the CA EI Event Management service.

Attachments

    Outcomes