AnsweredAssumed Answered

Unable to update load balancing for collector

Question asked by osvaldog on Mar 23, 2017
Latest reply on Mar 28, 2017 by osvaldog

Hi everybody, I'm having an issue in my monitors enviroment, node tree doesn't show metrics and log's MOM show this:

 

3/23/17 10:06:40.096 AM GMT-03:00 [ERROR] [ClusterManager Async Executor] [Manager] Error registering with ARPAPP064@5001
3/23/17 10:06:40.096 AM GMT-03:00 [INFO] [ClusterManager Async Executor] [Manager.GeoLocation] Register GeoLocation Message Service for Collector-15
3/23/17 10:06:40.096 AM GMT-03:00 [INFO] [ClusterManager Async Executor] [Manager.GeoLocation] GeoLocationProvider registration failed for collector: ARPAPP064@5001com.wily.isengard.message.MessageUndeliverableException: Outgoing mailbox is closed. Message cannot be sent
3/23/17 10:06:40.217 AM GMT-03:00 [INFO] [MOM Collection Buffer consumer thread.] [Manager] Ingore collector went away: ARPAPP064@6001
3/23/17 10:06:40.218 AM GMT-03:00 [INFO] [MOM Collection Buffer consumer thread.] [Manager] Ingore collector went away: buaplnx009@5001
3/23/17 10:06:46.113 AM GMT-03:00 [WARN] [ClusterManager Async Executor] [Manager] Unable to update load balancing for collector "ARPAPP068@6001"
com.wily.isengard.message.MessageUndeliverableException
at com.wily.isengard.messageprimitives.service.MessageServiceClient.sendRequest(MessageServiceClient.java:173)
at com.wily.isengard.messageprimitives.service.MessageServiceClient.invoke(MessageServiceClient.java:356)
at com.sun.proxy.$Proxy218.removeCollector(Unknown Source)
at com.wily.introscope.server.beans.loadbalancer.ClusteredLoadBalancer.removeCollector(ClusteredLoadBalancer.java:733)
at com.wily.introscope.server.beans.loadbalancer.ClusteredLoadBalancerBean.collectorsRemoved(ClusteredLoadBalancerBean.java:436)
at com.wily.introscope.spec.server.beans.clusters.ClusterNotification.dataRemoved(ClusterNotification.java:28)
at com.wily.isengard.ongoingquery.AbstractQueryServiceManager$NotifyRemoved.run(AbstractQueryServiceManager.java:438)
at com.wily.isengard.ongoingquery.QueryServiceManager2$1.execute(QueryServiceManager2.java:46)
at com.wily.isengard.ongoingquery.QueryServiceManager2.runNotification(QueryServiceManager2.java:85)
at com.wily.isengard.ongoingquery.AbstractQueryServiceManager.stateRemoved(AbstractQueryServiceManager.java:231)
at com.wily.introscope.server.beans.AOngoingQueriableBean.stateRemoved(AOngoingQueriableBean.java:89)
at com.wily.introscope.server.beans.clusters.ClusterManager.collectorRemoved(ClusterManager.java:277)
at com.wily.introscope.server.beans.clusters.ClusterManager.access$1(ClusterManager.java:261)
at com.wily.introscope.server.beans.clusters.ClusterManager$CollectorRemovedCommand.run(ClusterManager.java:376)
at com.wily.EDU.oswego.cs.dl.util.concurrent.QueuedExecutor$RunLoop.run(QueuedExecutor.java:88)
at java.lang.Thread.run(Unknown Source)
3/23/17 10:06:46.129 AM GMT-03:00 [INFO] [MOM Collection Buffer consumer thread.] [Manager] Ingore collector went away: ARPAPP068@6001
3/23/17 10:06:55.166 AM GMT-03:00 [INFO] [MOM Collection Buffer consumer thread.] [Manager] Ingore collector went away: ARPAPP064@5001
3/23/17 10:06:55.166 AM GMT-03:00 [INFO] [MOM Collection Buffer consumer thread.] [Manager] Ingore collector went away: buaplnx010@5001
3/23/17 10:07:02.077 AM GMT-03:00 [INFO] [MOM Collection Buffer consumer thread.] [Manager] Ingore collector went away: ARPAPP068@5001
3/23/17 10:07:02.077 AM GMT-03:00 [INFO] [MOM Collection Buffer consumer thread.] [Manager] Ingore collector went away: ARPAPP064@6001
3/23/17 10:07:02.079 AM GMT-03:00 [WARN] [ClusterManager Async Executor] [Manager] Unable to update load balancing for collector "ARPAPP068@5001"
com.wily.isengard.message.MessageUndeliverableException
at com.wily.isengard.messageprimitives.service.MessageServiceClient.sendRequest(MessageServiceClient.java:173)
at com.wily.isengard.messageprimitives.service.MessageServiceClient.invoke(MessageServiceClient.java:356)
at com.sun.proxy.$Proxy218.removeCollector(Unknown Source)
at com.wily.introscope.server.beans.loadbalancer.ClusteredLoadBalancer.removeCollector(ClusteredLoadBalancer.java:733)
at com.wily.introscope.server.beans.loadbalancer.ClusteredLoadBalancerBean.collectorsRemoved(ClusteredLoadBalancerBean.java:436)
at com.wily.introscope.spec.server.beans.clusters.ClusterNotification.dataRemoved(ClusterNotification.java:28)
at com.wily.isengard.ongoingquery.AbstractQueryServiceManager$NotifyRemoved.run(AbstractQueryServiceManager.java:438)
at com.wily.isengard.ongoingquery.QueryServiceManager2$1.execute(QueryServiceManager2.java:46)
at com.wily.isengard.ongoingquery.QueryServiceManager2.runNotification(QueryServiceManager2.java:85)
at com.wily.isengard.ongoingquery.AbstractQueryServiceManager.stateRemoved(AbstractQueryServiceManager.java:231)
at com.wily.introscope.server.beans.AOngoingQueriableBean.stateRemoved(AOngoingQueriableBean.java:89)
at com.wily.introscope.server.beans.clusters.ClusterManager.collectorRemoved(ClusterManager.java:277)
at com.wily.introscope.server.beans.clusters.ClusterManager.access$1(ClusterManager.java:261)
at com.wily.introscope.server.beans.clusters.ClusterManager$CollectorRemovedCommand.run(ClusterManager.java:376)
at com.wily.EDU.oswego.cs.dl.util.concurrent.QueuedExecutor$RunLoop.run(QueuedExecutor.java:88)
at java.lang.Thread.run(Unknown Source)
3/23/17 10:07:02.079 AM GMT-03:00 [INFO] [ClusterManager Async Executor] [Manager] BaselineAlertMoMService: Detected collector disconnected: buaplnx009@5001
3/23/17 10:07:02.079 AM GMT-03:00 [ERROR] [ClusterManager Async Executor] [Manager] Uncaught Exception in Enterprise Manager: In thread ClusterManager Async Executor and the message is java.lang.NullPointerException
3/23/17 10:07:02.126 AM GMT-03:00 [INFO] [MOM Collection Buffer consumer thread.] [Manager] Ingore collector went away: ARPAPP064@5001
3/23/17 10:07:02.126 AM GMT-03:00 [INFO] [MOM Collection Buffer consumer thread.] [Manager] Ingore collector went away: buaplnx010@5001
3/23/17 10:07:04.283 AM GMT-03:00 [INFO] [MOM Collection Buffer consumer thread.] [Manager] Ingore collector went away: ARPAPP064@6001
3/23/17 10:07:10.179 AM GMT-03:00 [ERROR] [Alarm Pooled Worker] [Manager] Uncaught Exception in Enterprise Manager: In thread Alarm Pooled Worker and the message is java.lang.IllegalStateException: This is not a simple alert.
3/23/17 10:07:25.176 AM GMT-03:00 [ERROR] [Alarm Pooled Worker] [Manager] Uncaught Exception in Enterprise Manager: In thread Alarm Pooled Worker and the message is java.lang.IllegalStateException: This is not a simple alert.
3/23/17 10:07:27.285 AM GMT-03:00 [INFO] [ClusterManager Async Executor] [Manager] BaselineAlertMoMService: Detected collector disconnected: ARPAPP064@6001
3/23/17 10:07:27.286 AM GMT-03:00 [ERROR] [ClusterManager Async Executor] [Manager] Uncaught Exception in Enterprise Manager: In thread ClusterManager Async Executor and the message is java.lang.NullPointerException
3/23/17 10:07:55.229 AM GMT-03:00 [ERROR] [Alarm Pooled Worker] [Manager] Uncaught Exception in Enterprise Manager: In thread Alarm Pooled Worker and the message is java.lang.IllegalStateException: This is not a simple alert.

Outcomes