AnsweredAssumed Answered

9.1.1.0 Collector Error when EPAgent tries to connect

Question asked by davevdm on Sep 19, 2012
Latest reply on Sep 25, 2012 by davevdm
I get the following errors on the collector when the EPAgent tries to connect.

9.0.6.5 Agent ---> this agent works when connecting to a 9.0.6.5 EM
==> /ca/wily/col/introscope9.1.1.0/logs/startupOut.log <==
9/19/12 09:56:34.529 AM SAST [ERROR] [PO:main Mailman 4] [Manager.MessageService] Exception: java.lang.NullPointerException calling method: com.wily.isengard.messageprimitives.service.MessageServiceCallMessage: {com.wily.introscope.spec.server.beans.loadbalancing.ILoadBalancer.getCollectorToReconnectTo, v1, [v058dsmffd004, EPAgentProcess, EPAgent, 21, default]}

Error message on Agent
9/19/12 09:22:42 AM SAST [INFO] [EPAgent] Introscope EPAgent Release 9.1.1.0 (Build 581673)
9/19/12 09:22:42 AM SAST [INFO] [EPAgent] Using Java VM version "OpenJDK 64-Bit Server VM 1.6.0" from Sun Microsystems Inc.
9/19/12 09:22:42 AM SAST [INFO] [EPAgent] Using Introscope installation at: /ca/wily/col/introscope9.1.1.0/.
9/19/12 09:22:42 AM SAST [INFO] [EPAgent] CA Wily Introscope(R) Version 9.1
9/19/12 09:22:42 AM SAST [INFO] [EPAgent] Copyright (c) 2012 CA. All Rights Reserved.
9/19/12 09:22:42 AM SAST [INFO] [EPAgent] Introscope(R) is a registered trademark of CA.
9/19/12 09:22:42 AM SAST [INFO] [EPAgent] Starting Introscope EPAgent...
9/19/12 09:22:42 AM SAST [INFO] [EPAgent] Reading configuration file: IntroscopeEPAgent.properties
log4j:WARN No appenders could be found for logger (EPAgent).
log4j:WARN Please initialize the log4j system properly.

==> /ca/wily/col/introscope9.1.1.0/logs/IntroscopeEnterpriseManager.log <==
9/19/12 09:22:42.969 AM SAST [ERROR] [PO:main Mailman 7] [Manager.MessageService] Exception: java.lang.NullPointerException calling method: com.wily.isengard.messageprimitives.service.MessageServiceCallMessage: {com.wily.introscope.spec.server.beans.loadbalancing.ILoadBalancer.getCollectorReconnectList, v1, [v058dsmffd003, 10.9.130.207, EPAgentProcess, EPAgent, 21, default, false]}

==> /ca/wily/col/introscope9.1.1.0/logs/startupOut.log <==
9/19/12 09:22:42.969 AM SAST [ERROR] [PO:main Mailman 7] [Manager.MessageService] Exception: java.lang.NullPointerException calling method: com.wily.isengard.messageprimitives.service.MessageServiceCallMessage: {com.wily.introscope.spec.server.beans.loadbalancing.ILoadBalancer.getCollectorReconnectList, v1, [v058dsmffd003, 10.9.130.207, EPAgentProcess, EPAgent, 21, default, false]}

==> /ca/wily/col/introscope9.1.1.0/logs/epa.log <==
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Release 9.1.1.0 (Build 581673)
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Using Java VM version "OpenJDK 64-Bit Server VM 1.6.0" from Sun Microsystems Inc.
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Trying to load agent profile based on system property "com.wily.introscope.agentProfile"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Trying to load file from IntroscopeEPAgent.properties
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Loaded file from IntroscopeEPAgent.properties
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent using old configuration (introscope.agent.configuration.old) set to default value of "false"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Canonical Key Map Thread Local (introscope.agent.reduceAgentMemoryOverhead.usecanonicalkeysthreadlocal) set to default value of "false"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Thread priority (introscope.agent.thread.all.priority) set to default value of "5"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Transaction Trace Limit (introscope.agent.ttClamp) set to default value of "200"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.tracer.sampling.maxrate) set to default value of "10"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.tracer.sampling.initial.period) set to default value of "100"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.tracer.sampling.reset.period) set to default value of "10000"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Transaction Trace Component Count Limit (introscope.agent.transactiontrace.componentCountClamp) set to default value of "5000"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Transaction Trace Head Filter Limit (introscope.agent.transactiontrace.headFilterClamp) set to default value of "30"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.transactiontracer.tailfilterPropagate.enable) set to default value of "true"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.transactiontracer.parameter.capture.sessionid) set to default value of "true"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Metric Aging (introscope.agent.metricAging.turnOn) set to "true"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Metric Aging Interval (introscope.agent.metricAging.heartbeatInterval) set to "1800" seconds
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Metric Aging Data Chunk (introscope.agent.metricAging.dataChunk) set to "500"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Metric Aging Exclusion List (introscope.agent.metricAging.metricExclude.ignore) set to "[Threads*]"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Metric Agent Timeslice Intervals (introscope.agent.metricAging.numberTimeslices) set to "3000"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Looking for agent profile property "introscope.agent.extensions.directory" to locate the extensions directory.
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] The agent extensions directory /ca/wily/col/introscope9.1.1.0/ext was successfully located
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent] Fully Qualified Agent Host Name (introscope.agent.display.hostName.as.fqdn) set to default value of "false"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent] Configuration property (introscope.agent.fallback.domain.name) set to default value of null
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent] Configuration property (introscope.agent.hostName) set to default value of null
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent] Configuration property (introscope.agent.primary.net.interface.name) set to default value of null
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent] Configuration property (introscope.agent.ip.family.order) set to default value of "1"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent] Configuration property (introscope.agent.subnetworks.path) set to default value of null
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Business Recording Enabled (introscope.agent.bizRecording.enabled) set to default value of "true"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Introscope Agent startup complete.



9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Metric Limit (introscope.agent.metricClamp) set to default value of "-1"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.charEncoding) set to default value of null
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.transactiontracer.parameter.httprequest.headers) set to default value of ""
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.transactiontracer.parameter.httprequest.parameters) set to default value of ""
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.transactiontracer.parameter.httprequest.attributes) set to default value of ""
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.transactiontracer.parameter.httpsession.attributes) set to default value of ""
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.transactiontracer.userid.key) set to default value of null
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.transactiontracer.userid.method) set to default value of null
9/19/12 09:22:43 AM SAST [WARN] [IntroscopeAgent.Agent] Agent_Transaction_Trace_UserID_Not_Configured
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] The Agent will attempt to determine its name.
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Unable to determine the Agent name from the System Property "com.wily.introscope.agent.agentName" because that property was either not found or had no value.
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Unable to determine the Agent name from a user specified System Property because the property "introscope.agent.agentNameSystemPropertyKey" in the Introscope Agent Profile was either not found or had no value.
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] The Agent will not attempt to automatically determine its name from the Application Server because that feature has been disabled in the Introscope Agent Profile.
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Using the Agent name "EPAgent" based on the "introscope.agent.agentName" property in the Introscope Agent Profile.
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Initial agent name set to EPAgent
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Isengard] Initiating connection attempts to the Introscope Enterprise Manager.
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Automated Agent Failback disabled. Agent Failback Retry Interval property was not found in the agent profile or the retry interval is set to zero.
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Isengard] The Agent reconnection delay is set to 15 second(s).
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.appmap.queue.size) set to default value of "1000"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Configuration property (introscope.agent.appmap.queue.period) set to default value of "1000"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.ChangeDetector] Introscope ChangeDetector Enabled (introscope.changeDetector.enable) set to default value of "false"
9/19/12 09:22:43 AM SAST [WARN] [IntroscopeAgent.ChangeDetector] ChangeDetector is currently disabled and won't run. To enable ChangeDetector set the property introscope.changeDetector.enable to true.
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Error snapshot collection has been enabled
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Started Error Reporting service
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Sustainability Property (com.wily.introscope.agent.sustainabilitymetrics.enabled) set to default value of "false"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Sustainability Metric enabled property (com.wily.introscope.agent.sustainabilitymetrics.metrics.enabled) set to default value of "false"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Sustainability Report enabled property (com.wily.introscope.agent.sustainabilitymetrics.report.enabled) set to default value of "false"
9/19/12 09:22:43 AM SAST [INFO] [IntroscopeAgent.Agent] Agent Sustainability Report frequecy property (com.wily.introscope.agent.sustainabilitymetrics.report.frequency) set to default value of "60000"
9/19/12 09:22:43 AM SAST [ERROR] [IntroscopeAgent.MessageServiceClient] Exception: java.lang.NullPointerException calling method: com.wily.isengard.messageprimitives.service.MessageServiceCallMessage: {com.wily.introscope.spec.server.beans.loadbalancing.ILoadBalancer.getCollectorReconnectList, v1, [v058dsmffd003, 10.9.130.207, EPAgentProcess, EPAgent, 21, default, false]}
com.wily.isengard.messageprimitives.ConnectionException

at com.wily.isengard.messageprimitives.service.MessageServiceClient.sendRequest(MessageServiceClient.java:194)

at com.wily.isengard.messageprimitives.service.MessageServiceClient.invoke(MessageServiceClient.java:356)

at $Proxy2.getCollectorReconnectList(Unknown Source)

at com.wily.introscope.agent.connection.IsengardServerConnectionManager.connectInternalAdvanced(IsengardServerConnectionManager.java:923)

at com.wily.introscope.agent.connection.ConnectionThread.attemptAdvancedConnection(ConnectionThread.java:299)

at com.wily.introscope.agent.connection.ConnectionThread.connect(ConnectionThread.java:434)

at com.wily.introscope.agent.connection.ConnectionThread.run(ConnectionThread.java:68)

at java.lang.Thread.run(Thread.java:636)
Caused by: java.lang.NullPointerException

at com.wily.introscope.spec.server.beans.clusters.ConnectedCollector.equals(ConnectedCollector.java:444)

at java.util.ArrayList.indexOf(ArrayList.java:216)

at java.util.ArrayList.contains(ArrayList.java:199)

at com.wily.introscope.server.beans.loadbalancer.LoadBalancerBean.getCollectorReconnectList(LoadBalancerBean.java:794)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at com.wily.isengard.messageprimitives.MethodCallUtilities.callInterface(MethodCallUtilities.java:75)

at com.wily.isengard.messageprimitives.MethodCallUtilities.callInterface(MethodCallUtilities.java:29)

at com.wily.isengard.messageprimitives.service.MessageService.attemptMethodCall(MessageService.java:183)

at com.wily.isengard.messageprimitives.service.MessageService.handleMethodCallMessage(MessageService.java:135)

at com.wily.isengard.messageprimitives.service.MessageService.receiveMessage(MessageService.java:161)

at com.wily.isengard.postoffice.Mailbox.handleMessage(Mailbox.java:252)

at com.wily.isengard.postoffice.PostOffice.deliverInternal(PostOffice.java:501)

at com.wily.isengard.postoffice.PostOffice.access$1(PostOffice.java:447)

at com.wily.isengard.postoffice.PostOffice$DeliveryItem.run(PostOffice.java:786)

at com.wily.EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:728)

at java.lang.Thread.run(Thread.java:662)


and

9.1.1.0 Agent


==> /ca/wily/col/introscope9.1.1.0/logs/IntroscopeEnterpriseManager.log <==
9/19/12 09:23:13.657 AM SAST [ERROR] [PO:main Mailman 3] [Manager.MessageService] Exception: java.lang.NullPointerException calling method: com.wily.isengard.messageprimitives.service.MessageServiceCallMessage: {com.wily.introscope.spec.server.beans.loadbalancing.ILoadBalancer.getCollectorReconnectList, v1, [v058dsmffd003, 10.9.130.207, EPAgentProcess, EPAgent, 445, default, false]}

Error message on Agent

9/19/12 10:06:43 AM SAST [ERROR] [IntroscopeAgent.MessageServiceClient] Exception: java.lang.NullPointerException calling method: com.wily.isengard.messageprimitives.service.MessageServiceCallMessage: {com.wily.introscope.spec.server.beans.loadbalancing.ILoadBalancer.getCollectorToReconnectTo, v1, [v058dsmffd004, EPAgentProcess, EPAgent, 21, default]}
com.wily.isengard.messageprimitives.ConnectionException

at com.wily.isengard.messageprimitives.service.MessageServiceClient.sendRequest(MessageServiceClient.java:194)

at com.wily.isengard.messageprimitives.service.MessageServiceClient.invoke(MessageServiceClient.java:356)

at $Proxy2.getCollectorToReconnectTo(Unknown Source)

at com.wily.introscope.agent.connection.IsengardServerConnectionManager.connectInternal(IsengardServerConnectionManager.java:805)

at com.wily.introscope.agent.connection.ConnectionThread.attemptConnection(ConnectionThread.java:141)

at com.wily.introscope.agent.connection.ConnectionThread.connect(ConnectionThread.java:260)

at com.wily.introscope.agent.connection.ConnectionThread.run(ConnectionThread.java:64)

at java.lang.Thread.run(Thread.java:636)
Caused by: java.lang.NullPointerException

at com.wily.introscope.spec.server.beans.clusters.ConnectedCollector.equals(ConnectedCollector.java:444)

at java.util.ArrayList.indexOf(ArrayList.java:216)

at java.util.ArrayList.contains(ArrayList.java:199)

at com.wily.introscope.server.beans.loadbalancer.LoadBalancerBean.getCollectorToReconnectTo(LoadBalancerBean.java:389)

at sun.reflect.GeneratedMethodAccessor244.invoke(Unknown Source)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at com.wily.isengard.messageprimitives.MethodCallUtilities.callInterface(MethodCallUtilities.java:75)

at com.wily.isengard.messageprimitives.MethodCallUtilities.callInterface(MethodCallUtilities.java:29)

at com.wily.isengard.messageprimitives.service.MessageService.attemptMethodCall(MessageService.java:183)

at com.wily.isengard.messageprimitives.service.MessageService.handleMethodCallMessage(MessageService.java:135)

at com.wily.isengard.messageprimitives.service.MessageService.receiveMessage(MessageService.java:161)

at com.wily.isengard.postoffice.Mailbox.handleMessage(Mailbox.java:252)

at com.wily.isengard.postoffice.PostOffice.deliverInternal(PostOffice.java:501)

at com.wily.isengard.postoffice.PostOffice.access$1(PostOffice.java:447)

at com.wily.isengard.postoffice.PostOffice$DeliveryItem.run(PostOffice.java:786)

at com.wily.EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:728)

at java.lang.Thread.run(Thread.java:662)




Anyone have any ideas

Dave

Outcomes