DX Application Performance Management

  • 1.  ca apm agent appeared NullPointerException,It affected the production system

    Posted Dec 27, 2018 05:09 AM

    Hello evryone:

       When i deployed  agent,one of a tomcat after the restarted , ca apm agent appeared NullPointerException.Then users can't login the System. After that we canceled the apm monitoring. The System was back to normal,Users can log in normally.  I hope someone would give me some advice,thanks a lot .

    Some configurations are as follows:

     CA Wily Introscope(R) Version 10.3.0 Release 10.3.0.15

     apache-tomcat-7.0.85

     jdk1.7.0_80

     

    • Below is  the some of tomcat  error log

    • Exception
      java.lang.NullPointerException
      at com.wily.introscope.agent.trace.intelligent.HighPerformanceIntelligenceStackElement.getException(HighPerformanceIntelligenceStackElement.java:2054)
      at com.wily.introscope.agent.trace.intelligent.HighPerformanceIntelligenceStackElement$HighPerformanceIntelligenceStackElementVirtualStack.IIntelligentInstrumentationMethodTracer_setThrownException(HighPerformanceIntelligenceStackElement.java:1661)
      at com.bamboocloud.bam.authentication.jaas.LoginContext.invoke(LoginContext.java:306)
      at com.bamboocloud.bam.authentication.jaas.LoginContext.login(LoginContext.java:123)
      at com.bamboocloud.bam.authentication.service.AMLoginContext.runLogin(AMLoginContext.java:557)
      at com.bamboocloud.bam.authentication.service.AMLoginContext.executeLogin(AMLoginContext.java:515)
      at com.bamboocloud.bam.authentication.server.AuthContextLocal.login(AuthContextLocal.java:544)
      at com.bamboocloud.bam.authentication.server.AuthContextLocal.login(AuthContextLocal.java:419)
      at com.bamboocloud.bam.authentication.AuthContext.runLogin(AuthContext.java:778)
      at com.bamboocloud.bam.authentication.AuthContext.login(AuthContext.java:671)
      at com.bamboocloud.bam.authentication.AuthContext.login(AuthContext.java:614)
      at com.bamboocloud.bam.authentication.AuthContext.login(AuthContext.java:417)
      at com.bamboocloud.bam.idsvcs.bam.IdentityServicesImpl.authenticate(IdentityServicesImpl.java:236)
      at sun.reflect.GeneratedMethodAccessor53.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at com.bamboocloud.bam.idsvcs.rest.IdentityServicesHandler$SecurityMethod.invoke(IdentityServicesHandler.java:831)
      at com.bamboocloud.bam.idsvcs.rest.IdentityServicesHandler$SecurityMethod.execute(IdentityServicesHandler.java:724)
      at com.bamboocloud.bam.idsvcs.rest.IdentityServicesHandler.service(IdentityServicesHandler.java:140)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:731)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
      at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
      at com.bamboocloud.bam.validation.ResponseValidationFilter.doFilter(ResponseValidationFilter.java:44)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
      at com.bamboocloud.bam.setup.AMSetupFilter.doFilter(AMSetupFilter.java:98)
      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219)
      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110)
      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169)
      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
      at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:962)
      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
      at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:445)
      at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1115)
      at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:637)
      at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:318)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
      at java.lang.Thread.run(Thread.java:745)

    Attachment(s)

    zip
    193tomcat日志.zip   1.82 MB 1 version
    zip
    apm-logs3.zip   301 KB 1 version


  • 2.  Re: ca apm agent appeared NullPointerException,It affected the production system
    Best Answer

    Posted Dec 31, 2018 10:03 AM

    Morning Liao,

     

    I've had quite a bit of experience with trying to get an APM agent into Tomcat hosting Atlassian Confluence.

     

    Atlassian Confluence 6.1.0 - CA APM 10.0 Tomcat Agent 

     

    With the Tomcat agent, which is a Java agent, it will bind to the class loader, the problem with that is the agent has to be in the right sequence within the boot delegation in order for the agent's dynamic instrumentation to be out of the way of the other bootloaded classes.

     

    Highly suggest you open a support case and reference Case 00768835.

     

     

    We implemented the same settings for 10.5.2 Tomcat agent and it has been functioning.

     

    Hope this helps,

     

    Billy



  • 3.  Re: ca apm agent appeared NullPointerException,It affected the production system

    Posted Jan 03, 2019 05:44 AM

    Thank you for your reply. I think the reason is this.

    Smart Instrumentation cross-process automatic trac - CA Knowledge 

    Three tomcat servers are deployed on one server,They all made the mistake,but Only one Tomcat has had an impact. Forgive me for my poor English