DX Application Performance Management

  • 1.  RE: How to Monitor Active Hung Threads using Introscope Agent?

    Posted Feb 12, 2013 03:44 AM
    After being started,EPAgent cant read the weblogic scripts....its showing that The stateful plugin '
    WEBLOGIC' has unexpectedly quit.

    here is the log:---->

    C:\Program Files\CA APM\Introscope9.1.0.2\EPAgent\lib>java -jar EPAgent.jar -Dco
    m.wily.introscope.epagent.properties=IntroscopeEPAgent.properties
    Options:
    -help -h -? display this help screen
    -verbose -v turn on verbose output
    2/12/13 02:01:04 PM IST [INFO] [EPAgent] Introscope EPAgent Release 9.1.0.2 (Bui
    ld 581100)
    2/12/13 02:01:04 PM IST [INFO] [EPAgent] Using Java VM version "Java HotSpot(TM)
    Client VM 1.7.0_09" from Oracle Corporation
    2/12/13 02:01:04 PM IST [INFO] [EPAgent] Using Introscope installation at: C:\Pr
    ogram Files\CA APM\Introscope9.1.0.2\EPAgent\lib\.
    2/12/13 02:01:04 PM IST [INFO] [EPAgent] CA Introscope(R) Version 9.1
    2/12/13 02:01:04 PM IST [INFO] [EPAgent] Copyright (c) 2012 CA. All Rights Reser
    ved.
    2/12/13 02:01:04 PM IST [INFO] [EPAgent] Introscope(R) is a registered trademark
    of CA.
    2/12/13 02:01:04 PM IST [INFO] [EPAgent] Starting Introscope EPAgent...
    2/12/13 02:01:04 PM IST [INFO] [EPAgent] Reading configuration file: IntroscopeE
    PAgent.properties
    2/12/13 02:01:04 PM IST [INFO] [EPAgent] Introscope EPAgent started.
    2/12/13 02:01:04 PM IST [INFO] [EPAgent.EPAgent WEBLOGIC] Starting plugin 'WEBLO
    GIC'.
    2/12/13 02:01:04 PM IST [ERROR] [EPAgent.EPAgent WEBLOGIC] [ stderr ] Can't open
    perl script "'C:\Program": Invalid argument
    2/12/13 02:01:04 PM IST [INFO] [EPAgent.EPAgent WEBLOGIC] The process started by
    plugin WEBLOGIC was destroyed
    2/12/13 02:01:04 PM IST [ERROR] [EPAgent.EPAgent WEBLOGIC] The stateful plugin '
    WEBLOGIC' has unexpectedly quit.
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Release 9.1.0.2 (Bu
    ild 581100)
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Using Java VM version "Ja
    va HotSpot(TM) Client VM 1.7.0_09" from Oracle Corporation
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Trying to load agent prof
    ile based on system property "com.wily.introscope.agentProfile"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Trying to load file from
    IntroscopeEPAgent.properties
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Loaded file from Introsco
    peEPAgent.properties
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent using old configura
    tion (introscope.agent.configuration.old) set to default value of "false"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Canonical Key Map Thread
    Local (introscope.agent.reduceAgentMemoryOverhead.usecanonicalkeysthreadlocal) s
    et to default value of "false"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Thread priority (introsco
    pe.agent.thread.all.priority) set to default value of "5"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Transaction Trace L
    imit (introscope.agent.ttClamp) set to default value of "200"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.tracer.sampling.maxrate) set to default value of "10"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.tracer.sampling.initial.period) set to default value of "100"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.tracer.sampling.reset.period) set to default value of "10000"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Transaction Trace Compone
    nt Count Limit (introscope.agent.transactiontrace.componentCountClamp) set to de
    fault value of "5000"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Transaction Trace Head Fi
    lter Limit (introscope.agent.transactiontrace.headFilterClamp) set to default va
    lue of "30"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.transactiontracer.tailfilterPropagate.enable) set to default val
    ue of "true"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.transactiontracer.parameter.capture.sessionid) set to default va
    lue of "true"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Metric Aging (intro
    scope.agent.metricAging.turnOn) set to "true"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Metric Aging Interv
    al (introscope.agent.metricAging.heartbeatInterval) set to "1800" seconds
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Metric Aging Data C
    hunk (introscope.agent.metricAging.dataChunk) set to "500"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Metric Aging Exclus
    ion List (introscope.agent.metricAging.metricExclude.ignore) set to "[Threads*]"

    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Metric Agent Timesl
    ice Intervals (introscope.agent.metricAging.numberTimeslices) set to "3000"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Looking for agent profile
    property "introscope.agent.extensions.directory" to locate the extensions direc
    tory.
    2/12/13 02:01:05 PM IST [ERROR] [IntroscopeAgent.Agent] The agent extensions dir
    ectory C:\Program Files\CA APM\Introscope9.1.0.2\EPAgent\lib\ext could not be lo
    cated. No extensions will be loaded.
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent] Fully Qualified Agent Host Name
    (introscope.agent.display.hostName.as.fqdn) set to default value of "false"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent] Configuration property (introsc
    ope.agent.fallback.domain.name) set to default value of null
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent] Configuration property (introsc
    ope.agent.hostName) set to default value of null
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent] Configuration property (introsc
    ope.agent.primary.net.interface.name) set to default value of null
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent] Configuration property (introsc
    ope.agent.ip.family.order) set to default value of "1"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent] Configuration property (introsc
    ope.agent.subnetworks.path) set to default value of null
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Business Recording Enable
    d (introscope.agent.bizRecording.enabled) set to default value of "true"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Introscope Agent startup
    complete.
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Metric Limit (intro
    scope.agent.metricClamp) set to default value of "-1"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.charEncoding) set to default value of null
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.transactiontracer.parameter.httprequest.headers) set to default
    value of ""
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.transactiontracer.parameter.httprequest.parameters) set to defau
    lt value of ""
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.transactiontracer.parameter.httprequest.attributes) set to defau
    lt value of ""
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.transactiontracer.parameter.httpsession.attributes) set to defau
    lt value of ""
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.transactiontracer.userid.key) set to default value of null
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.transactiontracer.userid.method) set to default value of null
    2/12/13 02:01:05 PM IST [WARN] [IntroscopeAgent.Agent] Agent_Transaction_Trace_U
    serID_Not_Configured
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] The Agent will attempt to
    determine its name.
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Unable to determine the A
    gent name from the System Property "com.wily.introscope.agent.agentName" because
    that property was either not found or had no value.
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Unable to determine the A
    gent name from a user specified System Property because the property "introscope
    .agent.agentNameSystemPropertyKey" in the Introscope Agent Profile was either no
    t found or had no value.
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] The Agent will not attemp
    t to automatically determine its name from the Application Server because that f
    eature has been disabled in the Introscope Agent Profile.
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Using the Agent name "EPA
    gent" based on the "introscope.agent.agentName" property in the Introscope Agent
    Profile.
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Initial agent name set to
    EPAgent
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Isengard] Initiating connection
    attempts to the Introscope Enterprise Manager.
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Automated Agent Failback
    disabled. Agent Failback Retry Interval property was not found in the agent prof
    ile or the retry interval is set to zero.
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Isengard] The Agent reconnection
    delay is set to 15 second(s).
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.appmap.queue.size) set to default value of "1000"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Configuration property (i
    ntroscope.agent.appmap.queue.period) set to default value of "1000"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Error snapshot collection
    has been enabled
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Started Error Reporting s
    ervice
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Sustainability Prop
    erty (com.wily.introscope.agent.sustainabilitymetrics.enabled) set to default va
    lue of "false"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Sustainability Metr
    ic enabled property (com.wily.introscope.agent.sustainabilitymetrics.metrics.ena
    bled) set to default value of "false"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Sustainability Repo
    rt enabled property (com.wily.introscope.agent.sustainabilitymetrics.report.enab
    led) set to default value of "false"
    2/12/13 02:01:05 PM IST [INFO] [IntroscopeAgent.Agent] Agent Sustainability Repo
    rt frequecy property (com.wily.introscope.agent.sustainabilitymetrics.report.fre
    quency) set to default value of "60000"
    2/12/13 02:01:17 PM IST [INFO] [IntroscopeAgent.IsengardServerConnectionManager]
    Connected controllable Agent to the Introscope Enterprise Manager at 192.168.20
    6.161:5001,com.wily.isengard.postofficehub.link.net.DefaultSocketFactory. Host =
    "testclient3", Process = "EPAgentProcess", Agent Name = "EPAgent", Active = "tr
    ue".
    2/12/13 02:01:17 PM IST [INFO] [IntroscopeAgent.ConnectionThread] Connected to 1
    92.168.206.161:5001,com.wily.isengard.postofficehub.link.net.DefaultSocketFactor
    y in allowed mode.
    2/12/13 02:01:34 PM IST [ERROR] [EPAgent] The stateful plugin 'WEBLOGIC' is bein
    g restarted.
    2/12/13 02:01:34 PM IST [ERROR] [EPAgent.EPAgent WEBLOGIC] [ stderr ] Can't open
    perl script "'C:\Program": Invalid argument
    2/12/13 02:01:34 PM IST [INFO] [EPAgent.EPAgent WEBLOGIC] The process started by
    plugin WEBLOGIC was destroyed
    2/12/13 02:01:34 PM IST [ERROR] [EPAgent.EPAgent WEBLOGIC] The stateful plugin '
    WEBLOGIC' has unexpectedly quit.




    In IntroscopeEPAgent.properties i changed the following things:->

    uncommented this property:----->introscope.epagent.config.networkDataPort=8000

    introscope.epagent.plugins.stateful.names=WEBLOGIC
    introscope.epagent.stateful.WEBLOGIC.command=perl 'C:\\Program Files\\CA APM\\Introscope9.1.0.2\\EPAgent\\epaplugins\\weblogic\\weblogicLogReader.pl'


    In weblogicLogReader.cfg i changed the following thing:--->>>

    LOGFILEDIR = 'C:\Oracle\middleware\wlserver_10.3\samples\domains\wl_server\servers\examplesServer\logs'
    LOGFILE = 'examplesServer.log'
    SLEEPTIME = 15


    EPAgent cant read weblogic logfile....plz help to solve this problem.... ..thanks in advance


    Regards
    Manirul


  • 2.  RE: How to Monitor Active Hung Threads using Introscope Agent?

    Broadcom Employee
    Posted Feb 12, 2013 03:51 AM
    Here's your problem:
    2/12/13 02:01:04 PM IST [ERROR] [EPAgent.EPAgent WEBLOGIC] [ stderr ] Can't open
    perl script "'C:\Program": Invalid argument
    You need to put quotation marks around directory names with spaces, or use the 8.3 formatted name. If you don't know what the 8.3 version of a directory or file is, use the following command:
    dir /x
    For example, the 8.3 version of "C:\Program Files" is C:\PROGRA~1 and "C:\Program Files (x86)" is C:\PROGRA~2.

    -Hiko


  • 3.  RE: How to Monitor Active Hung Threads using Introscope Agent?

    Posted Feb 14, 2013 06:00 AM
    hi ,

    i did not put any quotation mark around the directory name.its working now...here is the command->
    introscope.epagent.stateful.WEBLOGIC.command=perl C:\\PROGRA~1\\CAAPM\\Introscope9.1.0.2\\EPAgent\\epaplugins\\weblogic\\weblogicLogReader.pl

    thank you hiko

    -Manirul