DX Application Performance Management

In CEM under the Events tab i'm able to see the error "Errors processing statistics file(s). See EM log for details".

In Collector server EM service logs i'm getting "Agent stg3 reported 50,000 metrics ".

So we took the backup of the config file "apm-events-thresholds-config-xml" and changed the threshold limit of introscope.enterprisemanager.agent.metrics.limit. as the default limit is 50,000.After changing the value the error is not coming in the log files.But Still i'm getting the same error on CEM "Errors processing statistics file(s). See EM log for details".

After changing the value of metrics the metric data was able to see in the dash board for one day.After that i'm not able to see any metrics in the Investigator.

Please help me.

Thanks.

Hi,

I think the error you see in events page is nowhere related to Jboss metrics. The error says stats files are not processed. In your EM logs, check whether daily stats aggregation service ran successfully. It usually runs on midnight so you can see series of messages confirming that. Also check your performance and analysis reports on CEM page for daily, past week and custom dates. if you see no data/blank graph, daily stats aggregation service did not run/errors in processing. As a first step, restart your enterprise manager service on where your CEM service(Stats aggregation) is running.

Coming to no metrics for Jboss, it seems your collector is overloaded due to too much of metrics from Agent stg3. To check whether your collector is overloaded, check for any clamps on APM status console or check number of metrics/number of historical metrics. If these two metrics are gradually increasing and crossing the limit, your collector will stop receiving metrics from agent stg3.

It seems like agent stg3 is sending more than 50,000 metrics. So check why agent is sending too much of data(use metrics count tab to find which metrics are of high count) and try to reduce by fine-tuning instrumentation.

By analyzing these data, i hope you have CEM services and agents reporting to same collector. Give CEM services an individual collector(follow CA's recommendations) and agents on another one so you are free from overloading.

Hope this helps. Here are some detailed techniques - How to improve the performance of APM?

Thanks,

Karthik

Hello Karthik,

I have checked the logs and the daily stats aggregation service is running fine.

From last 13 days i'm not able to see any data on the graph and only the availability (Connection status) is showing green.

we have one collector for agent and for CEM services it will automatically redirect to one of the free collector.

Thanks.