DX Unified Infrastructure Management

  • 1.  ACE/UGS Probes

    Posted Apr 12, 2017 07:11 AM

    Hello Folks,

     

    We are having several issues related to the nimsoft data insertion queues.

    There are many bottlenecks in the probe data_engine

     

    Trying to find the cause, I ended up finding errors in the UGS and ACE probe logs

     

    In the UGS probe, the log that repeats is as follows:

    Unable to contact ACE. Configuration will not occur until ACE comes back online.

     

    Already in the ACE probe, the log that is is as follows:

    WARN [attach_socket, com.nimsoft.probe.service.ace.Configurator] Configuration process already running. Will retry later ...

     

    Are these logs correct?



  • 2.  Re: ACE/UGS Probes
    Best Answer

    Broadcom Employee
    Posted Apr 12, 2017 07:42 AM
      |   view attached

    Hi Jean,

    The errors in those probes won’t be affecting your data_engine insert rate.

    Have you enabled the multi threading in the data engine ?

    These are the keys that should be in the setup section…

       queue_limit_total = 100000

       thread_count_insert = 8

    the thread count should roughly match the number of cores you have on the primary hub.

     

    Also put the data engine into log level 1 and look at the insert rates. Are they less than 200ms ?

    If more than this, your SQL server might be struggling for resources.

    Cheers

    Rowan



  • 3.  Re: ACE/UGS Probes

    Posted Apr 12, 2017 07:48 AM

    Hello Rowan,

     

    We have four servers on primary hub (Core) and 25 secondary hubs

     

    Follow the configuration of our data_engine

     

       queue_limit_total = 100000

       thread_count_insert = 4

     

    The average of insert rates now is 4977msg/sec

     

    I will keep looking to find the issue 



  • 4.  Re: ACE/UGS Probes

    Broadcom Employee
    Posted Apr 12, 2017 09:53 AM
      |   view attached

    What was the insert rate before the multi threading change?

    If there is a queue for the data engine and you are only getting 5k per second then it isn’t too bad, perhaps a little slow though.

    Need to see your level 1 data engine log