Clarity

Expand all | Collapse all

App and NSA services will not start

  • 1.  App and NSA services will not start

    Posted Apr 20, 2017 11:28 AM

    Hi all,

     

    I am having some problems getting the app and nsa services to start.

     

    SYS 2017-04-20 11:46:42,079 [localhost-startStop-2] niku.union (none:none:none:none) Stopping Distributed Cache Maintenance...
    SYS 2017-04-20 11:46:42,095 [localhost-startStop-2] niku.union (none:none:none:none) Destroying: tower...
    SYS 2017-04-20 11:46:42,157 [localhost-startStop-2] niku.union (none:none:none:none) Destroying: nsa...
    SYS 2017-04-20 11:46:42,157 [localhost-startStop-2] niku.union (none:none:none:none) Destroying: wmd-init...
    SYS 2017-04-20 11:46:42,157 [localhost-startStop-2] niku.union (none:none:none:none) Destroying: jasper-init...
    SYS 2017-04-20 11:46:42,157 [localhost-startStop-2] niku.union (none:none:none:none) Destroying: odf.init...
    SYS 2017-04-20 11:46:42,157 [localhost-startStop-2] niku.union (none:none:none:none) Destroying: bpm...
    SYS 2017-04-20 11:46:42,157 [localhost-startStop-2] niku.union (none:none:none:none) Destroying: bpm-validation...
    SYS 2017-04-20 11:46:42,157 [localhost-startStop-2] niku.union (none:none:none:none) Destroying: njs...
    SYS 2017-04-20 11:46:42,157 [localhost-startStop-2] niku.union (none:none:none:none) Destroying: blobcrack.init...
    SYS 2017-04-20 11:46:42,157 [localhost-startStop-2] niku.union (none:none:none:none) Destroying: schedulers.init...
    SYS 2017-04-20 11:49:47,013 [localhost-startStop-1] niku.union (none:none:none:none) Clarity 15.2.0.213 initializing...
    WARN 2017-04-20 11:49:48,699 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Could not get Connection to verify Database: clarity
    WARN 2017-04-20 11:49:48,699 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Could not verify database connection for Local TenantInstance with id = clarity marking as an invalid configuration.
    SYS 2017-04-20 11:49:48,700 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) ==================================================================
    SYS 2017-04-20 11:49:48,700 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) ==================================================================
    SYS 2017-04-20 11:49:48,700 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) CLARITY

    SYS 2017-04-20 11:49:48,700 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Tenants: TenantInstance: id: clarity
    SYS 2017-04-20 11:49:48,700 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Tenants: TenantInstance: appId: app
    SYS 2017-04-20 11:49:48,700 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Tenants: TenantInstance: bgId: bg
    SYS 2017-04-20 11:49:48,701 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Tenants: TenantInstance: fileDirectory: tenantDirectory
    SYS 2017-04-20 11:49:48,701 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Tenants: TenantInstance: status: invalid
    SYS 2017-04-20 11:49:48,701 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: id: clarity
    SYS 2017-04-20 11:49:48,701 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: serviceId: niku
    SYS 2017-04-20 11:49:48,701 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: driver: com.ca.clarity.jdbc.sqlserver.SQLServerDriver
    SYS 2017-04-20 11:49:48,701 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: url: jdbc:clarity:sqlserver://48.137.137.179:1433;DatabaseName=niku;InsensitiveResultSetBufferSize=0;ProgramName=Clarity
    SYS 2017-04-20 11:49:48,701 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: username: niku
    SYS 2017-04-20 11:49:48,701 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: schemaName: niku
    SYS 2017-04-20 11:49:48,702 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: serviceName: niku
    SYS 2017-04-20 11:49:48,702 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: vendor: mssql
    SYS 2017-04-20 11:49:48,702 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: largeIndex: INDX_LARGE
    SYS 2017-04-20 11:49:48,702 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: smallIndex: INDX_SMALL
    SYS 2017-04-20 11:49:48,702 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: largeTables: USERS_LARGE
    SYS 2017-04-20 11:49:48,702 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/Database: smallTables: USERS_SMALL
    SYS 2017-04-20 11:49:48,703 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: id: clarity_dwh
    SYS 2017-04-20 11:49:48,703 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: serviceId: ppm_dwh
    SYS 2017-04-20 11:49:48,703 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: driver: com.ca.clarity.jdbc.sqlserver.SQLServerDriver
    SYS 2017-04-20 11:49:48,703 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: url: jdbc:clarity:sqlserver://IELETT12KEPICRT:1433;DatabaseName=ppm_dwh;InsensitiveResultSetBufferSize=0;ProgramName=Clarity
    SYS 2017-04-20 11:49:48,703 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: username: ppm_dwh
    SYS 2017-04-20 11:49:48,703 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: schemaName: ppm_dwh
    SYS 2017-04-20 11:49:48,703 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: serviceName: ppm_dwh
    SYS 2017-04-20 11:49:48,704 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: vendor: mssql
    SYS 2017-04-20 11:49:48,704 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: clarityDBLink: PPMDBLINK
    SYS 2017-04-20 11:49:48,704 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: factIndex: DWH_PPM_INDX_FACT
    SYS 2017-04-20 11:49:48,704 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: dimensionIndex: DWH_PPM_INDX_DIM
    SYS 2017-04-20 11:49:48,704 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: factTables: DWH_PPM_DATA_FACT
    SYS 2017-04-20 11:49:48,704 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Properties/dwhDatabaseServer/Database: dimensionTables: DWH_PPM_DATA_DIM
    SYS 2017-04-20 11:49:48,715 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) ==================================================================
    SYS 2017-04-20 11:49:48,716 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Tenants for this Application with instance id = app :
    SYS 2017-04-20 11:49:48,716 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) ==================================================================
    SYS 2017-04-20 11:49:48,716 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) Active Tenants:
    SYS 2017-04-20 11:49:48,716 [localhost-startStop-1] config.TenantConfigurationManager (none:none:none:none) ==================================================================
    ERROR 2017-04-20 11:49:48,717 [localhost-startStop-1] niku.union (none:none:none:none) Clarity15.2.0.213 failed to initialize.
    com.niku.union.config.ConfigurationException: The application failed to start because of a database configuration problem. Please review the application log for specific error information.
    at com.niku.union.config.ConfigurationManager.initAppServerIntern(ConfigurationManager.java:4067)
    at com.niku.union.config.ConfigurationManager.initAppServer(ConfigurationManager.java:3992)
    at com.niku.union.web.WebControlServlet.init(WebControlServlet.java:155)
    at javax.servlet.GenericServlet.init(GenericServlet.java:158)
    at org.apache.catalina.core.StandardWrapper.initServlet(StandardWrapper.java:1183)
    at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1099)
    at org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:989)
    at org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:4913)
    at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5223)
    at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
    at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1419)
    at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1409)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)

     

    Since the above errors I have been unable to restart the services.



  • 2.  Re: App and NSA services will not start

    Posted Apr 20, 2017 11:35 AM

    Looks like a "can not reach database" problem?

     

    Can you connect to your DB okay from the application server? If not, need to fix that!

    Can you restart (completely) your application server (i.e. not just the services)?

     

    (sorry if this sounds obvious)



  • 3.  Re: App and NSA services will not start

    Broadcom Employee
    Posted Apr 20, 2017 03:57 PM

    In addition to what Dave said, you may see similar messages after database refresh when the database version does not match exactly the application version. I.e. if you have 15.1.0.3 in Production and restore it to 15.1.0.5 on Test. The mismatch is detected and reported in the logs as database issue.

     

    Hope this helps -Nika



  • 4.  Re: App and NSA services will not start

    Posted Apr 20, 2017 04:11 PM

    Thanks for the suggestions guys. I'll make sure to apply them when I'm back in the office.

     

    Nika - isn't there a SQL query I can run to verify which db version I'm on? Our application is at 15.2 now but it'd be worth checking to see if our db version is definitely 15.2 as well.

     

    If it isn't, if memory serves me there is a command I can run to update the db version?

    Sent from Email+ secured by MobileIron



  • 5.  Re: App and NSA services will not start

    Broadcom Employee
    Posted Apr 20, 2017 04:19 PM

    Hi Colin

     

    You can compare your versions by comparing the file version.properties from $clarityppm\.setup on the application to the latest version in the results of:

    select * from cmn_install_history order by installed_date desc

     

    I'd first check though that CSA displays the database as Available at all.

     

    Currently there is no command to update the database version, if there is a mismatch an upgrade/patch install should be performed to bring the updates in.

     

    Hope this helps -Nika



  • 6.  Re: App and NSA services will not start

    Posted Apr 20, 2017 04:25 PM

    Thanks again Nika.

    I'll check this out tomorrow and let you know how it goes.

     

    Sent from Divide managed by MobileIron



  • 7.  Re: App and NSA services will not start

    Posted Apr 21, 2017 02:26 AM

    Ok so I checked in clarity\.setup for the version.properties file and it say there that I am on version 15.2

     

    Then I ran the query to check the install history and db version. It also says that I'm at version 15.2.

    So there doesn't appear to be any mismatch between the db and the app versions.

     

    I restarted the app server completely and ran an admin general upload-config. There were no errors when I did this.

    But my app and nsa services still will not start. 

     

    I cannot check the CSA to see the db availability because the NSA service will not start.

    Which log files will likely give me the best info?



  • 8.  Re: App and NSA services will not start

    Posted Apr 21, 2017 02:29 AM

    version.properties:


    # Full version number
    version=15.2.0.213

    # Clarity-specific additional information
    display.version=${version}
    release=15.2.0

     

    install database NULL 15.2.0 15.2.0.213 2017-04-13 10:02:39.980 PROCESSED

     

    I used the tomcat version that came with the 15.2 ISO



  • 9.  Re: App and NSA services will not start

    Posted Apr 21, 2017 02:36 AM

    in app.system.log

     

    Unable to locate the class org.apache.catalina.startup.Bootstrap: java.lang.ClassNotFoundException: org.apache.catalina.startup.Bootstrap



  • 10.  Re: App and NSA services will not start

    Broadcom Employee
    Posted Apr 21, 2017 03:05 AM

    Hi Colin,

     

    Can you please check if the rights are proper in database. 

     

    Regards

    Suman Pramanik 



  • 11.  Re: App and NSA services will not start

    Posted Apr 21, 2017 04:42 AM

    Hi Suman,

     

    I'm not sure what you mean. I have system admin access to the db server so if you can advise what I should check I should be able to do so. 

     

    Thanks!



  • 12.  Re: App and NSA services will not start

    Posted Apr 21, 2017 04:49 AM

    Can you please provide the bit more line from the system logs?  It seems some files are missing.