We only have one application server and one database server in this particular environment and both are on the same host.
We really are stumped here:
Again today we see a temporary drop in database connection and then after a while it re-establishes connection again:
ERROR 2015-08-17 01:03:02,497 [Dispatch pool-4-thread-4 : bg@SERVER (tenant=clarity)] persistence.PersistenceController (clarity:X163479:199931018__DFC41A43-EF4A-4883-B437-CD4590B6ED7F:Time Slicing) Exception due to DB Connection failure
ERROR 2015-08-17 01:03:02,550 [Dispatch pool-4-thread-4 : bg@SERVER (tenant=clarity)] niku.blobcrack (clarity:X163479:199931018__DFC41A43-EF4A-4883-B437-CD4590B6ED7F:Time Slicing) Exception during blobcrack process
java.sql.SQLException: [CA Clarity][SQLServer JDBC Driver]Object has been closed.
FATAL 2015-08-17 01:03:02,560 [Dispatch pool-4-thread-4 : bg@SERVER (tenant=clarity)] union.persistence (clarity:X163479:199931018__DFC41A43-EF4A-4883-B437-CD4590B6ED7F:Time Slicing) Failed to determine analytic function support
java.sql.SQLException: [CA Clarity][SQLServer JDBC Driver]Object has been closed.
FATAL 2015-08-17 01:03:02,568 [Dispatch pool-4-thread-4 : bg@SERVER(tenant=clarity)] union.persistence (clarity:X163479:199931018__DFC41A43-EF4A-4883-B437-CD4590B6ED7F:Time Slicing) Failed to retrieve database version
java.sql.SQLException: [CA Clarity][SQLServer JDBC Driver]Object has been closed.
ERROR 2015-08-17 01:03:02,652 [Dispatch pool-4-thread-4 : bg@SERVER (tenant=clarity)] niku.blobcrack (clarity:X163479:199931018__DFC41A43-EF4A-4883-B437-CD4590B6ED7F:Time Slicing) Exception during blobcrack process
com.niku.union.persistence.PersistenceException:
SQL error code: 0
Error message: [CA Clarity][SQLServer JDBC Driver]Object has been closed.
Executed:
{call PRJ_BLB_SLICE_RESET_ALL_SP(?,?)}
Derived from statement:
<?xml version="1.0" encoding="UTF-8"?>
<statement sortColumnPath="/data/header/sortInfo/@sortColumn" sortDirectionPath="/data/header/sortInfo/@sortDirection" slicePath="/data/header/pagination/sliceInfo/@slice" sliceSizePath="/data/header/pagination/sliceInfo/@sliceSize" inputSource="map" xmlns="http://schemas.niku.com/2002/pmd">
<sql dbVendor="all">
<text>
{call PRJ_BLB_SLICE_RESET_ALL_SP(?,?)}
</text>
<param type="string" direction="IN" constantValue="PRJ_RESOURCES" expressionListDelimiter=","/>
<param name="sliceStatusFlag" type="int" direction="IN" expressionListDelimiter=","/>
</sql>
</statement>
Referenced by:
<?xml version="1.0" encoding="UTF-8"?>
<statementRef id="blobcrack.setAllResourcesModified_set_nested_0" inputSource="map" inputMapIndex="0" sortColumnPath="/data/header/sortInfo/@sortColumn" sortDirectionPath="/data/header/sortInfo/@sortDirection" slicePath="/data/header/pagination/sliceInfo/@slice" sliceSizePath="/data/header/pagination/sliceInfo/@sliceSize" defaultSliceSize="20" ignoreIfError="false" hideResultSets="false" xmlns="http://schemas.niku.com/2002/pmd"/>
Using input:
{sliceStatusFlag=3, parameters=[int:sliceStatusFlag:3:]}
at com.niku.union.persistence.PersistenceController.createException(PersistenceController.java:2019)
at com.niku.union.persistence.PersistenceController.handleSQLException(PersistenceController.java:2123)
at com.niku.union.persistence.PersistenceController.processSql(PersistenceController.java:2662)
at com.niku.union.persistence.PersistenceController.processStatement(PersistenceController.java:852)
at com.niku.union.persistence.PersistenceController.processStatements(PersistenceController.java:752)
at com.niku.union.persistence.PersistenceController.doProcessRequest(PersistenceController.java:560)
at com.niku.union.persistence.PersistenceController.processRequest(PersistenceController.java:290)
at com.niku.xql2.pmd.PMDDataSource.execute(PMDDataSource.java:204)
at com.niku.blobcrack.BlobCrackDB.resetRequest(BlobCrackDB.java:191)
at com.niku.blobcrack.BlobCrackDB.resetRequests(BlobCrackDB.java:221)
at com.niku.blobcrack.BlobCrackDB.prepareSliceStatus(BlobCrackDB.java:770)
at com.niku.blobcrack.BlobCrackDB.sliceCurves(BlobCrackDB.java:589)
at com.niku.blobcrack.BlobCrackDB.createSlices(BlobCrackDB.java:245)
at com.niku.blobcrack.xql2.handlers.BlobCracker.processExpiredRequests(BlobCracker.java:158)
at com.niku.blobcrack.xql2.handlers.BlobCracker.postProcess(BlobCracker.java:44)
at com.niku.xql2.XQLVisitor.postProcess(XQLVisitor.java:1355)
at com.niku.union.xml.dom.DOMWalker.postProcess(DOMWalker.java:210)
at com.niku.union.xml.dom.DOMWalker.traverseIntern(DOMWalker.java:94)
at com.niku.union.xml.dom.DOMWalker.traverseIntern(DOMWalker.java:92)
at com.niku.union.xml.dom.DOMWalker.traverseIntern(DOMWalker.java:92)
at com.niku.union.xml.dom.DOMWalker.traverse(DOMWalker.java:36)
at com.niku.xql2.XQLProcessor.process(XQLProcessor.java:257)
at com.niku.njs.xbl.XBLService.process(XBLService.java:127)
at com.niku.njs.xbl.XBLService.process(XBLService.java:75)
at com.niku.njs.listeners.XBLJob.scheduledEventFired(XBLJob.java:44)
at com.niku.njs.Dispatcher$BGTask.run(Dispatcher.java:290)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.sql.SQLException: [CA Clarity][SQLServer JDBC Driver]Object has been closed.
at com.ca.clarity.jdbc.sqlserverbase.ddb7.b(Unknown Source)
at com.ca.clarity.jdbc.sqlserverbase.ddb7.a(Unknown Source)
at com.ca.clarity.jdbc.sqlserverbase.ddb6.b(Unknown Source)
at com.ca.clarity.jdbc.sqlserverbase.ddb6.a(Unknown Source)
at com.ca.clarity.jdbc.sqlserverbase.BaseConnection.prepareCall(Unknown Source)
at com.ca.clarity.jdbc.sqlserverbase.BaseConnection.prepareCall(Unknown Source)
at com.niku.union.persistence.utils.Utils.createStatementInternal(Utils.java:669)
at com.niku.union.persistence.utils.Utils.createStatement(Utils.java:633)
at com.niku.union.persistence.PersistenceController.processSql(PersistenceController.java:2504)
... 26 more