Clarity

  • 1.  DWH Load Job is Failing - DWH_CMN_PRD_VAR_TRN - Errors detected!

    Posted Apr 01, 2016 01:18 PM

    Hello All,

     

    I have situation where have just imported data warehouse schema and trying to run 1st run of load data warehouse job which is failing with below error log. Have no clue why its failing. Load access right job works fine.

    Let me know if any ideas to troubleshoot this. Thanks.

     

    INFO 2016-04-01 12:10:12,973 [Thread-261] dwh.event dwh_etl_master - Start of job execution

    INFO 2016-04-01 12:10:16,592 [dwh_jb_pre_execution UUID: 9e88fb28-c6cb-498d-b300-4a494d6b9dc8] dwh.event audit table name - & DWH_CFG_AUDIT

    INFO 2016-04-01 12:10:16,592 [dwh_jb_pre_execution UUID: 9e88fb28-c6cb-498d-b300-4a494d6b9dc8] dwh.event audit table name - & DWH_CFG_AUDIT

    INFO 2016-04-01 12:10:16,592 [dwh_jb_pre_execution UUID: 9e88fb28-c6cb-498d-b300-4a494d6b9dc8] dwh.event audit table name - & DWH_CFG_AUDIT

    INFO 2016-04-01 12:10:16,593 [dwh_jb_pre_execution UUID: 9e88fb28-c6cb-498d-b300-4a494d6b9dc8] dwh.event audit table name - & DWH_CFG_AUDIT

    INFO 2016-04-01 12:10:16,593 [dwh_jb_pre_execution UUID: 9e88fb28-c6cb-498d-b300-4a494d6b9dc8] dwh.event audit table name - & DWH_CFG_AUDIT

     

    ERROR 2016-04-01 12:10:16,886 [DWH_CMN_PRD_VAR_TRN - Join Rows (cartesian product)] dwh.event Join Rows (cartesian product) - Unexpected error

    ERROR 2016-04-01 12:10:16,900 [DWH_CMN_PRD_VAR_TRN - Join Rows (cartesian product)] dwh.event Join Rows (cartesian product) - org.pentaho.di.core.exception.KettleException:

    Error creating temporary file(s) :

    No such file or directory

    at org.pentaho.di.trans.steps.joinrows.JoinRows.initialize(JoinRows.java:137)

    at org.pentaho.di.trans.steps.joinrows.JoinRows.processRow(JoinRows.java:276)

    at org.pentaho.di.trans.step.RunThread.run(RunThread.java:60)

    at java.lang.Thread.run(Thread.java:745)

    Caused by: java.io.IOException: No such file or directory

    at java.io.UnixFileSystem.createFileExclusively(Native Method)

    at java.io.File.createNewFile(File.java:1006)

    at java.io.File.createTempFile(File.java:1989)

    at org.pentaho.di.trans.steps.joinrows.JoinRows.initialize(JoinRows.java:120)



  • 2.  Re: DWH Load Job is Failing - DWH_CMN_PRD_VAR_TRN - Errors detected!
    Best Answer

    Broadcom Employee
    Posted Apr 01, 2016 02:24 PM

    Hi Kumu

     

    It looks like the error is when creating temporary files in your filesystem. This will occur if you your java.io.tmpdir is not set up properly, or it uses the default OS values, which do not get resolved as they should.


    Please check the following default values for java.io.tmpdir:
    1. If your server is on Windows if your System Environmental variables TMP and TEMP are set, and if yes, that the folder is available and accessible
    2. If on linux, that /tmp is available and accessible

     

    If you see an issue (missing variable or folder), please correct and re-run the job.

     

    If you don't see where the issue is coming from, please do the following:

     

    1. In your properties.xml please add the following line to App and BG Server JVM properties:

    -Djava.io.tmpdir=<pathname>

    (Here is an example of the path, and there is no need to use the same name/path, please just ensure the path you are using is resolving to an existing folder, which the user running the PPM service is able to access).

    How it will look for -Djava.io.tmpdir=c:\javatmp:

    <applicationServerInstance id="app" serviceName="Niku Server" rmiPort="23791" jvmParameters="-Xms2176m -Xmx2176m -XX:MaxPermSize=192m -Dsun.lang.ClassLoader.allowArraySyntax=true -XX:-UseGCOverheadLimit"
    [..]
    <backgroundServer jvmParameters="-Xms1024m -Xmx1024m -XX:MaxPermSize=192m -XX:-UseGCOverheadLimit"
    

    Change to:

    <applicationServerInstance id="app" serviceName="Niku Server" rmiPort="23791" jvmParameters="-Xms2176m -Xmx2176m -XX:MaxPermSize=192m -Dsun.lang.ClassLoader.allowArraySyntax=true -XX:-UseGCOverheadLimit -Djava.io.tmpdir=c:\javatmp"
    [..]
    <backgroundServer jvmParameters="-Xms1024m -Xmx1024m -XX:MaxPermSize=192m -XX:-UseGCOverheadLimit -Djava.io.tmpdir=c:\javatmp"
    

    2. Save and restart the services

    3. Re-run the job again (Load Data Warehouse - Full Load).

     

    Please let me know how it goes.

     

    Kind Regards

    Nika Hadzhikidi



  • 3.  Re: DWH Load Job is Failing - DWH_CMN_PRD_VAR_TRN - Errors detected!

    Posted Apr 04, 2016 10:01 AM

    Hi NIka - You got it nicely... The "javatmp" directory wasn't exists on server, I created and set appropriate privileges that worked. I was looking for /tmp directory initially.

     

    Thank you so much again for your help..!!