Clarity

Expand all | Collapse all

CA PPM Tech Tip: How should the main PPM jobs be scheduled?

navzjoshi00

navzjoshi00Nov 26, 2014 12:02 AM

  • 1.  CA PPM Tech Tip: How should the main PPM jobs be scheduled?

    Broadcom Employee
    Posted Nov 25, 2014 08:26 PM

    #The following is the suggested job scheduling for a typical PPM Production environment to accommodate business needs.
    The information provided will provide users with the most up-to-date information while providing optimal performance.


    Section 1. The following jobs will provide data to the stock portlets and reports.
    Set the duration and incompatible job list by navigating to Administration, Data Administration, Reports and Jobs and filtering for the job in question.

     

     

    JobDuration/PurposeNotes/Job Incompatibility List
    Time SlicingRun every minute.

     

    Get time-sliced data available various internal and external slice tables.

     

    Examples:

    PRJ_BLB_SLICES
    PRJ_BLB_SLICES_M_ALC

    Datamart Extraction (Default)

    Delete Investments (Default)

    Datamart Rollup (Default)


     

    Investment Allocation  

    Run only once per day, before the full Rate Matrix Extraction job

     

    Populates the project list page.
    Updates PRASSIGNMENT
    Updates INV_INVESTMENTS

     

     

    Load Data Warehouse

     

    Financial Module Jobs

     

    -Post Transactions to Financials

     

     

    -Post to WIP

    Run in sequential order
    a.Post Timesheets

    b.Post Transactions to Financials

    c.Post to WIP


    Obtain realized actuals in PPA_WIP table.

    Rate Matrix Extraction

    The incremental run:rme - incr.JPG

    Rate Matrix Extraction (Incremental run) which runs with options:

    -Extract Cost for Schedulers (if needed)

    -Prepare Matrix Data

    -Update Matrix Data

    -Incremental

     

    2. The full run:
    rme - full.JPG

    Rate Matrix Extraction (full) which runs with options:

    -Extract Cost for Schedulers (if needed)

    -Prepare Matrix Data

    -Update Matrix Data

     

    Run nightly at least once.


    Do not run the full run duing Production hours.


    This job must complete before an instance of the Post Timesheets job run.

     

    The job provides rates to the Post Timesheets job and baseline actions.

    The following actions to obtain rates can be performed after the incremental or full Rate Matrix Extraction job completes:

    -Post Timesheets job

    -Baseline a project

    -Baseline a task

    -Update Earned Value Totals

    -Update Earned Value History

    -Open project in OWB/MSP

    Reporting Jobs

     

    -Update Report Tables

     

    -Load Data Warehouse Access Rights

     

    -Load Data Warehouse
    1. Run incrementally (without the "full load"parameter) at key times during work day.

      ldw - inc.JPG
    2. Run with the "Full load" parameter nightly.

    hhttps://communities.ca.com/thread/241730797CA PPM Tech Tip: Getting Jaspersoft Advanced Reporting to work after upgrading to 14.2+

     

     

     


    Section 2. Jaspersoft Reports jobs.

     

    Run the following jobs to get the Jaspersoft Advanced Reporting domains/reports populated.

    -Update Report Tables
    -Load Data Warehouse
    -Load Data Warehouse Access Rights

     

    Section 3.
    If the financial posting module is used, be sure to follow the sequence of actions depending on the type of transaction.
    The full Rate Matrix Extraction job will need to run and complete before any of the posting jobs are ran.

    Transaction originCorrecting/Adjusting the transaction

    For timesheet transactions,
    a. Post TImesheets

    b. Post Transactions to Financials

    c. Post to WIP (if XOG/manual transactions). This job is not listed in Reports and Jobs > Available but from Home > Financial Management

    To adjust a timesheet transaction,
    a.Perform a timesheet adjustment. (The timesheet needs to be changed in order for the Post Timesheets job to process the adjustment.

    b.Run the following jobs:
    -Post Timesheets

    -Post Transactions to Financials

    -Post to WIP

     


    NOTE:
    If there are no changes in timesheet hours, WIP adjustments with the 'Calculate New Rates' option can be performed.

     

    If there are changes in hours, do NOT perform a WIP adjustment on timesheet transactions.

     

    Do not perform the adjustment until it is identified that there is a mismatch between these
    PRASSIGNMENT.actcost_sum and PPA_WIP_VALUES.AMOUNT
    as the mismatch needs to be corrected the first.

     

    Take caution because if the assignment actual cost is already not matching WIP, this method will not fix the amount, but will just adjust it based on what changed in WIP.
    For example, if the assignment cost = $100 and WIP cost = $150 for same transaction

     

    (PRASSIGNMENT.actcost_sum = 100 vs. PPA_WIP_VALUES.AMOUNT = 150)
    If you WIP adjust the transaction for +$25, the actual cost is now $175.

    For manual transactions,

    a. Post to WIP

    b. Import Financial Actuals

    To adjust a manual transaction,

    a. Home > Financial Management > Create WIP Adjustment
    -Set 'Quantity' to be the desired number of hours (never a negative quantity)
    -Set 'Cost' to be the desired actual cost rate (never a negative rate)
    -Checkmark 'Calculate New Rates'
    b. Approve the adjustment via Home > Financial Management > Approve WIP Adjustment

    For XOG transactions,

    a. Post Transactions to Financials

    b. Post to WIP
    c. Import Financial Actuals

    To adjust a XOG transaction,

    a. Home > Financial Management > Create WIP Adjustment

    b. Home > Financial Management > Approve WIP Adjustment



  • 2.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Posted Nov 26, 2014 12:02 AM

    Thanks for sharing this, Tuan

     

    NJ



  • 3.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Posted Nov 26, 2014 09:15 AM

    Thanks,

     

    Time slicing is run once a minute OOTB. That is fine if it completes under one minute.

    Some people say it take so long that they only run it once a night or once a week.

    That is their choice of having data updated.

     

    The rate matrix extraction has two aspects

    1. Performance. If you are doing something heavy you get that done slightly faster if you do not run rate matrix extraction.

    2. During the update you may get inconsistent results while data is being updated. No problem during the extract and prepare. In the system I am looking at the total job takes say 3 hours and the update only say 10 minutes.

     

    Just wondering why

    The full Rate Matrix Extraction job must complete before the Post Timesheets job runs.

    Isn't it the Post transactions to financials that puts the rates to the hours?



  • 4.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Posted Nov 26, 2014 09:22 AM

    ... further the new admins are not familiar with when the jobs should be run and with incompatibilities and therefore any incompatibility setting CA sees appropriate should be set OOTB and the same goes for the schedules.

     

    (Like we delivered it like this and that is all wrong you should have like that)



  • 5.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Broadcom Employee
    Posted Nov 26, 2014 12:40 PM

    The Post Timesheets (PT) job obtains the rate from the

    a. NBI_PROJ_RES_AND_RATES_AND_COSTSCP, which is populated when the RME parameter "Prepare Matrix Data" is selected.

    b. NBI_PROJ_RES_AND_RATES_AND_COSTS, which is populated when the RME parameter "Update Matrix Data" is selected.

     

    The Post Transactions to Financials (PTF) job obtains the rate from the live matrix,

    which is found in PPA_MATRIX/PPA_MATRIXVALUES.



  • 6.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Posted Nov 26, 2014 04:00 PM

    Thanks. So it goes to IMP_TRANSACTIONIMPORT and in there  IMP_TRANSACTIONIMPORT.COST



  • 7.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Posted Nov 27, 2014 12:07 AM

    Thanks Martti / Tuan for this wonderful insight

     

    Just to clear my understanding, the job sequence is as follows  -


    1. Time slicing is run once a minute OOTB - This is fine

    2. Investment Allocation job should only run once per day

    3. * Rate Matrix Extraction (aka Full run) with below mentioned job parameters {off-peak}

         -Extract Cost for Schedulers (if needed)

         -Prepare Matrix Data (NBI_PROJ_RES_AND_RATES_AND_COSTSCP is populated)

         -Update Matrix Data (NBI_PROJ_RES_AND_RATES_AND_COSTS is populated)

    4. * Datamart Extraction {off-peak}

    5. * Datamart Rollup {off-peak}

    6. * Rate Matrix Extraction (aka Incremental run) with below mentioned job parameters

         -Extract Cost for Schedulers (if needed)

         -Prepare Matrix Data

         -Update Matrix Data

         -Incremental 

    7. * Post Timesheets - When this is run, data goes into IMP_TRANSACTIONIMPORT, and it picks up which rate ?

    8. Purge Temporary Aggregated Data

    9. * Update Aggregated Data

    10. Update Earned Value History

    11. Update Earned Value Totals

    12. Create Earned-Value Snapshots

    13. Update Business Objects Report Tables job

    14. * Post Transactions to Financials - If this obtains the rate from the live matrix,which is found in PPA_MATRIX/PPA_MATRIXVALUES, then what is the purpose of Post Timesheets obtaining the rate ?

    15. Post to Wip (listed on home side, not listed in reports and jobs)

    16. * Import Financial Actuals


    And - So it goes to IMP_TRANSACTIONIMPORT and in there IMP_TRANSACTIONIMPORT.COST - What goes into "IMP_TRANSACTIONIMPORT.COST" ?

     

    NJ



  • 8.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Posted Nov 27, 2014 05:38 AM

    urmas wrote:

     

    Time slicing is run once a minute OOTB. That is fine if it completes under one minute.

    Some people say it take so long that they only run it once a night or once a week.

    That is their choice of having data updated.

     

     

    "Time Slicing" can't win!   

     

    The reason that it would take "so long" to run is because you only run it "once a week", run it "all the time" and most of the time it is doing nothing. It is only ever "long-running" when it has a lot of work to do - for example that you have not run it for a week   (but more usually when we have mass-updated some data, or at week/month/year "rollover") - a legitimate functional complaint would be about that rollover long-running of the job if you were working in a global instance (since the argument that you schedule timeslicing to run at a minute past midnight (to cater for the rollover) doesn't really work when "midnight" is relative to where your users are and where your server is, which may not be the same timezone - as a Clarity administrator you would just have to think about that a bit).



  • 9.  Re: CA PPM Tech Tip: How should the main PPM jobs be scheduled?

    Posted Jan 15, 2016 01:38 PM

    Urmas,

     

    Great question.

     

    The reason why the rates must be extracted before posting timesheets, is because the Post Timesheets job not only post hours, it is also responsible for calculating a field called "Actual Cost". This field was implemented to help customers who do not post to WIP, to gauge investment cost at a *high level* (I wish it was named differently, avoiding the word 'actual'). You would see this Actual Cost in places like task list, it's stored on in a curve (BLOB) on prassignment.

     

    The only things that are considered in this calculation are project+resource+role+dates and nothing else such as Transaction Class, and the Post Timesheets job does this calculation using a group of rates prepared by the Rate Matrix job in the nbi_proj_res_rates_and_costs table. This group of rates are identified with task ID being '-1'. Because this field is showing a high level calculation as opposed to the very granular calculation in WIP, it's not for comparing against WIP. There may be a KB explaining Actual Cost...

     

    Not to go off too far about Actual Cost... does this answer your question?

     

    Connie



  • 10.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

     
    Posted Nov 26, 2014 12:55 PM

    Thanks for sharing this tip with the community Tuan!

    TUAN TRAN wrote:

     

    The following is the suggested job scheduling for a typical Clarity Production environment:

     

    1. Time Slicing job needs to run every minute.

    2. Jobs that should NOT be running during PROD hours:

    *Rate Matrix Extraction (aka Full run) which run with job parameters

         -Extract Cost for Schedulers (if needed)

         -Prepare Matrix Data

         -Update Matrix Data

    *Datamart Extraction

    *Datamart Rollup

     

    3. The following sequence of jobs  can be ran during PROD hours as business process/procedure/needs dictate:

    *Rate Matrix Extraction (aka Incremental run) which runs with options:

         -Extract Cost for Schedulers (if needed)

         -Prepare Matrix Data

         -Update Matrix Data

         -Incremental    

    *Post Timesheets

    Purge Temporary Aggregated Data

    *Update Aggregated Data

    Update Earned Value History

    Update Earned Value Totals

    Create Earned-Value Snapshots

    Update Business Objects Report Tables job

     

    4. If the financial posting module is used, be sure the following sequence is used:
    *Post Transactions to Financials;

    Post to Wip (listed on home side, not listed in reports and jobs);

    *Import Financial Actuals;

     

    5. *Investment Allocation job should only run once per day, before the full Rate Matrix Extraction job.

     

    NOTE 1: * denotes the job needs to be set as incompatible with the Time Slicing job

     

    NOTE 2:

    The following actions to obtain rates can be performed after the incremental or full Rate Matrix Extraction job completes:

    -Post Timesheets job

    -Baseline a project

    -Baseline a task

    -Update Earned Value Totals

    -Update Earned Value History

    -Open project in OWB/MSP

     

    NOTE 3:

    The full Rate Matrix Extraction job must complete before the Post Timesheets job runs.

    To enforce this best practice, set the Rate Matrix Extraction job as incompatible with the Post Timesheets job.



  • 11.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Posted Jan 12, 2015 05:39 AM

    TuanTran

    Still wondering why

     

    The full Rate Matrix Extraction job must complete before the Post Timesheets job runs.

    Isn't it the Post transactions to financials that puts the rates to the hours?

     

    PART 2

     

    The Post Timesheets (PT) job obtains the rate from the

    a. NBI_PROJ_RES_AND_RATES_AND_COSTSCP, which is populated when the RME parameter "Prepare Matrix Data" is selected.

    b. NBI_PROJ_RES_AND_RATES_AND_COSTS, which is populated when the RME parameter "Update Matrix Data" is selected.

     

    The Post Transactions to Financials (PTF) job obtains the rate from the live matrix,

    which is found in PPA_MATRIX/PPA_MATRIXVALUES.

     

    Thanks. So it goes to IMP_TRANSACTIONIMPORT and in there  IMP_TRANSACTIONIMPORT.COST

     

    Now where is that going to be used and displayed?

    If the Post Transactions to Financials (PTF) job obtains the rate from the live matrix and that job deletes the records in the IMP_TRANSACTIONIMPORT table



  • 12.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Broadcom Employee
    Posted Jan 12, 2015 11:38 AM

    The PTF job processes records in the IMP_TRANSACTIONIMPORT table.

    If it is a valid financial transaction, the records will be moved from IMP_TRANSACTIONIMPORT to PPA_TRANSCONTROL/PPA_TRANSCONTROL_VALUES.

     

    So data is not deleted, but moved to the next table, ready for the Post-to-WIP (PTW).



  • 13.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Posted Jan 12, 2015 12:52 PM

    Thanks for responding.

    Yes that is technically more accurate.

    But my question is that

    the Post Transactions to Financials (PTF) job obtains the rate from the live matrix and puts them into

    PPA_TRANSCONTROL and PPA_TRANSCONTROL_VALUES

    what are the rates that were in IMP_TRANSACTIONIMPORT used for and where are they stored and displayed?

     

    Secondly if I do Post timesheets first and Rate matrix extractino after that what do I miss when I have posted to WIP?



  • 14.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Broadcom Employee
    Posted Jan 12, 2015 05:54 PM

    Hi urmas,

     

    You're welcome.

     

    What are the rates that were in IMP_TRANSACTIONIMPORT used for and where are they stored and displayed?

     

    The Post Timesheets (PT) job obtains its rates from the NBI_COST_RES_RATES_AND_COSTS table, which change if the Rate Matrix Extracton (RME) job detects rate changes.

     

    Records in the IMP_TRANSACTIONIMPORT can change as the this table is a holding table for new and failed financial transaction records that come from timesheets and XOG. Essentially, they are what can be seen from the admin > invalid transactions page.

     

    Therefore, the rate during the time the Post Transactions to Financials (PTF) job can be different from when the PT job initially obtained the rate, which by the way, are both null, when queried.

     

    Secondly if I do Post timesheets first and Rate matrix extractino after that what do I miss when I have posted to WIP?

    If there is timing issuem, i.e. running PT before and RME, you could get an incorrect rate get passed along to PPA_WIP/PPA_WIP_VALUES, which can be corrected via a timesheet adjustment or WIP adjustment



  • 15.  Re: Clarity Tuesday Tip: How should the main Clarity jobs be scheduled?

    Posted Jan 13, 2015 03:03 PM

    Thanks again.

    Now we know. Apparently there has not been a problem yet, but this helps in looking if we have.



  • 16.  Re: CA PPM Tech Tip: How should the main PPM jobs be scheduled?

    Posted Jun 05, 2017 11:57 AM

    One thing to remember is to keep an eye on your jobs log if you are making any changes. make sure you capture all jobs in it while you are evaluating the changes. Look for any long running jobs, jobs that are waiting, etc. Sometimes jobs are scheduled and other jobs are left waiting. Mis-configured jobs, can really impact the system. 



  • 17.  Re: CA PPM Tech Tip: How should the main PPM jobs be scheduled?

    Posted Jul 26, 2017 03:01 AM

    Hi,

     

    The job "Update Report Tables" can you please provide explanation or link regarding this job?

     

    Question:- We use general live tables like PRTEAM, SRM_RESOURCES and etc., will these come under Report tables?

     

    Are there any tables which gets populates seperately when we run the "Update Report Tables" job?

     

    Thanks,

    Santosh.



  • 18.  Re: CA PPM Tech Tip: How should the main PPM jobs be scheduled?

    Broadcom Employee
    Posted Jul 26, 2017 03:33 AM

    Hi Jaya,

    Please see techdoc below:

    https://www.ca.com/us/services-support/ca-support/ca-support-online/knowledge-base-articles.tec1284752.html

    This job populates the RPT_CALENDAR, RPT_RES_SKILLS_FLAT, RPT_RES_SKILLS_INDEX, RPT_PROGRAM_HIERARCHY, RPT_INV_HIERARCHY  tables

    Some further information related to the same job:

    https://communities.ca.com/thread/241735663

    Regards,

    Joxi



  • 19.  Re: CA PPM Tech Tip: How should the main PPM jobs be scheduled?

    Posted Jul 26, 2017 04:51 AM

    Thank-you so much



  • 20.  Re: CA PPM Tech Tip: How should the main PPM jobs be scheduled?

    Posted Aug 02, 2017 05:50 AM

    Hi Jose,

     

    What is the use of having another extra tables which prefix with RPT, will these helps us in providing extra information?

     

    Thanks,

    Santosh.



  • 21.  Re: CA PPM Tech Tip: How should the main PPM jobs be scheduled?

    Broadcom Employee
    Posted Aug 02, 2017 06:01 AM

    The Update Report tables job updates the tables above:

    RPT_CALENDAR, RPT_RES_SKILLS_FLAT, RPT_RES_SKILLS_INDEX, RPT_PROGRAM_HIERARCHY, RPT_INV_HIERARCHY  tables

    Each one of them is associated to the job parameters:

    Update Reporting Calendar
    Update Investment Hierarchy
    Update WBS Index
    Update Resource Skills Index
    Update OBS

    These tables are used for reporting