Tech Tip: HOTFIX to update the partition interval and allow 2017 csv files to be included in Data Manager pre-staging tables (DE269337)

Document created by biecl01 Employee on Feb 22, 2017
Version 1Show Document
  • View in full screen mode

Problem: The capman_da probe was unable to upload the csv files generated in 2017 into the Data Manager database pre-staging tables.

Reason: If you partitioned the CCC database as explained in the CCC 2.94 documentation,

the partitioning interval will prevent the 2017 csv files from entering the Data Manager pre-staging tables.

Solution: Use the attached script to update the partition interval. Follow these steps:

  1. Ensure that there is no staging, migration or rollup process in progress.
  2. Log in to the Data Manager and go to Configuration Settings.
  3. Select Global Parameters.
  4. Make a note of the value currently set for the NUMBER_DAYS_PRESTAGE_DATA_RETAINED parameter. Then set this parameter to the number of days the files are old. For example, if the files are a month old, set the parameter to 31.
  5. Open the configuration window of the capman_da probe, and go to data_output_setup.
  6. Make a note of the value currently set for the cleanup_archive_interval_in_days parameter. Then set this parameter to the number of days the files are old.
  7. Go to the Services panel and stop the Apache Tomcat service.
  8. Open SQL Developer and connect to the DM/CCC database.
  9. Copy and paste the script into SQL Developer, and execute it.
  10. Go to the Services panel and start the Apache Tomcat service.
  11. Use the following query to verify that the interval has been updated. The interval should now be updated to 10.
    "select * from PARTITION_TABLES where table_name='PRE_STAGING_ENTITY_METRICS';"

    After the files have been successfully uploaded, perform the following actions:
  12. Stage and migrate uploaded data.
  13. Once the data is successfully uploaded to staging and migration tables, reset NUMBER_DAYS_PRESTAGE_DATA_RETAINED in the Data Manager and cleanup_archive_interval_in_days in the capman_da probe to their previous values.

Outcomes