Clarity

Expand all | Collapse all

DMS-02104: The system cannot retrieve the requested document from the DMS

Deactivated User

Deactivated UserNov 05, 2012 04:41 AM

  • 1.  DMS-02104: The system cannot retrieve the requested document from the DMS

    Posted Nov 04, 2012 03:44 AM
    HI Experts,

    I have copied out the clarity12.1home directory(in production) to a test box in order to practise 13.1 installation.

    OUR ISSUE: Cannot access documents from filestore.

    ERROR: DMS-02104: The system cannot retrieve the requested document from the DMS. Contact your system administrator.

    STEPS TAKEN:

    1. Ran below command. Then tried opening a document. No success.
    nikuadmin recreate index commands

    2. Next, we ran the job;Index contents and documents for searches job several times till it completed . Then tried opening a document. No success.

    Not sure what to do next...
    Please help.

    Deepu.


  • 2.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 12:49 AM
    What is the path set for storing documents in NSA ?

    NJ


  • 3.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 01:02 AM
    Hi NJ,

    Answering for Deepu ---->

    We have attached the Documents tab from NSA here. Please take a look at it.

    The filestore and index directory locations are accessible to clarity. Because we could see that the interactive portlet that didn't display anything before migrating the doc filestore and fixing these paths, is now showing results, meaning it recognizes the .swf file :)

    But the problem is that no docs in the knowledge store are accessible to us. Please see the scrnshots.

    Thanks for your time,
    Georgy


  • 4.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 01:17 AM
    "STEPS TAKEN:

    1. Ran below command. Then tried opening a document. No success.
    nikuadmin recreate index commands

    2. Next, we ran the job;Index contents and documents for searches job several times till it completed . Then tried opening a document. No success."

    Did you restart the app after performing steps 1 and 2 ?

    NJ


  • 5.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 01:23 AM
    Hi NJ,

    Yes, we restarted all the services after these 2 steps.

    Same result :(


    Thanks,
    Georgy


  • 6.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 01:37 AM
    Hi Georgy

    Have you checked the logs as well ?

    Please check these -

    99304801

    98946493

    2287008



    NJ


  • 7.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 01:42 AM
    Hi NJ,

    yes...we were looking into logs too.

    I just initiated the index job again now and its failing now...See the error log from bg-niku.log
    ERROR 2012-11-04 22:36:30,513 [Dispatch Thread-24 : bg@AST-VM-CF] search.index (none:none:none) optimize - IO problem
    java.io.IOException: Lock obtain timed out: Lock@C:\Windows\system32\config\systemprofile\AppData\Local\Temp\lucene-e3e6e18b83fd0e65bbe0530d03b9142e-write.lock
    
    at org.apache.lucene.store.Lock.obtain(Lock.java:58)
    
    at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:223)
    
    at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:173)
    
    at com.niku.search.engine.lucene.LuceneIndexEngine.optimizeIndex(LuceneIndexEngine.java:628)
    
    at com.niku.search.engine.lucene.LuceneIndexEngine.optimizeSearchContentIndex(LuceneIndexEngine.java:612)
    
    at com.niku.search.engine.lucene.LuceneIndexEngine.index(LuceneIndexEngine.java:700)
    
    at com.niku.search.nspider.Nspider.scheduledEventFired(Nspider.java:170)
    
    at com.niku.njs.Dispatcher$BGTask.run(Dispatcher.java:277)
    
    at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:727)
    
    at java.lang.Thread.run(Thread.java:619)
    ERROR 2012-11-04 22:36:30,513 [Dispatch Thread-24 : bg@AST-VM-CF] search.index (none:none:none) scheduledEventFired
    com.niku.search.util.SearchException: SRCH-01003: Error occurred while indexing search contents.
    
    at com.niku.search.engine.lucene.LuceneIndexEngine.optimizeIndex(LuceneIndexEngine.java:635)
    
    at com.niku.search.engine.lucene.LuceneIndexEngine.optimizeSearchContentIndex(LuceneIndexEngine.java:612)
    
    at com.niku.search.engine.lucene.LuceneIndexEngine.index(LuceneIndexEngine.java:700)
    
    at com.niku.search.nspider.Nspider.scheduledEventFired(Nspider.java:170)
    
    at com.niku.njs.Dispatcher$BGTask.run(Dispatcher.java:277)
    
    at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:727)
    
    at java.lang.Thread.run(Thread.java:619)
    Caused by: java.io.IOException: Lock obtain timed out: Lock@C:\Windows\system32\config\systemprofile\AppData\Local\Temp\lucene-e3e6e18b83fd0e65bbe0530d03b9142e-write.lock
    
    at org.apache.lucene.store.Lock.obtain(Lock.java:58)
    
    at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:223)
    
    at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:173)
    
    at com.niku.search.engine.lucene.LuceneIndexEngine.optimizeIndex(LuceneIndexEngine.java:628)
    
    ... 6 more
    ERROR 2012-11-04 22:36:30,513 [Dispatch Thread-24 : bg@AST-VM-CF] niku.njs (none:none:none) Error executing job: 5072066
    com.niku.search.util.SearchException: SRCH-01003: Error occurred while indexing search contents.
    
    at com.niku.search.engine.lucene.LuceneIndexEngine.optimizeIndex(LuceneIndexEngine.java:635)
    
    at com.niku.search.engine.lucene.LuceneIndexEngine.optimizeSearchContentIndex(LuceneIndexEngine.java:612)
    
    at com.niku.search.engine.lucene.LuceneIndexEngine.index(LuceneIndexEngine.java:700)
    
    at com.niku.search.nspider.Nspider.scheduledEventFired(Nspider.java:170)
    
    at com.niku.njs.Dispatcher$BGTask.run(Dispatcher.java:277)
    
    at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(PooledExecutor.java:727)
    
    at java.lang.Thread.run(Thread.java:619)
    Caused by: java.io.IOException: Lock obtain timed out: Lock@C:\Windows\system32\config\systemprofile\AppData\Local\Temp\lucene-e3e6e18b83fd0e65bbe0530d03b9142e-write.lock
    
    at org.apache.lucene.store.Lock.obtain(Lock.java:58)
    
    at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:223)
    
    at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:173)
    
    at com.niku.search.engine.lucene.LuceneIndexEngine.optimizeIndex(LuceneIndexEngine.java:628)
    
    
    ... 6 more
    Thanks,
    Georgy


  • 8.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 01:44 AM


  • 9.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 04:37 AM
    Hi NJ,

    Thanks a lot for the links! We resolved the above lock timeout error by following the steps mentioned in :
    99304801

    Now the index job is not failing and it runs to completion from Clarity :)

    We tried again after restarting all the services but we still face the DMS-02104 document manager error.

    Thanks,
    Georgy


  • 10.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 04:41 AM
    Which OS is that?

    Martti K.


  • 11.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 04:55 AM
    Hi Martti,

    We are using

    App server: Windows Server 2008 R2 Standard SP1 (64 bit)

    Database: MS SQL Server 2008 R2.

    Clarity Version/Build : 12.1.0.5840

    Thanks,
    Georgy


  • 12.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 05:12 AM
    I checked this -

    2280516

    Check the last post -

    "Sounds as if the job just handles the Clarity part which would be all if you had you documents in the database.
    If that is the case you would have to pin point the files and manually delete them (what a drag).
    Some thing similar happened in 6.14 - 7.02 if you had you files in files store and switched the setting to database.
    Everything disappeared and even if you switched back you did not get your documetns back until you rebuild your
    s e a r c h indices.

    Martti K."

    Can you try running the below commands again ?

    nikuadmin search recreate-index-files -verbose
    nikuadmin search recreate-index-data -verbose

    NJ


  • 13.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 05:48 AM
    Hi NJ,

    I ran the 2 recreate index commands. We still have the DMS error!

    And when i checked the nspider-niku.log , i could see the following lines as a result of the recreate-index-files -verbose command:-
    WARN  2012-11-05 02:28:33,257 [main] search.index (none:none:none) indexFileList - Error getting File contents: id=5035443 name=Project_Charter_FINAL.docx
    WARN  2012-11-05 02:28:33,257 [main] search.index (none:none:none) indexFileList - Error getting File contents: id=5035451 name=Member Portal Expanded Benefits.pptx
    WARN  2012-11-05 02:28:33,257 [main] search.index (none:none:none) indexFileList - Error getting File contents: id=5035877 name=High-level Task List - Budget Est.xlsx
    WARN  2012-11-05 02:28:33,257 [main] search.index (none:none:none) indexFileList - Error getting File contents: id=5035882 name=Expanded Rate Renewal.doc
    ...........
    WARN  2012-11-05 02:28:33,257 [main] search.index (none:none:none) indexFileList - Error getting File contents: id=5035920 name=Change Request - 20120904.pptx
    WARN  2012-11-05 02:28:33,273 [main] search.index (none:none:none) indexFileList - Error getting File contents: id=5036009 name=Funding Request - 092412.pptx
    There are almost 372 error lines like this. :sad


    Thanks,
    Georgy


  • 14.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 05:57 AM
    Georgy

    Can you check what level of access does the user have on filestore directory ?

    Can you check if the level of access can be changed to Full Control, and then see if the issue still persists ?

    NJ


  • 15.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 06:23 AM
    Is it a clustered environment ?

    If yes, is there an NFS mount done, or, a symbolic link created ?

    NJ


  • 16.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 06:40 AM
    Hi NJ,

    No, its not a clustered environment. And there is no NFS mount or symlink either!

    In this windows app server, we have :-

    NIKU_HOME = C:\ClarityHome\Clarity\
    Filestore = C:\niku\clarity\filestore


    Thanks,
    Georgy


  • 17.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 12:25 PM
    Hello,

    I do not know if the following will help or not but just in case it might here is a doc I located that might apply. I know you have done some of the actions referenced in the doc however perhaps it might shed more light on the problem.

    Also, sometimes turning on debug can give some clues to these document search issues. I'll put those instructions below too. If any of this is redundant, I apologize!

    The Change and Impact Guide also might be helpful.

    ~dana


    1st doc:


    Filestore and Search Index location changes in Clarity v13
    Summary:

    There are two significant changes to the Clarity V13 upgrade process that directly affect the file store feature. These changes require action during the upgrade process to ensure that this feature operates correctly after the upgrade. These changes are necessary if the files are not stored in the database. If files are stored in the database then no action is required. Determining if files are stored in the database can be done by using the Clarity System Administration application. Login to the application and navigate to the Documents and Search link under the Properties tab. Review the Store Files in Database property.

    If the database has not been used as the filestore repository , action must be taken. Failure to follow these steps can potentially lead to permanent loss of the file store contents. The changes are as follows:

    1.
    The upgrade process in Clarity V13 always installs to an empty destination folder. During upgrade, any files and folders that exist in the target install folder are moved to a new location before the new files are installed. If the file store folder is located in the Clarity runtime folder it will be moved along with the other Clarity content. If the file store is located anywhere outside the Clarity runtime folder (which is the recommended configuration), then the filestore location will not need to be moved or copied from the backup location.
    2.
    The file store and search index folder structures have been altered slightly to accommodate architectural changes in Clarity V13. This change requires action for all Clarity V13 upgrades, regardless of whether the filestore was located in the Clarity installation folder or not.


    The course of action depends on two factors: where the file store was prior to upgrade, and the target install folder selected during the upgrade. The correction must be made immediately after the upgrade completes, prior to any files being added to the file store. Any files added to the file store before this correction is made must be manually preserved using the following steps:

    1.
    Use Clarity to retrieve the newly checked-in documents and save them to a temporary location on the file system.
    2.
    Perform the steps indicated by case 1, 2, or 3 below.
    3.
    Use Clarity to check the saved documents back into the Clarity file store.
    4.
    Execute the following commands from the <runtime>/bin folder:

    ‘admin search recreate-index-files’
    ‘admin search recreate-index-data’
    Filestore and Search Index Correction Procedure

    Before you start, ensure that a backup has been created of the filestore so that recovery is possible in the event of an unexpected problem. As noted in the previous section, if your document store has been used before completing this procedure, the newly added documents must be added back to the filestore after completing the following procedure.
    The following scenarios illustrate the actions to be taken because of the changes cited above. Use the "File store location" and "Target install folder" to determine the correct course of action.

    1)
    File store location: The file store was located in the Clarity runtime folder prior to upgrade.
    Target install folder: The existing (pre-upgrade) Clarity runtime folder was selected as the target install folder.
    Prior to the upgrade process running, the file or index folder is in the <runtime> folder and the upgrade process has moved it to a folder called <runtime>prev based on the chosen upgrade install option. The move has resulted in the file or index folder being located in the <runtime>prev folder. The file or index folder MUST be moved from the <runtime>_prev folder to another location because any subsequent upgrade attempt will delete this folder. Here are the steps to perform for this use case:

    a.
    If prior to the upgrade the file store location was <runtime>/filestore, copy or move the folders under <runtime>_prev/filestore to  a new path:

    <new directory>/filestore/clarity

    where <new directory> is located outside of the upgrade resulting <runtime> directory (having the location outside of the runtime folder follows best practices) . Ensuring the folder is outside of the Clarity installation directory will also ensure that this process will not have to be repeated in the future when Clarity is upgraded again. Login to the Clarity System Administration application and navigate to the Documents and Search link under the Properties tab and change the Filestore Directory location to the new location. For example if the file store path is <old clarity install directory>/filestore then it needs to be modified to <new directory>/filestore. Note: ‘clarity’ should not be appended to the path in the CSA. This is added internally by the Clarity architecture.
    b.
    If prior to the upgrade the search index directory location was <runtime>/searchindex , copy or move the folders under <runtime>_prev/searchindex  to  a new path:

    <new directory>/ searchindex /clarity

    where <new directory> is located outside of the upgrade resulting <runtime> directory (having the location outside of the runtime folder follows best practices) . Login to the Clarity System Administration application and navigate to the Documents and Search link under the Properties tab and change the Index Directory location to the new location. For example if the file store path is <old clarity install directory>/searchindex then it needs to be modified to <new directory>/searchindex. Note: ‘clarity’ should not be appended to the path in the CSA. This is added internally by the Clarity architecture.
    c.
    Execute the following command from the <runtime>/bin folder:

    ‘admin search recreate-index-files’
    ‘admin search recreate-index-data’


    2)
    File store location: The file store was located in the Clarity runtime folder prior to upgrade.
    Target install folder: A new, empty folder was selected as the target install folder.
    Prior to the upgrade process running, the file or index folder is located in the <runtime> folder and the upgrade process produced a different folder called <new runtime> based on the upgrade install option to choose a different folder for the upgrade result than the current one. This has resulted in the file or index folder being located in the <runtime> folder. Here are the steps to perform for this use case:

    a.
    If prior to the upgrade the file store location was <runtime>/filestore, copy or move the folders under <runtime>/filestore to a new path:

    <new directory>/filestore/clarity

    where <new directory> is located outside of the upgrade resulting <runtime> directory (having the location outside of the runtime folder follows best practices) . Ensuring the folder is outside of the Clarity installation directory will also ensure that this process will not have to be repeated in the future when Clarity is upgraded again. Login to the Clarity System Administration application and navigate to the Documents and Search link under the Properties tab and change the Filestore Directory location to the new location. For example if the file store path is <old clarity install directory>/filestore then it needs to be modified to <new directory>/filestore. Note: ‘clarity’ should not be appended to the path in the CSA. This is added internally by the Clarity architecture.
    b.
    If prior to the upgrade the search index directory location was <runtime>/searchindex , copy or move the folders under <runtime>/searchindex to a new path:

    <new directory>/ searchindex /clarity

    where <new directory> is located outside of the upgrade resulting <runtime> directory (having the location outside of the runtime folder follows best practices) . Login to the Clarity System Administration application and navigate to the Documents and Search link under the Properties tab and change the Index Directory location to the new location. For example if the file store path is <old clarity install directory>/searchindex then it needs to be modified to <new directory>/searchindex. Note: ‘clarity’ should not be added to the path. This is added internally by the Clarity architecture.
    c.
    Execute the following command from the <runtime>/bin folder:

    ‘admin search recreate-index-files’
    ‘admin search recreate-index-data’

    3)
    File store location: The file store was located outside Clarity runtime folder prior to upgrade.
    Target install folder: The target install folder is not relevant to this scenario. These steps must be performed for all upgrades with an external file store.
    The file or index folder is not located in the <runtime> folder. Here are the steps to perform for this use case:
    a.
    If the previous file store folder path is now located at <some folder>/filestore, copy or move the folders under <some folder>/filestore to a new path:

    <some folder>/filestore/clarity

    b.
    If the previous search index folder path is now located at <some folder>/searchindex, copy or move the folders under <some folder>/seachindex to a new path:

    <some folder>/seachindex/clarity

    c.
    Execute the following command from the <runtime>/bin folder:

    ‘admin search recreate-index-files’
    ‘admin search recreate-index-data’

    d.
    No modification to the Filestore Directory or Index Directory properties is needed. These properties can be viewed from the Properties tab, Documents and Search subtab in the Clarity System Administration application Note: ‘clarity’ should not be added to the path in the CSA. This is added internally by the Clarity architecture.




    Doc 2


    Turn on debugging in the CSA for DMS

    1. In the CSA click on the icons for Logs.

    2. Next screen up near the top but under the word Services
    click on Edit Configuration

    3. Next screen scroll down to the Categories section and
    click on Add Category

    4. Next you will see at the bottom now, com.niku. Click on the
    little arrow and choose com.niku.dms

    5. Now in the column that says 'Appender' it should default to 'STDOUT'
    and in the next column' Priority' click the arrow and choose 'Debug'.

    6. Scroll down and click Save.


  • 18.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 05, 2012 06:31 AM
    Hi NJ,

    Thanks for looking further into this!

    We are logged in as Administrator to the App server. The user already has full control over the filestore directory.

    In clarity, we log in using the admin account and he has all the possible global rights!

    Thanks,
    Georgy


  • 19.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 06, 2012 12:22 AM
    What access has been granted to the admin for Knowledgestore ?

    NJ


  • 20.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 06, 2012 02:08 AM
    Also, in the System Options, is the "Allow Non-participants to Access Documents" set to Yes / No ? If set to No, can you set it to Yes, and check ?

    NJ


  • 21.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Nov 06, 2012 05:10 AM
    Hi NJ,

    Thanks a lot for your time. Yes, we tried that too and even ticked the Download option and tried to download some docs. Its not working still.

    We later checked out again with the customer and they just confirmed that the filestore backup they gave was not complete :blink:

    We will restore the filestore again and we are sure that will fix all these issues. We will keep you all posted!

    Thanks a ton for all the suggestions,
    Georgy


  • 22.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Jan 02, 2013 11:43 PM
    Hi Georgy,

    I am facing exactly the same issue in opening existing knowledge store document. Have you resolved it? If yes, could you please guide me?

    Thanks,
    Uruj


  • 23.  RE: MS-02104: The system cannot retrieve the requested document from the DM
    Best Answer

    Posted Jan 03, 2013 02:08 AM
    Hi Uruj,

    We have resolved the issue.

    Basically we had to do some necessary steps before the v13.1 upgrade as mentioned in the section "Filestore and Search Index Location Changes" in the Change Impact and Upgrade guide. The section explains the steps to follow based on
    ■ Where the filestore was before the upgrade
    ■ The target installation folder that is selected during the upgrade

    There are 3 cases (A,B and C) under the above section, which are based on the above settings and you just have to decide which is your scenario and do the required steps in that scenario.

    For us, our Filestore was located outside the runtime folder before upgrade, so all we had to do was to move the folders under <some folder>/filestore to a new path:- <some folder>/filestore/clarity. We had no issues accessing the files after the upgrade was done.

    Hope this will resolve your issue.

    Thanks,
    Georgy


  • 24.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Jan 04, 2013 03:51 AM
    Hi,

    The issue has been resolved. We were doing the same but the files were not properly copied and hence some files were missing.

    Regards,
    Uruj


  • 25.  RE: MS-02104: The system cannot retrieve the requested document from the DM

    Posted Jan 08, 2014 09:50 AM

    Hello Uruj Hi Georgy,

     

    I also got the same problem i am not able to download the Doc from Knowledge store and also Rate matrix job is also getting failed!

    Please share and help me out with the solutions you have done to resolve your problem.

    Thanks

    Awadhesh



  • 26.  Re: DMS-02104: The system cannot retrieve the requested document from the DMS

    Posted Oct 13, 2016 04:30 PM

    Dear All,

     

    Thank you for all the contribution and information every are sharing here.

     

    I have received the same error, but this time when I'm trying to access where old document from Collaboration -- Documents tab.

     

    I also verified the file store and search index paths , and every this is as expected.

     

     

    The documents were created some where in Mar 2015 and we got upgraded to 14.2 In Nov 2015.

     

    Any help or suggestion would be highly appreciable.

     

    Thanks,

    sai krishna.K