Hi
Please, check the Memory Maximum Heap Size set in your application server where CA Identity Manager is deployed in two moments: when application server starts and when having the performance issue. If windows OS the tool task manager or tool top in Linux
It's recommend open a support case to deep research the root cause of this problem.