Dear Leo,
As suggested I stopped the web server, verified LLAWP process and Webserver process (both were not running post stopping web server),
******************************************
root@localhost selinux]# ipcs -s
------ Semaphore Arrays --------
key semid owner perms nsems
******************************************
I am unable to remove these shared memory segments. Moreover, I tried to check any orpahned processes related to these shmid which yielded nothing.
root@localhost ~]# ipcs
------ Shared Memory Segments --------
key shmid owner perms bytes nattch status
0x00000000 950272 root 600 393216 2 dest
0x00000000 983041 root 600 393216 2 dest
0x00000000 1015810 root 600 393216 2 dest
0x00000000 1048579 root 600 393216 2 dest
0x00000000 1081348 root 600 393216 2 dest
0x00000000 1114117 root 600 393216 2 dest
0x00000000 1146886 root 600 393216 2 dest
0x00000000 1179655 root 600 393216 2 dest
0x00000000 1212424 root 600 393216 2 dest
0x00000000 1245193 root 600 393216 2 dest
0x00000000 1277962 root 600 393216 2 dest
0x00000000 1310731 root 600 393216 2 dest
0x00000000 1343500 root 600 393216 2 dest
0x00000000 1376269 root 600 393216 2 dest
0x00000000 1409038 root 600 393216 2 dest
0x00000000 1441807 root 600 393216 2 dest
0x00000000 1474576 root 600 393216 2 dest
------ Semaphore Arrays --------
key semid owner perms nsems
------ Message Queues --------
key msqid owner perms used-bytes messages
********************************************
semaphore and shared memory keys present in error.log has already been cleared(as seen above output of ipcs).
After this I started the webagent. Error_log post restarting the webagent.
****************************************************
Wed Jun 21 15:52:40 2017] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[21/Jun/2017:15:52:40] [Info] [CA WebAgent LLAWP] [3647] [LLAWP Monitor: LLAWP has been started.]
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0x6b47862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0x6b47862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Created semaphore 131074 using key 0x6b47862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smalloc] Created shared memory segment 622608 using key 0x6c47862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0xf447862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Created semaphore 163843 using key 0xf447862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0x3247862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Created semaphore 196612 using key 0x3247862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smalloc] Created shared memory segment 655377 using key 0x6147862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0x3347862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Created semaphore 229381 using key 0x3347862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smalloc] Created shared memory segment 688146 using key 0x6247862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0x3447862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Created semaphore 262150 using key 0x3447862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smalloc] Created shared memory segment 720915 using key 0x6347862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0x6a47862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Created semaphore 294919 using key 0x6a47862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smalloc] Created shared memory segment 753684 using key 0x6947862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0x6647862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Created semaphore 327688 using key 0x6647862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0x6747862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Created semaphore 360457 using key 0x6747862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0x6c47862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Created semaphore 393226 using key 0x6c47862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smalloc] Created shared memory segment 786453 using key 0x6547862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0x6847862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Created semaphore 425995 using key 0x6847862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Attempted to attach to non-existent semaphore with key 0x6947862b
[21/Jun/2017:15:52:41] [Info] [CA WebAgent IPC] [3648] [CSmSem::getSem] Created semaphore 458764 using key 0x6947862b
nm: '/etc/httpd/bin/httpd': No such file
[Wed Jun 21 15:52:45 2017] [warn] Siteminder Web Agent: restart not supported.
[Wed Jun 21 15:52:45 2017] [notice] Digest: generating secret for digest authentication ...
[Wed Jun 21 15:52:45 2017] [notice] Digest: done
[Wed Jun 21 15:52:45 2017] [notice] Apache/2.2.15 (Unix) DAV/2 configured -- resuming normal operations
************************************************************************************
These created semaphores are automatically removed when stopping the server.
[Wed Jun 21 16:12:06 2017] [notice] caught SIGTERM, shutting down
[21/Jun/2017:16:12:06] [Info] [CA WebAgent IPC] [3852] [CSmSem::getSem] Attached to semaphore 163843 using key 0xf447862b
[21/Jun/2017:16:12:06] [Info] [CA WebAgent LLAWP] [3852] [Shutdown message sent to the LLAWP. It should stop within 5 seconds ...]
[21/Jun/2017:16:12:06] [Info] [CA WebAgent LLAWP] [3648] [Shutdown Message received waiting for all clients to disconnect ...]
[21/Jun/2017:16:12:06] [Info] [CA WebAgent LLAWP] [3648] [Now shutting down.]
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smfree] Removed shared memory segment 786453
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSem::SemRm] Removed semaphore 425995
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSem::SemRm] Removed semaphore 458764
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSem::SemRm] Removed semaphore 327688
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSem::SemRm] Removed semaphore 360457
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSem::SemRm] Removed semaphore 393226
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSem::SemRm] Removed semaphore 294919
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smfree] Removed shared memory segment 753684
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSem::SemRm] Removed semaphore 163843
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smfree] Removed shared memory segment 720915
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSem::SemRm] Removed semaphore 262150
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smfree] Removed shared memory segment 688146
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSem::SemRm] Removed semaphore 229381
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smfree] Removed shared memory segment 655377
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSem::SemRm] Removed semaphore 196612
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSharedSegment::smfree] Removed shared memory segment 622608
[21/Jun/2017:16:12:07] [Info] [CA WebAgent IPC] [3648] [CSmSem::SemRm] Removed semaphore 131074.
Please let me know if you require more information.
Best Regards,
Krishna