DX NetOps

Hello, I'm trying to load/send configuration via NCM in Spectrum 10.1 from/to our new C4507R+E devices. The capture succeeded after several trials, the config changes applied to the C4507R+E fails and causes a very high CPU load on these devices, resulting in a loss of all communication for at least 1 Minute to and from these nodes (caused by STP topology changes due to the high CPU load). Capture and sending config changes to other devices (Cisco IOS - SSH capable) like C2960, C3560 or ME3400G works fine. SNMP communities are correctly configurred for RW, the user used to change the config has rights of level 15 - so what could be the reason that it won't work. Are changes to the scripts to be done or do I need special configurations in Spectrum to resolve this problem? I have read about problems with NCM and the new Cisco IOS-XE - are there any solutions?

Kind regards

Stefan

Hi Stefan,

Have you checked the CPU utilization before uploading changes to the configuration? Is the utilization generally high or low?

What types of changes are you making to the configuration?  Are there numerous configuration changes or only a few?

Thank you,

Bill

Hi Bill,

it seems that the CPU load on one of the 4 cores is permanent around 98 percent. This is reported to Cisco and a TAC case is opened for troubleshooting this issue. Maybe it is a software bug in 3.7.2 Cisco IOS-XE causing this trouble of high CPU load. Cisco is investigating this deeper on Thursday 19th during a WebEx Session.

I only changed the port status of one port from “shutdown” to “no shutdown” so it is not really a lot of commands send to the device.

As I mentioned in my description all other Cisco IOS Switches works fine with upload of configuration and getting snapshots – only problems with the C4507R+E and the SUP8 installed there…

I took several screenshots and put them in a Word document containing the messages in Spectrum and the Event messages from the device.

Kind regards

Stefan

Von: Bill_Wol4th

Gesendet: Dienstag, 17. Mai 2016 17:31

An: Bischoff Stefan (ewz)

Betreff: Re:  - Problem with NCM in Spectrum 10.1 and C4507R+E devices (Cisco IOS-XE)

CA Communities <https://communities.ca.com/?et=watches.email.thread>

Problem with NCM in Spectrum 10.1 and C4507R+E devices (Cisco IOS-XE)

reply from WILLIAM WOLFORTH<https://communities.ca.com/people/Bill_Wol4th?et=watches.email.thread> in CA Infrastructure Management - View the full discussion<https://communities.ca.com/message/241884435?et=watches.email.thread#comment-241884435>

Hi Stefan,

It sounds like the 98% CPU utilization could be the culprit. Adding NCM captures and uploads onto an over burdened device can be problematic. Once the CPU Utilization is reduced it will be interesting to see if the NCM uploads will be able to successfully push the changes.

Best regards,

Bill

Hi Bill,

we reduced the CPU load on the C4507, but have still these issues. Other devices of this class SwCiscoIOS works fine.

Kind regards

Stefan

Von: Bill_Wol4th

Gesendet: Dienstag, 24. Mai 2016 13:59

An: Bischoff Stefan (ewz)

Betreff: Re:  - Problem with NCM in Spectrum 10.1 and C4507R+E devices (Cisco IOS-XE)

CA Communities <https://communities.ca.com/?et=watches.email.thread>

Problem with NCM in Spectrum 10.1 and C4507R+E devices (Cisco IOS-XE)

reply from WILLIAM WOLFORTH<https://communities.ca.com/people/Bill_Wol4th?et=watches.email.thread> in CA Infrastructure Management - View the full discussion<https://communities.ca.com/message/241886340?et=watches.email.thread#comment-241886340>

Hi Stefan, were you able to get this resolved with Cisco's help?

Cheers

Jay

Hi Jay,

Cisco couldn’t solve this problem. It seems to be a change in the behavior of the TFTP/SNMP script implementation. All other Cisco devices works fine only these C4705R+E containing the Sup8 behaves strange …  ☹

Kind regards

Stefan

Von: meaja05

Gesendet: Freitag, 16. September 2016 17:30

An: Bischoff Stefan (ewz)

Betreff: Re:  - Re: Problem with NCM in Spectrum 10.1 and C4507R+E devices (Cisco IOS-XE)

CA Communities <https://communities.ca.com/?et=watches.email.thread>

Re: Problem with NCM in Spectrum 10.1 and C4507R+E devices (Cisco IOS-XE)

reply from Jason Meader<https://communities.ca.com/people/meaja05?et=watches.email.thread> in CA Infrastructure Management - View the full discussion<https://communities.ca.com/message/241914301?commentID=241914301&et=watches.email.thread#comment-241914301>