We do XOGin using this application and port only.
If you mean that you explicitly use the address (not the load balancer address) in your XOG call then I think you are just fine to change the NSA setting - explicitly directing XOG to an IP/name and port would not be looking at any settings in the NSA.
(at v7.5.3 we could not even use the "internal" connection in processes that were calling XOG to short-cut that XOG address ; if I remember rightly that did not come in until 8.x)