Hi Piyush,
Keeping that a bit simple, you are getting one option to select all the cost plans, listed in one page, at one go, right? Why don't you use that Check box and click "Delete"?
And in case you have a really good number of Cost Plans under those projects, then you can select the maximum number of Cost Plans to be visible at one page as a List and then do the needful: