Rally Software

I have an agile team that chose to tie Test Cases to their stories in a sprint, then also tie those Test Cases to a Test Set for that same sprint.  They like the summary reporting provided for the Test Set and want to see it all the time whether they were executing the first time as part of a story or in some later sprint as part of a regression effort (e.g Test Status by Test Set).

They reported that the Percent complete of those test cases changes depending on how they execute them.  They begin on the Iteration Status page, then select the test cases from there.  However, there is a difference in how the % complete calculates:

"- When we execute test cases beneath the test set, the % complete goes to the test cases under the stories

- When we execute test cases beneath the stories, the % complete does NOT go to the test set"

Can someone please explain whether this was done intentionally and if so, why?

Thank you.

Hi Rebecca,

This is intentional behavior. Test Sets are used to record the results for selected test cases during an iteration, so the set will only display results that are associated to them. However, the Test Cases themselves will record every result entered for them regardless of whether it was part of a test set or run separately. 

This means if you run the Test Case and its result is not associated to the Test Set the % will not be included in that Test Set, but you will see a record of the result on the Test Case.

When you run the Test Case and its result is associated to the Test Set you will see the set's percentage update, but you will still also see the result on the Test Case.

You can find more information about Test Sets here if you are interested Manage Test Sets | CA Agile Central Help