How can I take a historic dump of all Data for Data Science work from Rally ? Is there a Rally Schema for the Rally Database ?
There are three options for you to get an export of data from, each with benefits and varying degrees of difficulty:
1. Export within Agile Central Pages - You can perform and export data yourself using the export option within Agile Central web pages. This is the least complete, but very user friendly. It exports whatever displays on summary screens, such as Plan > User Stories, Quality > Defects, etc. in .CSV format. On pages such as Plan > User Stories, creating a custom view to display fields not shown on the default views will cause the export to include those extra columns. Note: this will not include revision history, attachments, test case steps, or discussions.
2. Excel Add-In - This provides a quick and easy way to export data from your Agile Central subscription for tracking, reporting, or sharing. The data can be organized in a pivot table or displayed using Excel's built in charting capabilities. Multiple CA Agile Central object types can be exported into multiple tabs and the data cross referenced for more complex needs. You can find more information about that here: https://help.rallydev.com/rally-add-excel-installation-user-guide
3. XML or JSON Export - The Agile Central Support Team will email you a full export of your data in XML or JSON format in a password protected file. This request must be made by a Subscription Administrator. We will then provide the password to you via a telephone call. Please note that you will need to leverage internal resources if you must translate the data into another format. Also, please be aware that this will not include revision history, attachments, or test case steps.
If you choose option three please let us know and include a valid contact number with voicemail to which we may deliver this information.
Let us know if you have any questions.
I appreciate your quick response. The Rally is on premise and the goal is to export Data(limited projects belonging to a business group) to Hadoop Cluster on premise.
I am also looking for revision history/discussions/attatchments Which rules out option 1 and 2 is also ruled out for Data Lake reasons.
Option 3. JSON seems to be a good option since more people nowdays work with JSON. Can partial export be done or only full export works?
Are there Rest API's that support Data pull across all Tables for selective projects ?
Is there a link to Rally Schema like the one Jira Provides ?
I appreciate your help
Just realized option 3 doesn't include historic edits. Followup questions how to capture events in rally in real time for example using webhooks into hadoop ?
I saw best practise is not to access to Rally DB. How can i get a copy of all transactions ?
Unfortunately we do not have an integration into hadoop. Here's what we do have:
Unfortunately, on-premises doesn't have webhooks functionality so real time updates won't be possible.
Take a look at the DB connector which can be run on a cron schedule. While it won't export to Hadoop, it is designed to output to a DB such as Postgresql or MS-SQL. From there, perhaps some code could be developed to take it into Hadoop?
Retrieving data ...