Just figured out how to do this, and if you're wondering about this as well ... Here are some steps that you can take to build this out:
1. Log into UMP
2. Create a new TAB
3. Within the new TAB specify your Layout and add the Custom Dashboard application
4. Click the ellipsis (...) on the portlet title bar.
5. Click the Preferences menu item.
6. Enter the Dashboard name and click Save. ( i.e. Critical Services )
7. Click the Return to Full Page link.
Let me know if there are any quesitons.
Best,
-Gennady