Seems like the solution was in front of me all along.. I didn't need to use Set-AzureSubscription but I did need to use Select-AzureSubscription. What really surprised me is that the name of the subscription was very long and automatically set when I got my account.
In short: After the process above run the following command: Select-AzureSubscription