If you right-click on the git project name you should get an option to remove:
But sometimes you don't see that Remove menu item enabled!
Well in that case, just navigate to the folder where the git project is located and delete or relocate that folder. When you come back to Team Explorer Connect right-click again, you should see the menu item enabled.