I didn't realise I needed to create a local repository first in order to properly set up ZS with EGit.
I Followed the tutorial on the EGit gettting started page, and then went back to the instructions on EGit with GitHub instructions. This made Nils Werner's comment make sense where you simply choose the connection method on your GitHub account and configure EGit accordingly.