Xcode keeps generating developer certificate (no key)?

Question

I'm trying to start from scratch with all my keys for iOS development by deleting them, recreating them, and downloading and installing the new ones.

The problem is that I keep deleting the iPhone Developer: MyName certificate (no private key associated with it), but when I run Xcode, it generates a new one.

Is there a better way to start from scratch with all these certificates and profiles?