The problem was that in myItemizedOverlay, I had an onTap method which displayed information about the point including it's icon.
When opening the dialog, I used a reference to the icon which was placed on the map.
The solution was to create an entirely new icon (Drawable) and use that instead of the reference.