This is either a result of font scaling from a font atlas with mip-mapping set to true or it is a result of MakePixelPerfect not being set.
Turn off mip mapping on your font atlas or make sure your labels and parent hierarchy objects run MakePixelPerfect(). Select your label and press alt+shift+p. This should enforce the pixel perfect setting for you.