FREAK removes points if it can not generate a descriptor for it, many times this occurs in the border of the image as it cannot generate a descriptor if it falls out of the boundary image. I avoid this issue by applying a ROI before extraction.
I also use FAST combined with FREAK and I get the best results, but I still have the problem of reducing extractor time, which is too high for me.