You should approach this problem differently. Your source rectangles for textures are just that — don't try to use them as button rectangles, or you will get in trouble like this.
Instead, use a different Rectangle hitboxRectangle
, which will be the same size as your source rectangle initially, but will scale with your game window, and check intersections against it.