You can't just 'select by color'.
From your description I would look at using mask images. Take a copy of your image, scale and blur it and use that to mask a color wash.
If that won't work due to other contents in your image then you will need to look at flood fill algorithms (which is a potential basis of 'select a color' implementations).