No, ImageResizer doesn't current support adjusting relative to a color. However, if you wanted to implement said feature, it would not be difficult.
You could modify AdvancedFilters.cs, inserting an IF statement near line 150, and add support for a new command, such as "&a.white=rrggbb".
Simply provide the RGB values to the LinearLevels class to perform the scaling on the image. http://www.aforgenet.com/framework/docs/html/29bf1191-47c9-314b-eb8d-bea3f903ac28.htm
If you like the result, and want to share it, send me a pull request on GitHub or e-mail me the code snippet. If it passes testing, it might make it into the next release.
Client side, you might find this library helpful for selecting a color from an image.