VGA, as per DE-15 and similar output channels is analog1.
There is no trivial way to "read" a pixel at a specific coordinate - when going directly to an analog CRT there weren't even "x/y pixel coordinates" assigned by the device! It was only with the advent of later LCD monitors that the VGA analog signal was converted back into a digital (i.e. "with coordinates") format prior to being displayed.
One way to solve this problem/task is to use an analog frame grabber card/device and access the digitized image stream.
1 See VGA Video Signal Format and Timing Specifications for a brief overview of the analog format.