In r2012b, use a VideoReader to iterate through the movie, one frame at a time. For older versions of Matlab, use the aviread() function.
For each frame, call ginput() to collect graphical input from the user.
myVideo = VideoReader('myRobotVideo.avi');
n = myVideo.NumberOfFrames;
x = nan(n,1);
y = nan(n,1);
for i = 1:n
img = read(myVideo,i);
imshow(img);
[x(i),y(i)] = ginput();
end
disp([x,y])
This is a convenient technique for quickly annotating computer vision ground truth.
Alternatively, if you don't have the toolbox, you can use an open source tool such as FFMPEG to convert the video as a series of .png images, and then iterate through these using the built-in imread()
function.