I think you'll have to implement a simple (single window) GUI and include a matplotlib graphical backend inside that.
You might be in luck: the matplotlib examples provide a nice example. Note how, when running the example, keypresses are caught and printed to the terminal, but also forwarded to matplotlib.backend_bases.key_press_handler
.