That isn't public state, but you can check
fig.canvas.manager.toolbar._active is None
which will be True
if the toolbar is not trying to grab clicks (either through pan or zoom).
You are reaching in and touching internal state which can change at any time, so use this at your own risk. The developers have no compunction about changing anything that starts with a _*
with no deprecation period.