You could just have functions for adding/removing listeners :
function addListeners():void
{
// loop through and add the listeners for the cards
// add keyboard listeners
}
function removeListeners():void
{
// loop through and remove listeners from the cards
// remove keyboard listeners
}
Before you set the timer, you remove your listeners :
removeListeners();
Then in your flipback timer handler you just call the addListeners :
addListeners();