According to the MySQL mailing list you can not deny and action to a table that has been granted to the database. Looks like you might have to set table level access per table.
From the mailing list post:
"You can't revoke SELECT privilege from the table if you grant privileges on the database. You can grant SELECT privilege on each table that you want to be visible to user instead."
Unfortunately this seems to be the only way atm.