I can't be sure without seeing your voice trigger XML, but it sounds like you might have written the trigger to expect additional input by including this line:
<input prompt="@string/glass_voice_prompt" />
Remove that line from your trigger and it won't prompt you.