You need to add ValidationGroup
property to validator and button which should do validation
<asp:CompareValidator ID="ddlto" ... ValidationGroup="MyValidation"... />
<asp:Button ID="MyBtn" ... ValidationGroup="MyValidation"... />
Just make sure, that validator and button have same group.