It would be much easier to answer if you'd provided HTML of your form... Okay, I hope you will figure out the solution:
Look at the value of href attribute if the toggle link, it should look like '#something' and then just edit the css file and add the following line at the bottom:
#something { display: none }
So, make sure you replace something
with the actual value from the toggle link.