The Problem solved itself. I have absolutely no idea if this was just some random quirk or if I changed something that fixed it. Thanks for the help anyway.
EDIT: Apparently the Problem was that browsers cache 301 Redirects (thanks to hypercube for pointing it out). More Information here: http://www.electrictoolbox.com/google-chrome-clear-301-redirect/.