routes.RouteExistingFiles = true;
routes.MapPageRoute("Route1", "Pages/{page}.aspx", "~/404.aspx");
routes.MapPageRoute("Route2", "Pages/{folder}/{page}.aspx", "~/404.aspx");
Instead of Ignoring the route, you need to map it to a page that throws a 404 instead of a response. Hopefully this helps someone else!