This can only be done by tweaking web.xml
Have you tried to remove the following servlet-mappings?
IdentityServices /identityservices/ IdentityServicesHandler /identity/
Sidenote: If you're using newer agents they might not work anymore.
-Bernhard