Try to disable all breakpoints, some breakpoints such as conditional breakpoints on very frequently used classes or method breakpoints in general can cause a great slowdown in debug mode.
Also increase the PermGen settings, have a look at this answer as well. By disabling all breakpoints, you should get a startup time comparable to the non debug run.
Then try to enable the breakpoints back one by one to see which one is causing the problem.