Browsers only support a certain number of HTTP channels, number here.
So with 100+ files all your HTTP requests are queuing and slowing down loading of the page.
So, it is (generally) much more efficient to download one large file than lots of small files. So your best optimisation for above is to put all your Js files into one (or a few) large(ish) files.