Sorry for the bump, but finally have a semi-solution.
This was to increase the NFS threads on the server and improve the efficiency of the code so it is not doing as many directory listings. These combined do allow it to work reasonably (at least in our situation).