I solved it by deploying the needed dll with the application itself. svnClientAdapter is also using a special property subversion.native.library
to find the dlls. So in the initialization method I'm getting the absolute path the application is running in with the following method:
String strPath = getClass().getClassLoader().getResource("someResourceThatExists").getPath();
strPath = strPath.replace("filenameOfResource");
Afterwards I'm adding the filename of the library and setting the property:
System.setProperty("subversion.native.library", strPath);
That seems to work quite well.