discussed it in Qt-project forums and the only way to make it work is to create a QApplication in the plugins when it does not exists (which is only the case when the app it statically linked against Qt)
And I make the plugin also statically linked against Qt too and it works fine :)