I ended up with setting unreferenced projects' output path same same as the web application's.
..\WebApp\bin
This works well for building the solution inside Visual Studio. For release builds (only building the Website project) I wrote a custom script that builds Web application and other libraries. After those libraries are built, all dll files are copied to WebApp\bin
folder inside _PublishedWebsites
using a Copy task.