After a couple of frustrating days I found the solution. You need to set the LD_LIBRARY_PATH
variable in the upstart script located at /etc/init/shiny-server.conf, but per the upstart documentation, you need to define it with the env
keyword. So adding:
env LD_LIBRARY_PATH=/usr/lib/oracle/11.2/client64/lib:$LD_LIBRARY_PATH
to beginning of the shiny-server.conf script seems to have fixed the problem.