About 10 minutes after posting this I found the answer, so here it is in case somebody is trying to do the same and finds this at a later date.
Although the documentation says:
Are there any notable log entries? Check the log files for any related warnings or errors. By default the Jackrabbit JCR Server writes log entries to the standard output of the servlet container. You can customize logging by editing the /WEB-INF/log4j.xml file and redeploying this web application.
This appears to be incorrect as in fact the newer Jackrabbit uses logback, and the configuration file in the standard distribution is:
WEB-INF/classes/logback.xml
In which you can change the basic level and append to the console as such:
<root level="DEBUG">
<appender-ref ref="console"/>
</root>
You can get more advanced from there, it appears. Make the change, restart the container, and you're good to go.