Just figured it out. This should do the trick.
html_sidebars = {'**': ['localtoc.html', 'sourcelink.html', 'searchbox.html']}
Using this as a reference
Sphinx theming guide html_sidebars
I am experimenting with creating a custom sidebar since I don't like the included options. Using the bootstrap demo index.html I created the following for a custom sidebar. Just name it something like my_custom_sidebar.html
and put it in /source/_templates
<ul class="globaltoc"
>{{ toctree(maxdepth=theme_globaltoc_depth|toint, collapse=False,includehidden=theme_globaltoc_includehidden|tobool) }}</ul>
Then edit html_sidebars
html_sidebars = {'**': ['my_custom_sidebar.html', 'searchbox.html']}