For that You have to clear the browser cache in logout page and the page used before you click logout Or its better to that in every page.
Add The code below in start of every page inside jsp scriplet.
response.setHeader("Pragma","no-cache");
response.setHeader("Cache-Control","no-store");
response.setHeader("Expires", "0");
response.setDateHeader("Expires", -1);