Navigation portlet is using Liferays tag - liferay-ui:navigation
. You can create a small jsp-hook to override /html/taglib/ui/navigation/page.jsp
. In this jsp you can make your modifications in how to display the items.
Also check the nestedChildren
attribute in liferay-ui:navigation
. I don't remember what exactly it does, but could be something helpful for your case.