From the vim documentation (:help wildmenu):
While the "wildmenu" is active the following keys have special meanings:
[...]
<Down> - in filename/menu name completion: move into a subdirectory or submenu
[...]
So I think that gets at least part of what you're after.