You would need to make multiple panels and add those panels to different parts of the JFrame (for ex. the top part would be add(panel1, BorderLayout.NORTH), the middle add(panel2, BorderLayout.CENTER) etc.)
Then you would just set the layout manager for panel2 (or whatever you name the middle panel) to have a flow layout and only add the components you want in the middle to that panel.