Place the 2 JButtons
on a new JPanel
using GridLayout
like this
JPanel basePanel = new JPanel(new GridLayout(0, 1, 0, 3));
basePanel.add(select);
basePanel.add(back);
controls.add(basePanel, BorderLayout.PAGE_END);
GridLayout
can provide a vertical gap between buttons in its constructor as shown in your question