Consider using nested JPanels with the outer JPanel using BorderLayout. It holds a JPanel on its WEST side that can use BoxLayout, and then it holds another JPanel in the BorderLayout.CENTER position...