Just use this code fragment to make it look like a JTextPane look like a JLabel.
JTextPane f = new JTextPane();
f.setContentType("text/html"); // let the text pane know this is what you want
f.setEditable(false); // as before
f.setBackground(null); // this is the same as a JLabel
f.setBorder(null); // remove the border
Courtesy of this question: Selecting text from a JLabel?