I have the same issue in the past but with Nimbus L&F My issue
Solved by doing this
JTextField#setBorder( null )
In your code
public CustomCellEditor(int maxStringLength)
{
super(new JTextField());
((JTextField) editorComponent).setDocument(new CustomDocument(maxStringLength));
((JTextField) editorComponent).setBorder(null); // cast may be not needed
}