To solve this problem I did the following.
When adding the button to the table, I used the following Code.
table.add(button).height(HEIGHT).width(WIDTH);
This did not solve the mentioned issue, but it allowed me to explicitly set the desired width and height of the button, which played a part in solving the actual issue. When creating the button, the button, being an extension of Cell, I used to add() function to re-position the text.
button = new TextButton("button", style);
button.add(button.getLabel()).padBottom(CONSTANT);
combined with the Cell.height()
function, I was able to use a constant padding variable to position the button's text (or label) in the middle of the button.