Not very sure, but you can check for the Function Queries with functions like abs or any mathematical functions which might convert it to the int values and use it for sort
e.g. abs(some_field) desc
Else, copy the field into the new field with int type which would need reindex.
Also, Sorting doesn't work good on multivalued and tokenized Text fields.
Documentation - Sorting can be done on the "score" of the document, or on any multiValued="false" indexed="true" field provided that field is either non-tokenized (ie: has no Analyzer) or uses an Analyzer that only produces a single Term (ie: uses the KeywordTokenizer)