Its pretty easy actually. you can find the source of ListPreference at: http://grepcode.com/file/repository.grepcode.com/java/ext/com.google.android/android/1.5_r4/android/preference/ListPreference.java
as you can see in the source, you just need to overwrite onPrepareDialogBuilder and mess with the onClick section. Note that you'll have to do some editing since you can't use private instance variables, but there are getters and setters for each one so its pretty straightforward