And I wish instead of that, when a button is checked, it's is highlighted in becoming yellow for example.
You can define your own radiobutton_selector.xml for radio button:
<?xml version="1.0" encoding="utf-8"?>
<selector xmlns:android="http://schemas.android.com/apk/res/android">
<item android:state_checked="true" android:drawable="@drawable/unchecked" />
<item android:state_checked="false" android:drawable="@drawable/checked" />
</selector>
and then set it to RadioButton like
<RadioButton
android:id="@+id/button_faute"
android:button="@drawable/radiobutton_selector"
style="@style/type_action"
android:layout_alignLeft="@id/button_service"
android:layout_alignTop="@id/button_bloc"
android:layout_marginTop="10dp"
android:text="@string/faute" />
//EDIT
also i found this tutorial or tutorial1 with full source code for customizing radio buttons in way you as you want to :P