All right, I figured it out and it's incredibly simple:
All I have to do is to add this attribute to the given ListView
:
android:drawSelectorOnTop="true"
And that's all! I can give the list items any background color that I want and it will always be overlayed by the system default selector!