Look into this
And this.
I hope this would help you. If you have any other questions, ask.
OK! So basically there is nothing wrong with what you're doing. AppCompact library should use old themes on old devices.
if you want to use Holo themes on old devices you should use HoloEverywhere.