This is actually a known Android bug as can be seen here: https://code.google.com/p/android/issues/detail?id=35885
I just stumbled upon this same problem and I am currently trying to find a good and simple workaround for it. As soon as I have something, I'll post it.