The view returned by the getView method gets recycled to minimize resource usage. If one of your views that contains the right info image gets recycled it will still be there.
This works as intended. The solution to this is, as you already discovered, to reset the state of that right info image by using setImageResource(0) or setVisibility(View.GONE) or something similar.
This applies to checkbox state, etc. as well.