The translate animation takes in change in x values, not absolute values. Hence you need to get your fromView's x and your toView's x, and put the difference between them in your translate animation (and same with y).
From: http://developer.android.com/reference/android/view/animation/TranslateAnimation.html Parameters fromXDelta: Change in X coordinate to apply at the start of the animation
toXDelta: Change in X coordinate to apply at the end of the animation
fromYDelta: Change in Y coordinate to apply at the start of the animation
toYDelta: Change in Y coordinate to apply at the end of the animation