you should stop it on onpause method and replay it on onresume,
@Override
protected void onPause() {
mp.stop();
super.onPause();
}
@Override
public void onResume(){
// put your code here...
mp.start();
super.onPause();
}