Finally,We found the problem.The problem was there were multiple remoting channels in the Appdomain and eveything had same priorities,so my application was using the wrong channel all the time and this channel did not have any specific binding to it.
I increased the priority for the channel which it is supposed to use,then everything started working