When we provide the Name Filter = Default agent. It takes whichever agent is available and continue with that agent. If we want to choose any specific agent we can use a simple assign activity just after get the build agent to choose the specific build agent as used below.
agentsettings.name= "Agent name".
This will let us choose the build agent that we wanted it to perform the task.