This error comes due to the user (configured on the TFS side) not having read access to all the changesets in the collection. Read access to all the changesets is needed for processing/recovery purposes.
It is recommended that the user configured have admin privileges so that they can read all the changesets.