After investigation, the issue is caused by company security policy. The host server is in country A' data center. The TFS server and SCVMM are in country B's data center. All the servers are domain trusted.
But for data transfer policy of the country, the file share is disabled for all servers, except some public server which is audited by IT for file share. That's why some server(public server)'s Admin$ can be accessed in country B.
At last, we decide to move the SCVMM server to country A's data center, in the same data center with the Hosts.