With the usual MSTest setup, when you build an MSTest project, you get a dll. A dll is an assembly (a .exe also is an assembly, and there are other, more exotic assembly types). Here's an SO question on that subject.
So what TeamCity wants in that list are the paths to the MSTest dlls it will feed to the test runner.