It helped looking at another assignment for a while :)
If anyone else run into the same problem Use the Ibuildserver object to get a list of IBuildController
buildServer = (IBuildServer)teamProjectCollection.GetService(typeof(IBuildServer));
IBuildController[] buildserverlist = buildServer.QueryBuildControllers();