The ServerManager
class is documented as
"Any instance members are not guaranteed to be thread safe".
Which generally means you can't call them from a background thread because there's no way to do any locking to ensure IIS isn't accessing data at the same time in the main thread.
Simply get what you need while in the main thread, cache it, then use it in a background thread.