Diamond-question-marks in Visual Studio

Question

I'm running Visual Studio 2005 for the first time on my new machine (an HP thin client accessing a virtual machine over their HP SAM Client software). When execution halts on an exception, the text for that line appears as below. It appears that it can't find the characters in some font variant or something, but I can't figure it out.

I tried changing the font from Courier New to other ones, and it made no difference. This same character showed up in that alternate font. I wasn't even sure what to try searching for on here or Google with this one.

Update: I'm seeing this in various other places in my code, even at design-time. It definitely appears linked to some specific font attribute, though I haven't been able to tell which.

Update 2: I'm not sure whether this is surprising or not, but copying and pasting the question marks into another application works as though there's no problem.

Update 3: On the same machine, Visual Studio 2008 behaves as expected (that is to say, normally). To provide additional details on VS2005, I'm running version 8.0.5727.42.