Apparently looks like that's all one have to do in order to receive the report.
Today my dashboard was updated with some real error that had 4 hits (reported from 4 different machines).
I have not received the report for null-pointer dereference. I guess the problem has happen on more than one machine to actually show up.