The "Tracking Progress" section in the RBM tutorial at deeplearning.net (http://deeplearning.net/tutorial/rbm.html) gives very good guidance:
- Check that samples from the RBM look like the training data
- (For image data) Check that latent variable values maxima look sort of like smooth gabor filter banks
- Track the pseudolikelihood