Currently New Relic alerts for an applications error rate, and Apdex score, or a servers CPU, IO, memory usage, and full disk.
Downtime alerts are available for both applications and servers. New Relic does not provide alerts when a specific error is traced.