If you use AWS Data pipeline (and use EMR as a node inside it), it has OnSuccees and OnFailure alarm support. In the alarm you can configure to send email to you. http://aws.amazon.com/datapipeline/faqs/ (look for "How do I add alarms to an activity?").
You cant but customize the email content. May be you can keep the CSVs in a predesignated location with some time/date based naming convention. This way when you get the success mail, you know where to look into for the record.
All this you can do without writing any extra code (just configurations).