Try changing the format of your request to JSON, i.e. replace
delete "/api/v1/contacts/#{@contact.id}"
by
delete "/api/v1/contacts/#{@contact.id}.json"
that would allow the format
logic to figure out that you want the reply rendered in JSON which it knows about.