I fixed this issue by overriding the default destroy method in my Image model as follows:
# override destroy method to put it in a background task
class Image < ActiveRecord::Base
def destroy
CarrierwaveImageDeleteWorker.perform_async(self.id)
end