After tweaking my DAL to handle specific SQL Errors, I was able to retry all the transactions whenever there was a Availability group fail-over.
I am handling the following SQL Errors
Severity 16 DB error codes (10054, 233, 232, 2812, 64, 3906) Severity 14 Db error codes (983, 922, 945)