I think I figured it out.
If I cross the Up Vector, from my rotation matrix, with the Forward Vector, calculated from the camera current Pan/Tilt, I will get the Side Vector which I can use to calculate the Roll angle.
double roll = Math.atan(side.z / Math.sqrt(side.x * side.x + side.y * side.y));