Try with this I think there is need of one more parent. Hope it will work. Since I was stuck with same problem few months ago.
$(document).mousedown(function(event){
if( event.button == 2 ) {
if ($(event.target).parent().parent().is('.draggable')){
$el = $(event.target).parent().parent();
flag = true;
}else{
flag = false;
}
}
});