Since I got no answer, I found a workaround this problem.
I made sure to have no ajax calls to the listener method (doing some sacrifices) and used BalusC's answer in this thread.
Using :
if (FacesContext.getCurrentInstance().getPartialViewContext().isAjaxRequest()) {
return; // Skip ajax requests.
}
in the listener method solves this problem.