Try,
/odata/avisos?$filter=not Destinatarios/any() or Destinatarios/any(d: d/Id eq 4)
You do not need the null check as we handle null propagation for you. Also, having null collections is not a good practice in general as it causes confusion between null and empty collections.