The request to the KMZ-file comes from google, not from the user(when you take a look at console->network you'll see that there isn't any request to the KMZ-file).
So the only "user" that needs to be authorized is google.
Means: it's not possible(except you pass the credentials needed to authenticate the user via the KMZ-URL, but this of course would be insecure )