I figured it out; didn't know you can do this. I just used stage.removeChild(bullet) in a loop through all bullets like this:
stage.removeChild(bullets[i]);
Which is interesting, since i thought you have to pass child name into this method, but obviously I was wrong; you pass the actual object and that's it.