It depends on what you're killing, really.
If that process has created some temp files, they aren't going to get cleaned up. If the process was in the middle of writing to a file, the file will be incomplete.
I wouldn't worry about the side effects from killing a frozen notepad.exe
. But if it is something like VMWare Workstation, then yes, I would worry because my VM might be corrupted.