After playing a while with the quotes, I realized that I need to pass the emacs' escape character for the double quotes. So the command that finally worked for me is:
PS> emacs.exe --eval '(with-current-buffer \"*scratch*\" (insert \"Hi\"))'
Thanks everyone for your help.