You can launch a file in a separate GVIM instance via this:
:silent execute '! gvim' shellescape(filename, 1)
For Windows, use !start
instead of !
.
NERDTree has great documentation on how to extend it. See :help NERDTreeKeymapAPI
and :help NERDTreeMenuAPI
.