If you want to use your VM in different guest platforms, then yes.
The advantage that bytecode gives you is portability (therefore the alternate naming "p-code", which is short for "portable code").
If you plan to use your VM in different platforms, you should go for bytecode. Then you would have to take care of compiling the program into bytecode instructions and the VM would take care of the rest.