Yes you can install xfce and use it using a VNC viewer on your remote system.
You need to follow the following steps:
sudo apt-get update
sudo apt-get upgrade
sudo apt-get install vnc4server
sudo apt-get install gnome-core xfce4 xfce4-goodies firefox nano -y --force-yes
Backup default configuration
mv ~/.vnc/xstartup ~/.vnc/xstartup.bak
Create new basic conf file:
vim ~/.vnc/xstartup
paste these lines into it
#!/bin/bash xrdb $HOME/.Xresources startxfce4 &
sudo chmod +x ~/.vnc/xstartup
Setting up as service:
sudo vim /etc/init.d/vncserver
paste the following code into it:
#!/bin/bash PATH="$PATH:/usr/bin/" export USER="user" DISPLAY="1" DEPTH="16" GEOMETRY="1024x768" OPTIONS="-depth ${DEPTH} -geometry ${GEOMETRY} :${DISPLAY} -localhost" . /lib/lsb/init-functions case "$1" in start) log_action_begin_msg "Starting vncserver for user '${USER}' on localhost:${DISPLAY}" su ${USER} -c "/usr/bin/vncserver ${OPTIONS}" ;; stop) log_action_begin_msg "Stopping vncserver for user '${USER}' on localhost:${DISPLAY}" su ${USER} -c "/usr/bin/vncserver -kill :${DISPLAY}" ;; restart) $0 stop $0 start ;; esac exit 0
sudo chmod +x /etc/init.d/vncserver
sudo service vncserver start
ssh -L 5901:127.0.0.1:5901 -N -f -l user server_ip_address
sudo update-rc.d vncserver defaults
These guides has been a great help.