You can do it with the following:
export PS1="$PWD> " #this will always show the dir you were when performing the command
export PS1='$PWD> ' #this is the correct
Note that this will work for your current session. To make it persistent, add the line to your ~/.bashrc
file.
For comprehensive information about this topic, you can check How to: Change / Setup bash custom prompt (PS1).