I figured it out! These are the instructions for doing it on RHEL 5 for the version 1.8.1:
What you need to do is first build and install git using the commands:
$ make prefix=/usr all
$ sudo make prefix=/usr install
Once that is installed and done, you then need to cd
outside of the git source code directory, and clone the docs:
$ cd ../
$ git clone git://git.kernel.org/pub/scm/git/git-manpages.git
$ git clone git://git.kernel.org/pub/scm/git/git-htmldocs.git
Next, you then need to navigate back into the git source code directory, and run the commands:
$ sudo make prefix=/usr quick-install-doc
$ sudo make prefix=/usr quick-install-html
Doing this installed the man pages, and the html page documentation!