1) Simply install the package again with your package manager of your linux distribution. There should also be something like repair package or other similar options in your tool. Don't forget that you need a valid binutils/gcc/libc/g++/libg++ combination. Maybe your distribution contains a meta package for development, which contains all the needed packages.
2) You can install multiple versions of the compiler in parallel. Simply you have to provide --prefix= to your configure options. I use /opt/linux-gnu-gcc4.x.x for the versions. Using the /opt path is common practice to not collide with packages of your distribution.
3) The problem, that you could not compile any program at all is not a good problem description. For me it sounds that you have a mixed set of library header to incompatible headers problem. Nobody can understand what you do without a much more detailed error description. But you should start with 1)