Using a buildroot created toolchain outside of Buildroot?

Question

I'm trying to compile XFCE using Uclibc. Uclibc was generated by crosstool-ng via buildroot. How do i use the toolchain to build something outside of buildroot? I've had a look at the instructions on both buildroot's and uclibc's website and they were all a bit vague. Do i set a flag during ./configure with a link to uclibc? Or have i totally missed the point?

Thanks