The above question can be solved by the following command.
clang -target armv7-none-eabi -sysroot=/toolchain/path/to/sysroot/ hello.c -ccc-gcc-name arm-none-linux-gnueabi-gcc hello.c
Here target says the clang compiler to choose proper target. sysroot says the exact path to take the headers and libraries(No need to provide include and library paths)