Your configuration was not correct ,to Cross-compile build=(your x86 gcc),and host=target=(arm-tool-chain).Try this below command.
./configure --host=armv6j-hardfloat-linux-gnueabi --build=x86_64-pc-linux-gnu --target=armv6j-hardfloat-linux-gnueabi \
CFLAGS="-march=armv6 -mfloat-abi=hard -mfpu-vfp"