I was not getting the right environement for installing ruby and gemsets . But
rvmsudo
worked for me
I tried installing those gems which required compiler like
rvmsudo gem install json -v '1.8.0'
And it worked for me.
I am having only local user access which does not have any rights to run commands like yum