For easiest build you can just check precompiled version from
https://svn.code.sf.net/p/cmusphinx/code/trunk/pocketsphinx-android-demo
It is new updated version with new features which doesn't require SWIG and works just with importing the project.
For information about it please see the updated tutorial