At the WEKA Explorer GUI, when you apply the StringToWordVector, the former class attribute is most often moved to be the first attribute, so it is not detected as the class by default. When you are at the Classify tab, please ensure that the correct attribute is selected as the class for your experiment.
Another potential source of problems is that the class is numeric, thus preventing some algorithms (which expect a nominal class) to be applied.
In case this does not solve your problem, please post an excerpt of your ARFF file (header extract plus one instance) in order to allow us to provide more precise advice.