First, one-class SVM is a different algorithm, not jus "one class svm kernel" - you are confusing two things here.
Second, vlfeat supports just a simple binary SVM ( http://www.vlfeat.org/matlab/vl_svmtrain.html ) so the answer is "you should use other library" - original libsvm have Matlab bindings and supports (among others) one-class SVM.