You can remove them using the "remove" filter in WEKA's Explorer. Once the data has been loaded into WEKA:
1) Go to "Process" (1st main tab).
2) In "filter" area click "Choose" a filter.
3) Navigate through the tree to "filters" -> "unsupervised" -> "attribute" -> "Remove".
4) Once "Remove" filter has been chosen, click to "Remove" label next to "Choose" button, it will open a dialog.
5) Fill out the attributeIndices text field with the index/indices of the attributes to be removed, i.e. "1,4,10" or "1-3,7".
6) Click "OK" in the dialog and "Apply" button in the filter area of the main window.
That's all !!