How to use String tokenizer to remove the words from a list of words? [closed]

Question

It's difficult to tell what is being asked here. This question is ambiguous, vague, incomplete, overly broad, or rhetorical and cannot be reasonably answered in its current form. For help clarifying this question so that it can be reopened, visit the help center.

Closed 9 years ago.

I have a list of words after Pos Tagging in Java. Now I want to remove particular words with specified tags.How to use string tokenizer to remove the tagged words? such as to-PRP? and all words with tags prp?

The input file:

mike-NNS

Buses-NNP

Walk_VRB

to_PRP

. . . . . . . . . and so on

Answer 1

    final List<String> result = new ArrayList<String>();

    final List<String> textList= getList(); // get your list

    final StringTokenizer tokenizer = 
      new StringTokenizer(textList, delimiter); // your delimiter
    while (tokenizer.hasMoreElements()) {
      final String token = tokenizer.nextToken();
      if (isValid(token)) { // implement your own isValid method
        result.add(token);
      }

    }
    return result;