Natural Language Processing using nltk [closed]

Question

Closed. This question needs to be more focused. It is not currently accepting answers.

---

Want to improve this question? Update the question so it focuses on one problem only by editing this post.

Closed 8 years ago.

Improve this question

I need an algorithm to tokenize given sentence into words which are correctly tagged to its grammar meaning.

for example: "People took to the streets and protested" people-noun took- adjective and-conjunction to- ...and so on

Answer 1

You mean you want part of speech tagging?

>>> import nltk
>>> tokens = nltk.word_tokenize("People took to the streets and protested")
>>> nltk.pos_tag(tokens)
[('People', 'NNS'), ('took', 'VBD'), ('to', 'TO'), ('the', 'DT'), ('streets', 'NNS'), ('and', 'CC'), ('protested', 'VBD')]