Find the 10 most frequently occurring words with morphology [closed]

Question

It's difficult to tell what is being asked here. This question is ambiguous, vague, incomplete, overly broad, or rhetorical and cannot be reasonably answered in its current form. For help clarifying this question so that it can be reopened, visit the help center.

Closed 8 years ago.

Please tell me how to solve this problem better.

I have the text of the Russian and I want to find the 10 most common words with morphology. Maybe there is any open source libraries to solve this issue in python?

Answer 1

You can use one of Python morphology analyzers for Russian to normalize the word:

• https://github.com/kmike/pymorphy2
• https://github.com/kmike/pymorphy
• https://github.com/irokez/Pyrus

There is also a Porter stemmer for Russian in https://github.com/nltk/nltk. Also, you could employ http://company.yandex.ru/technologies/mystem/ from a command line.

I'd recommend pymorphy2 for your task, but I'm a bit biased :)

Answer 2

PyStemmer and NLTK are the two obvious libraries here.