Python descending order of wordcount [duplicate]

Question

This question already has answers here:

How to print frequencies in descending order? (4 answers)

Word frequency analysis in Python returning letter frequency (3 answers)

Closed 9 years ago.

I'm using this code to count the frequency of word appearance in a text file:

#!/usr/bin/python
file=open("out1.txt","r+")
wordcount={}
for word in file.read().split():
    if word not in wordcount:
        wordcount[word] = 1
    else:
        wordcount[word] += 1
for k,v in wordcount.items():
    print k, v

How can I print the output in the descending order of frequency numbers?

Answer 1

Here is the code:

file=open("out1.txt","r+")
wordcount={}
for word in file.read().split():
    word = word.lower()
    if word.isalpha == True:
        if word not in wordcount:
            wordcount[word] = 1
        else:
            wordcount[word] += 1
copy = []
for k,v in wordcount.items():
    copy.append((v, k))


copy = sorted(copy, reverse=True)

for k in copy:
        print '%s: %d' %(k[1], k[0])

Out1.txt:

hello there I am saying hello world because Bob is here and I am saying hello because John is here

Runs as:

hello: 3
saying: 2
is: 2
here: 2
because: 2
am: 2
I: 2
world: 1
there: 1
and: 1
John: 1
Bob: 1

Answer 2

Use Counter.most_common without specifying a value to get a descending list of word frequencies.

from collections import Counter

word_count = Counter()

with open("out1.txt","r+") as file:
    word_count.update((word for word in file.read().split()))

for word, count in word_count.most_common():
    print word, count

>>> the 6
Lorem 4
of 4
and 3
Ipsum 3
text 2
type 2

Answer 3

You can create a list of tuples and sort that. Here's an example.

wordcount = {'cat':1,'dog':2,'kangaroo':20}

ls = [(k,v) for (k,v) in wordcount.items()]

ls.sort(key=lambda x:x[1],reverse=True)

for k,v in ls:
    print k, v

...outputs...

kangaroo 20
dog 2
cat 1

Answer 4

Use the Counter module.

from collections import Counter

s = "This is a sentence this is a this is this"

c = Counter(s.split())
#s.split() is an array of words, it splits it at each space if no parameter is given to split on

print c

>>> Counter({'is': 3, 'this': 3, 'a': 2, 'This': 1, 'sentence': 1})

This won't work 'correctly' with periods and capital letters though. You can simply remove periods at the end of words to count it correctly and make everything lower/uppercase to make it case-insensitive as well.

You can get rid of both of those problems with this:

s1 = "This is a sentence. This is a. This is. This."
s2 = ""

for word in s1.split():
    #punctuation checking, you can make this more robust through regex if you want
    if word.endswith('.') or word.endswith('!') or word.endswith('?'):
        s2 += word[:-1] + " "
    else:
        s2 += word + " "

c = Counter(s2.lower().split())

print c

>>> Counter({'this': 4, 'is': 3, 'a': 2, 'sentence': 1})