Autocorrect a document corpus

Question

I have an approximately 6GB sized document corpus of mostly user generated content on mobile platforms. Due to the nature of origin of this corpus, it is rife with misspelled, abbreviated and truncated words. Is there a way i could autocorrect these words to the nearest English language word?

Answer 1

This might be fun to look at, seen that you tagged your question with machine learning:

http://norvig.com/spell-correct.html

It's a fascinating read. On the other hand, if you are not looking to tinker, a better one might be Enchant, have a look at

https://pypi.org/project/pyenchant/