1. Extract all corpus files to a directory and cd to that directory.
2. Run sep_words.sh to merge all files and separate words into separate lines.
3. Open corpus.txt in vim and source vim_prune.vim
4. Run 
sort --parallel=8 corpus.txt | uniq -c > sorted_corpus.txt
