三国演义人物出场频率分析

使用jieba库对三国演义人物出场进行分析:

词频分析代码 出现错误

发现时存储的txt文件的编码模式未ANSI, 对编码模式进行修改, 改为UTF-8后运行正常.

对不正确词组进行排除, 重复找不正确的词进行排除

import jieba

txt = open('threekingdoms.txt','r',encoding='utf-8').read()

excludes = {'将军','却说','荆州','二人','不可','不能','如此','商议','如何','主公','军士','左右','军马','引兵','次日','大喜','天下','东吴','于是','今日'

          ,'不敢','魏兵','陛下','一人','都督'}

words = jieba.lcut(txt)

counts = {}

for word in words:

    if len(word) == 1:

        continue

    elif word == '诸葛亮' or word == '孔明曰':

        rword = '孔明'

    elif word == '关公' or word == '云长':

        rword = '关羽'

    elif word == '玄德' or word == '玄德曰':

        rword = '刘备'

    elif word == '孟德' or word =='丞相':

        rword = '曹操'

    else:

        counts[word] = counts.get(word,0) + 1

for word in excludes:

    del counts[word]

items = list(counts.items())

items.sort(key = lambda x:x[1],reverse=True)

for i in range(15):

    word,count = items[i]

    print('{0:<10}{1:>5}'.format(word,count))