Extra word exclusion

main
Bob Mottram 2021-07-23 13:08:17 +01:00
parent 6826fed2e9
commit e23c424162
1 changed files with 2 additions and 1 deletions

View File

@ -533,7 +533,8 @@ def _updateWordFrequency(content: str, wordFrequency: {}) -> None:
'"' in word or \
'@' in word or \
"'" in word or \
'://' in word:
"--" in word or \
'//' in word:
continue
if word.lower() in commonWords:
continue