indymedia
/
epicyon
mirror of https://gitlab.com/bashrc2/epicyon
7
4
Fork 1
Code Issues 14 Releases Wiki Activity

Improve blocking of user agent domains

main
Bob Mottram 2022-03-31 16:18:42 +01:00
parent 92b9942183
commit c9cd6ea9ab
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
crawlers.py
View File

@ -117,6 +117,7 @@ def blocked_user_agent(calling_domain: str, agent_str: str,
ua_block + "/" in agent_str_lower or \
ua_block + ")" in agent_str_lower or \
ua_block + ";" in agent_str_lower or \
ua_block + "," in agent_str_lower or \
ua_block + ">" in agent_str_lower or \
ua_block + "<" in agent_str_lower or \
ua_block + " " in agent_str_lower: