indymedia
/
epicyon
mirror of https://gitlab.com/bashrc2/epicyon
7
4
Fork 1
Code Issues 14 Releases Wiki Activity

pixelfedbot is I assume a legit aspect of pixelfed instances

merge-requests/30/head
Bob Mottram 2023-08-04 17:16:04 +01:00
parent 025ec98673
commit 3119e0a33f
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
crawlers.py
View File

@ -130,7 +130,8 @@ def blocked_user_agent(calling_domain: str, agent_str: str,
for bot_str in bot_strings: for bot_str in bot_strings:
if bot_str in agent_str_lower: if bot_str in agent_str_lower:
if '://bot' not in agent_str_lower and \ if '://bot' not in agent_str_lower and \
'://robot' not in agent_str_lower: '://robot' not in agent_str_lower and \
'pixelfedbot/' not in agent_str_lower:
contains_bot_string = True contains_bot_string = True
break break
if contains_bot_string: if contains_bot_string: