8 Commits (d37e6d2b3801bea8c2cc5eb7fe5ab16d5b5076cb)

Author	SHA1	Message	Date
Bob Mottram	118571ae3f	Extra check for search bots	2022-03-08 20:03:41 +00:00
Bob Mottram	8070d2a276	More robot strings	2022-03-08 12:40:15 +00:00
Bob Mottram	89a9ece062	Change filename for consistency	2022-03-06 14:21:49 +00:00
Bob Mottram	5b218919b3	Change variable name to avoid confusion	2022-03-06 14:20:25 +00:00
Bob Mottram	5f1f973d85	Use a different filename to distinguish from api/nodeinfo access	2022-03-06 14:11:11 +00:00
Bob Mottram	9be61c2b38	Save a list of known web crawlers	2022-03-06 14:02:26 +00:00
Bob Mottram	885a2b82c9	Comment	2022-03-06 13:26:06 +00:00
Bob Mottram	f4fc143b3a	Add crawlers module	2022-03-06 12:56:26 +00:00