Skip to content

Commit

Permalink
Merge pull request #459 from Krakozaber/patch-1
Browse files Browse the repository at this point in the history
  • Loading branch information
JayBizzle authored May 24, 2021
2 parents a42972f + 330a257 commit 6d48e1d
Show file tree
Hide file tree
Showing 3 changed files with 4 additions and 1 deletion.
3 changes: 2 additions & 1 deletion raw/Crawlers.txt
Original file line number Diff line number Diff line change
Expand Up @@ -153,6 +153,7 @@ BingPreview
binlar
biNu image cacher
Bitacle
Bitrix link preview
biz_Directory
BKCTwitterUnshortener\/
Black Hole
Expand Down Expand Up @@ -1357,4 +1358,4 @@ Zombie\.js
Zoom\.Mac
ZoteroTranslationServer
ZyBorg
[a-z0-9\-_]*(bot|crawl|archiver|transcoder|spider|uptime|validator|fetcher|cron|checker|reader|extractor|monitoring|analyzer|scraper)
[a-z0-9\-_]*(bot|crawl|archiver|transcoder|spider|uptime|validator|fetcher|cron|checker|reader|extractor|monitoring|analyzer|scraper)
1 change: 1 addition & 0 deletions src/Fixtures/Crawlers.php
Original file line number Diff line number Diff line change
Expand Up @@ -174,6 +174,7 @@ class Crawlers extends AbstractProvider
'binlar',
'biNu image cacher',
'Bitacle',
'Bitrix link preview',
'biz_Directory',
'BKCTwitterUnshortener\/',
'Black Hole',
Expand Down
1 change: 1 addition & 0 deletions tests/crawlers.txt
Original file line number Diff line number Diff line change
Expand Up @@ -3591,6 +3591,7 @@ OnalyticaBot
Pleroma 2.1.50-495-gf9ece1a7-develop+dev; https://search.fedi.app <[email protected]>; Bot
SmerBot/0.1 ([email protected]) Language Model Dataset Fetcher
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/71.0.3578.98 Safari/537.36 Prerender (+https://github.com/prerender/prerender)
Bitrix link preview
Mikrotik/6.x Fetch
Mikrotik/7.x Fetch
HTTPing v2.5
Expand Down

0 comments on commit 6d48e1d

Please sign in to comment.