Page 1 of 1

Bytespider has found me help

Posted: Fri Sep 08, 2023 8:27 pm
by AlphaGameDeveloper
Bytespider has found me :/
If it is self hosted, how can I kick this radioactive spider in it's rear end?
Also- How did it find me in the first place? I'm pretty sure no other website linked to me...

Code: Select all

wordpress    | 47.128.27.94 - - [08/Sep/2023:20:21:50 +0000] "GET /wp-content/uploads/2023/02/docker.png HTTP/1.1" 200 7182 "https://alphagame.dev/posts/technology/i-screwed-up-big-time/" "Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; [email protected])"

Re: Bytespider has found me help

Posted: Sat Sep 09, 2023 6:20 pm
by MattKC
What HTTP server software are you using? If it's Apache or NGINX, you should be able to just block its user agent. If you go through Cloudflare, you can also block in Cloudflare before it even reaches your server.

Here's the article for Apache I found that gave me the idea to block, though I use NGINX so I couldn't use the instructions directly.

Re: Bytespider has found me help

Posted: Thu Sep 14, 2023 6:41 pm
by AlphaGameDeveloper
I'm using Caddy