The GardenDespatches from The Satyrs’ Forest

Crawler problems

I don’t know whose dumbfuck crawler is responsible for this, but whoever it is, can you please calm down? I welcome robotic visitors1, but they don’t have to be so hyperactive. I promise you the data will still be there tomorrow.

An analytics chart showing a huge spike of visitors in the past day

Edit: The tidal wave has stopped, but i have started logging bots’ User-Agents just in case whatever that thing is comes back. I hope they’re happy with themselves.

Edit #2: Well, that was quick. They’re back… and they’re not even using a “bot” User-Agent to identify themselves! That’s just bad manners.

Edit #3: I’ve implemented a basic rate-limiting system with a limit fast enough that it won’t affect my biological readers. Fingers crossed.

Two comments

  1. NOOB says…
    Canada

    i'm sorry, no bot was involved, i can be hyperfixated and click alot, then tried to use an extension, i stoped, so sorry 😓

    (i'm a total noob and was trying to learn, didn't mean any harm)

  2. Xanthe says…
    2w8373gz the United Kingdom

    @282 Well, you somehow managed to hit every single page on my site several times over. I hope this has been a learning experience for the both of us.

Please be nice. Comments may be edited for proper spelling and capitalisation, because i’m a pedant. Basic formatting: *bold*, /italics/, [//satyrs.eu links]→ More