Drunk & Root@sh.itjust.works to Selfhosted@lemmy.worldEnglish · 2 months agoHow to combat large amounts of Ai scrapersmessage-squaremessage-square54linkfedilinkarrow-up1123arrow-down15file-text
arrow-up1118arrow-down1message-squareHow to combat large amounts of Ai scrapersDrunk & Root@sh.itjust.works to Selfhosted@lemmy.worldEnglish · 2 months agomessage-square54linkfedilinkfile-text
everytime i check nginx logs its more scrapers then i can count and i could not find any good open source solutions
minus-squaredb0@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up20arrow-down1·2 months agoYou need yo block the alibaba subnets primarily. In my experience this is where most of them originate
You need yo block the alibaba subnets primarily. In my experience this is where most of them originate