minus-squarePlantPowerPhysicist@discuss.tchncs.detoOpen Source@lemmy.ml•The Open-Source Software Saving the Internet From AI Bot Scraperslinkfedilinkarrow-up30·20 hours agothe scrapers ignore robots.txt. It doesn’t really ban them - it just asks them not to access things, but they are programmed by assholes. linkfedilink
minus-squarePlantPowerPhysicist@discuss.tchncs.detoPrivacy@lemmy.world•"Your downvote was reported."linkfedilinkEnglisharrow-up15·3 days agosudo downvote linkfedilink
PlantPowerPhysicist@discuss.tchncs.de to Linux@lemmy.ml · 5 months agoThank you Microsoft, for the final pushplus-squarediscuss.tchncs.deimagemessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imageThank you Microsoft, for the final pushplus-squarediscuss.tchncs.dePlantPowerPhysicist@discuss.tchncs.de to Linux@lemmy.ml · 5 months agomessage-square0fedilink
the scrapers ignore robots.txt. It doesn’t really ban them - it just asks them not to access things, but they are programmed by assholes.