Andy Reid@lemmy.world to Technology@lemmy.worldEnglish · 5 months agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square193fedilinkarrow-up1968arrow-down115
arrow-up1953arrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid@lemmy.world to Technology@lemmy.worldEnglish · 5 months agomessage-square193fedilink
minus-squareNullPointer@programming.devlinkfedilinkEnglisharrow-up2·5 months agoa bad-bot .htaccess trap.
a bad-bot .htaccess trap.