Track_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 1 month agoRISE UPslrpnk.netexternal-linkmessage-square14fedilinkarrow-up1627arrow-down18
arrow-up1619arrow-down1external-linkRISE UPslrpnk.netTrack_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 1 month agomessage-square14fedilink
minus-squareTheTechnician27@lemmy.worldlinkfedilinkEnglisharrow-up30·1 month agoThe inverse of robots.txt: crawling robots without their consent.
The inverse of robots.txt: crawling robots without their consent.