General_Effort@lemmy.world to Technology@lemmy.worldEnglish · 1 month agoReddit will block the Internet Archivewww.theverge.comexternal-linkmessage-square161fedilinkarrow-up1913arrow-down19cross-posted to: [email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]
arrow-up1904arrow-down1external-linkReddit will block the Internet Archivewww.theverge.comGeneral_Effort@lemmy.world to Technology@lemmy.worldEnglish · 1 month agomessage-square161fedilinkcross-posted to: [email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected][email protected]
minus-squareNatanael@infosec.publinkfedilinkEnglisharrow-up4·1 month agoThe ability to block crawling is separate from the ability to delist old pages. The latter usually happens after domains change owners
The ability to block crawling is separate from the ability to delist old pages. The latter usually happens after domains change owners