Track_Shovel@slrpnk.net to Microblog Memes@lemmy.worldEnglish · 3 days agoLa_Brea_V2.0.exeslrpnk.netimagemessage-square64fedilinkarrow-up1840arrow-down113
arrow-up1827arrow-down1imageLa_Brea_V2.0.exeslrpnk.netTrack_Shovel@slrpnk.net to Microblog Memes@lemmy.worldEnglish · 3 days agomessage-square64fedilink
minus-squarebless@lemmy.mllinkfedilinkEnglisharrow-up5·2 days agoBeware of dog signs also have no enforcement of law. But apart from that, if your crawler ends up stuck in an endless loop, that’s poor coding on your part. Human beings won’t browse a static website endlessly, neither should a crawler
Beware of dog signs also have no enforcement of law.
But apart from that, if your crawler ends up stuck in an endless loop, that’s poor coding on your part. Human beings won’t browse a static website endlessly, neither should a crawler