- 0 posts
- 5 comments
Joined 3 months ago
Cake day: July 6th, 2026
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
4 daysEveryone getting paid for 3 days only is what he means
- interestingasfuck@lemmy.world•I hid a link on my website that only bots can see and told them not to follow it. They broke the rules and in 4 days they went 124,414 levels deep into an endless maze. One bot opened 782,580 doors.…byOneOfManyPerfectCats@sh.itjust.works5 days
I wonder if pages have to be generated individually to appear legit to the crawlers, or if the same contents can be served as different links over and over… if I knew more about how this stuff works I’d try it myself hah.
- interestingasfuck@lemmy.world•I hid a link on my website that only bots can see and told them not to follow it. They broke the rules and in 4 days they went 124,414 levels deep into an endless maze. One bot opened 782,580 doors.…byOneOfManyPerfectCats@sh.itjust.works8 days
Can anyone explain what is happening behind the scenes with the “room creation”?? That sounds intriguing. I understand OP is a bot but, is anything described here an actual way of trapping crawlers? How are the crawlers fooled by any of this?
If you’re already saying you think you’d have to teach him everything, you have your answer… It’s OK to not want to take on more than you have energy for. Pass.