I'm wondering about deploying Nepenthes on my personal site. To punish any AI crawlers.
https://zadzmo.org/code/nepenthes/
On the one hand I'm wary about tanking my search rankings, on the other... I'm not finding the major search engines much good anymore anyways!
I do like SearchMySite, but I *think* its smart enough to not be tripped up by it.
@alcinnz I'm not sure I know enough to evaluate the strengths and weaknesses of different approaches, but have you seen iocaine?
@alcinnz This explanation helped me understand the motivation for iocaine:
> This has the downside that I need to redirect explicitly, so unknown agents will not be trapped (while they will be caught in Nepanthes' maze!). On the other hand, it means that my content is unavailable for AI crawlers in the first place - at least to known ones.
https://come-from.mad-scientist.club/@algernon/statuses/01JHRNX1KFQV19AVTB54ZFB8EZ
@skyfaller Thanks for the links, I'm investing!