yeah I’m not thrilled with the methodology “just buy a domain, lie on Wikipedia, and LLMs will buy your bullshit.” I certainly don’t doubt it, either.
It really is like the old SEO days, only the LLMs whitewash your lies for you. People trust what pops up at the top of Google results as being fact.

AI avatar man wants you to be afraid: “sleeper agents”! “backdoors”! “poisoned documents”! Terrifying!

It is terrifying. People in positions of power have placed entirely too much trust in these machines that are this easily fooled. I’d argue that we shouldn’t trust these machines as much as they are, but I don’t think the rest of the world is listening enough to these warnings.

I also worry about how broken search result rankings have gotten. For someone like me who doesn’t use these AI products, it concerns me that actual search engines (which I do use) continue to get worse.

Sure, there are lessons here for those who build and maintain LLMs, but everyone else should still be terrified at how the world is moving towards, rather than away, this nonsense.