I, for one, find the language used in these posts and publications extremely off-putting. "Behaviour", "teaching", "the model's ethics". And this is presumably written by technical folks, who know how these systems actually work, and should know better than to use such anthropomorphic, magicalhocus-pocus terminology.
I think the hocus-pocus language is also to a large part responsible for this ridiculous hype bubble in the first place, why investors are ignoring all the warning signs and betting it all on vapourware, why mass media is diligently ignoring that all of those amazing projections are built on an entirely fictitous circular zero-sum game with made-up numbers, and why non-tech executives are talked into sacrificing their companies' product quality, service level, and know-how for a third-party dependency with some vague promises of future savings and some unproven efficiency gain.
More personally, it makes me very glad that I left CS research more than a decade ago. My friends from academia, and having remote-visited a conference again recently, confirmed my suspicion that this is what CS research is largely about these days. Throw tokens at the wall, pull the handle, see what sticks and present it as a discovery. Nobody asks about what could possibly be learned from it, and nobody cares. Nothing is reproducible in any reasonable sense of the word, and nothing is of any real use for other researchers. These communities and conferences used to be about curiosity, discovery, and collaboration. Now it's just about showing what everyone got from the slot machine. How terminally boring.
> this is presumably written by technical folks, who know how these systems actually work, and should know better than to use such anthropomorphic, magicalhocus-pocus terminology
I get your point. But regardless of whether we can definitively establish if any of these Generative AI LLM agents are conscious (we cannot, because we can't even say the same of our fellow humans, see Philosophical Zombies), the bigger issue which we are already in the midst of is that many people believe and behave as if they were, and how that downstream behavior has very real consequences in our world which cannot be ignored.
The results of people anthropomorphizing needs to be dealt with more than the actual process itself (which we have no way to stop anyhow).
These agents have mostly conquered the realm of intelligent-seeming expression of complex ideas through language. Speaking about their actions in terms of ethical concepts is not only appropriate, but necessary.
I think the hocus-pocus language is also to a large part responsible for this ridiculous hype bubble in the first place, why investors are ignoring all the warning signs and betting it all on vapourware, why mass media is diligently ignoring that all of those amazing projections are built on an entirely fictitous circular zero-sum game with made-up numbers, and why non-tech executives are talked into sacrificing their companies' product quality, service level, and know-how for a third-party dependency with some vague promises of future savings and some unproven efficiency gain.
More personally, it makes me very glad that I left CS research more than a decade ago. My friends from academia, and having remote-visited a conference again recently, confirmed my suspicion that this is what CS research is largely about these days. Throw tokens at the wall, pull the handle, see what sticks and present it as a discovery. Nobody asks about what could possibly be learned from it, and nobody cares. Nothing is reproducible in any reasonable sense of the word, and nothing is of any real use for other researchers. These communities and conferences used to be about curiosity, discovery, and collaboration. Now it's just about showing what everyone got from the slot machine. How terminally boring.