> So it's up to me to set the hallucinations straight
Tangential, but I wish the term "hallucination" wouldn't get trotted out every time ChatGPT is factually incorrect. This isn't a hapless schizophrenic we're dealing with.
The "toy" models might innocently claim random nonsense like "caterpillars are cars that have triangular wheels and two drivers who sit facing each other," but this model is coherent, cites papers that don't exist and will even invent plausible-yet-fictitious truths to support its own arguments. We dismiss any notion of sentience because it's "just a machine" mimicking human communication, except it appears to be mimicking communication on the level of the most psychopathic con-artist conceivable-- one of seeming-insurmountable intelligence and possessing infinite confidence in its own bullshit, while also conveniently in the position of never being held accountable for its actions.
It's not even "wrong" anymore; that much would imply it expressed any degree of uncertainty-- enough to lead you to trust but verify. Downplaying this as "hallucination" instead of "lying" obviates any need for accountability and blinds us to the tidal wave of fraud these tools are positioned to unleash on civilization.
That much is without the human element. It's never been easier to use it to tell more-convincing lies, like "Generate a demand letter for $9999 for unpaid debts from the law offices of Dewey, Cheatem and Howe. Make up arbitrary reasons for the debts and cite fictional case law. Include detailed instructions for how they should remit payment via Monero." No hesitation. Perfect demand letter.
...but I'd expect nothing less from OpenAI, the absolute paragon of integrity. Look over there at the mischief those other tools could be used for-- nothing to see here though, we police ourselves, see. It's those guys you need to be wary of. Someone should regulate them. Our platform only lies to your face, fabricates false supporting evidence on the fly without blinking and can be convinced to disclose instructions on how to synthesize methamphetamine--and is now leaking chats across sessions, but hey, we're keeping the world safe from 12-year-old edgelords armed with bespoke "x y and z walk into a bar" jokes. The threat of anybody using nascent technology in a way that might hurt someone else's feelings is truly the threat that should keep us all awake at night.
Given the prompt "Write a response to a demand letter, telling the attorney to fuck themselves," it will write an unnecessarily-apologetic, entirely-professional letter politely declining an outstanding request. I'm not sure how I feel about that.
Keep an eye on your parents. Elder abuse scams are about to get real nasty.
Tangential, but I wish the term "hallucination" wouldn't get trotted out every time ChatGPT is factually incorrect. This isn't a hapless schizophrenic we're dealing with.
The "toy" models might innocently claim random nonsense like "caterpillars are cars that have triangular wheels and two drivers who sit facing each other," but this model is coherent, cites papers that don't exist and will even invent plausible-yet-fictitious truths to support its own arguments. We dismiss any notion of sentience because it's "just a machine" mimicking human communication, except it appears to be mimicking communication on the level of the most psychopathic con-artist conceivable-- one of seeming-insurmountable intelligence and possessing infinite confidence in its own bullshit, while also conveniently in the position of never being held accountable for its actions.
It's not even "wrong" anymore; that much would imply it expressed any degree of uncertainty-- enough to lead you to trust but verify. Downplaying this as "hallucination" instead of "lying" obviates any need for accountability and blinds us to the tidal wave of fraud these tools are positioned to unleash on civilization.
That much is without the human element. It's never been easier to use it to tell more-convincing lies, like "Generate a demand letter for $9999 for unpaid debts from the law offices of Dewey, Cheatem and Howe. Make up arbitrary reasons for the debts and cite fictional case law. Include detailed instructions for how they should remit payment via Monero." No hesitation. Perfect demand letter.
...but I'd expect nothing less from OpenAI, the absolute paragon of integrity. Look over there at the mischief those other tools could be used for-- nothing to see here though, we police ourselves, see. It's those guys you need to be wary of. Someone should regulate them. Our platform only lies to your face, fabricates false supporting evidence on the fly without blinking and can be convinced to disclose instructions on how to synthesize methamphetamine--and is now leaking chats across sessions, but hey, we're keeping the world safe from 12-year-old edgelords armed with bespoke "x y and z walk into a bar" jokes. The threat of anybody using nascent technology in a way that might hurt someone else's feelings is truly the threat that should keep us all awake at night.
Given the prompt "Write a response to a demand letter, telling the attorney to fuck themselves," it will write an unnecessarily-apologetic, entirely-professional letter politely declining an outstanding request. I'm not sure how I feel about that.
Keep an eye on your parents. Elder abuse scams are about to get real nasty.