Well LLMs also spout a lot of bullshit sometimes. I had a conversation with one just recently where it couldn’t do arithmetic too well with a challenge involving coins of a foreign currency. I think maybe it got tripped up because the convo got a bit too long or maybe it didn’t like that I was using the dollar sign.

You can also make LLMs agree with your own biases for some reason. For example, the people who use them to plan shady stuff.