What does it say about me that when I run my writing through one of those "detect if AI" tools I seldom see a value of less than 70% confidence that the writing was AI generated?
It baffles me when I see ostensibly smart people refusing to click shift. Especially programmers. I know you can do it! I've seen you use curly brackets!
Simple: The derived variance in your word usage and sequences, is outside the mean distribution range, that would be labeled as AI generated, given this specific evaluation algorithm
It’s not nondeterministic
you can probably do the shannon entropy calculation yourself if you understand what the evaluation algorithm is
That said…if the evaluator is non-deterministic, then there’s no value in the estimate anyway
I haven't tried my HN comments; I've only tried things spanning more than a few sentences and that I've put more effort into. I only discovered this when my son put an e-mail I wrote to his teacher that he was CC'd on into the tool on his school iPad.
I really don't see how this can be possible unless they're accepting abysmal recall? Perhaps I'm missing something fundamental here, but the idea that AI and non-AI assisted text can be separated with "nearly 0 false positives" just says to me that it's really just a filter for the weakest, most obvious AI generated text. Is that valuable?
about you? not much. but i wouldnt spin up a blog, or even longer comments here, if you want to keep your sanity.
the amount of "that is obvious ai slop" comments i see on mine or other people's genuine non-ai writing has discouraged me from sharing anything more than roughly a paragraph for probably the rest of my life.