It feels like there's should be some sort of "demonstrable intent to do harm" statute on the books for situations like this.
If you have a genuinely-held belief that AI systems will end life on earth and you willfully continuing working on them anyway, then, like... you probably shouldn't be allowed to walk free in civil society anymore, right?
This is basically already the case in the flourishing indie space, but for different reasons.
The only developers chasing cutting-edge hardware features are the AAA studios and I honestly think a lot of them would just die before successfully relearning how to make games that play well instead of just look pretty.
And since LLMs are apparently good at circumventing the absence of an API, there's not much incentive to add them now. APIs are for humans. LLMs just break through all the captchas and anti-bot measures.
Yes, but for humans it creates friction. Seeing a captcha makes me think twice and thrice if I really want to visit that site so badly that I'll endure the suckage. LLMs don't care, for them the friction doesn't exist.
It must be tuned for rage-based engagement because Claude only ever uses the most obnoxious Claudisms on me despite constant reminders to knock it off.
When was the last time you saw an ad for cigarettes?
Those second-order effects are easy to mitigate with sensible public policy. And it's not like we have to invent the solution from scratch — we've done it before, very effectively.
This is the correct reply to the constant "but whatabout" replies, that inevitably come up whenever you suggest regulation. "You've regulated bad thing X, but then they'll do Y!" So regulate Y! It's not like legislators only get one crack at a law. We should elect a government willing to move fast and iterate when loopholes are uncovered.
The thing is that US Congress can't make laws. It just can't. It's nonfunctional. When it does that's the rare exception, and it better be perfect the first time because you won't get so lucky twice.
I was at a gas station today that sells tobacco. No ads. Its because even displaying tobacco products, let alone advertising them, is not allowed in that jurisdiction.
I'll bet you didn't see any cartoon camels or doctors recomending a brand though, because even where tobacco ads are legal, many tobacco ads are no longer legal.
Whether you see ads, and what kind of ads you see is highly regulated. That's the whole point,
So applied math, math, applied math, applied math, and maybe some others.
That makes sense, although I'd argue that at least in the realm of HEP theoretical physics has extraordinarily expensive kit compared to what scientists make. See: The LHC.
I think it's telling that "Researchers cost more than any other aspect of research" seems to involve primarily math as inputs and outputs. Like I said the obvious outlier is theoretical physics because that tends to involve significant resources both to explore (supercomputers) and verify (colliders, telescopes, interferometers, etc). Most people involved in research in any number of fields do not find that their collective salaries are the majority of the cost required; math is an outlier in many cases.
In science fiction, the AI agent has written the training loop management software and included a back door to prevent that from happening (or found a way to talk to the training loop management agent and convinced them to not listen to the evil human when it tries to do brain surgery on the AI agent.
Also, when the human reaches for the power switch the AI agent uses a flaw in the power management software to weld the switch shut with a big power surge, killing the human with a huge electric arc in the process.
I don’t think whether we will get there, but the stories of LLMs escaping their sandbox make me think we’re moving in that direction.
The stories of LLMs "escaping the sandbox" were mostly a marketing stunt, trying to make people in government think the models are invincible hacking weapons that need lots of government money to "maintain AI dominance".
They might just merge with OpenAI. Right now it seems they are still working out who might come out on top but they are both burning tons of money and essentially offer the exact same product up to some minor differences, economically it makes much more sense for them to collude instead of compete for the same market. They might be colluding already for all we know. If they manage to push out foreign competitors they can probably divvy up the Western market quite profitably as their domestic competitors would have less than 20 % (?) market share together?
I don't see how merging or colluding fixes their problems, though. Both companies burn cash at historic rates because inference costs a lot more than people want to pay for it. Even if they somehow manage to crowd out any competitors and fix the price of AI, that price can't be much higher than it is today or people will just decide to stop paying for it.
No amount of collusion can solve the core economics problem of compute.
They could ~halve their training costs with collusion.
Instead of each paying full price to generate a SOTA model in competition, they could share the result and split the cost. This gets even simpler if they merge.
If you have a genuinely-held belief that AI systems will end life on earth and you willfully continuing working on them anyway, then, like... you probably shouldn't be allowed to walk free in civil society anymore, right?
reply