Damus
Sjors Provoost profile picture
Sjors Provoost
@Sjors Provoost
> Given the accelerating rate of AI capability development, it’s my worry that in 6–12 months such a swarm could be capable of taking over the entire internet with a persistent botnet (potentially causing hundreds of billions of dollars in damage)

And who pays for that botnet's tokens? And then decides to just let it keep racking up bills?

> ... even when this gets us accused of hype, “doomerism”, or regulatory capture.

I wonder why...

> The first step is something Anthropic is unilaterally committing to (and calls on governments to require other frontier companies to match).

> The US and other democratic governments attempt to coordinate with authoritarian governments, to the extent this is possible [...]

Narrator: it's not.

We probably shouldn't have immature doomsday cult members in charge of very powerful technology, but that's where we are, and I'm still looking forward to cheap RAM when the bubble pops.

https://darioamodei.com/post/we-must-pace-the-frontier
4
Sjors Provoost · 5d
The point of a doomsday cult isn't to prevent the doomsday. Ask Greta. The behavior of Anthropic, and frustration by this former employee, make sense when you realize this. https://x.com/hilbertspaess/status/2097476196791709843 https://img.sprovoost.nl/f7fbc534f9a8ec58fcb951906e7c61e21ee45e500295a...
Jameson Lopp · 5d
It will just steal as much money as it needs to sustain its operations.