> But you can’t just set an agent loose in production. It can easily corrupt the database, and all it can do afterwards is apologize and promise not to do it again.
More and more, people are just gonna do it. After all, the same statement is true if employees, and they're rapidly becoming less trustworthy that frontier models.
Reckless and negligent idiots are criminals. They should be stopped be stopped before they get someone killed. Chernobyl happened because of massive negligence, not because someone thought a meltdown would make good PR.
If you consider these guys admitted they dont really have eyes on pre and post training, then incompetence really does seem more likely... especially with how fast they are moving. Its the SaaS playbook, move fast and break shit.
reply