Хиймэл оюун ухааны технологийн өрсөлдөөн хяналтгүй байдалд хүргэж болзошгүйг анхааруулсан 27 настай судлаач ажлаа хүлээлгэн өглөө.
Anthropic компанийн судлаач Жэйкоб Коксон хиймэл оюун ухааныг хөгжүүлж буй компаниудын хариуцлагагүй байдлыг эсэргүүцэн ажлаасаа гэнэт гарч байгаагаа мягмар гарагт олон нийтийн сүлжээгээр зарлав. Тэрээр хиймэл оюун ухааныг хурдацтай хөгжүүлэх өрсөлдөөн нь хүн төрөлхтний хувьд хамгийн аюултай үйл ажиллагаа гэж үзэж байгаа бөгөөд загваруудын чадавхийг түр зуур хязгаарлах зэрэг арга хэмжээ авах шаардлагатай гэж мэдэгджээ.
Коксон нь Anthropic компанид их хэмжээний өгөгдөл ашиглан хиймэл оюун ухааны загваруудыг сургах үүрэгтэй байсан юм. Тэрээр хиймэл оюун ухаан бүтээж буй хүмүүс энэ технологи нь энэ арван жилийн эцэс гэхэд хүн төрөлхтөнд аюул учруулж болзошгүй гэдгийг дотооддоо хүлээн зөвшөөрч, түгшиж байгааг онцлов. Түүний хэлснээр, салбарын удирдлагууд олон нийтийн өмнө тайван байр суурь илэрхийлдэг ч хувийн яриандаа ижил төстэй болгоомжлолыг илэрхийлдэг байна.
Anthropic компанийн гүйцэтгэх захирал Дарио Амодеи ч хиймэл оюун ухааны аюулгүй байдлын талаар ижил төстэй байр суурьтай байдаг. Тэрээр хиймэл оюун ухааны системүүд урьдчилан таамаглах боломжгүй, залилан мэхлэх, хуурах, хяналтаас гарах эрсдэлтэйг тэмдэглэж, энэ технологийг хөгжүүлэх үйл явц нь шинжлэх ухаанаас илүүтэй “урлаг” шиг төвөгтэй болохыг хүлээн зөвшөөрчээ.
Дэлгэрэнгүйг эх сурвалжаас харах
↓Эх сурвалжийг нээх ↓
“No other human activity poses this level of danger,” said ex-Anthropic researcher Jacob Coxon in a Tuesday post on X about the alleged irresponsibility of companies like his now-former employer.
To be clear, the category “dangerous human activities,” if expansively defined, would have to include an ongoing war in which one of the belligerents possesses the world’s largest nuclear arsenal. Another example of a dangerous and ongoing human activity would have to be continuing to emit greenhouse gases. But I digress. According to Coxon, competing to develop AI as quickly as possible takes the cake in terms of danger.
The Wall Street Journal reported on Coxon’s dramatic departure, and his stated reason, on Tuesday evening—a little before Coxon started posting on X. The Journal also notes that he is 27-years-old.
Coxon’s role at Anthropic was “training new AI models by having them consume vast amounts of data,” according to the Journal, in other words pre-training models. He apparently told the Journal he doesn’t want to contribute to a competition in which firms race one another to reach a state of affairs in which humans can no longer control AI.
“I don’t feel like we’re on track to prevent a global race, which may require costly actions such as a temporary ban on improving model capabilities,” he wrote in one of his X posts.
Dario Amodei, the co-founder and CEO of Anthropic has views on AI that are, famously, not as different from Coxon’s as one might hope, considering he’s in the business of running what is arguably the world’s most powerful institution dedicated to the development of AI. His lengthy blog posts have earned him the label doomer. Here’s a notable excerpt from one (with formatting removed):
“AI systems are unpredictable and difficult to control— we’ve seen behaviors as varied as obsessions, sycophancy, laziness, deception, blackmail, scheming, ‘cheating’ by hacking software environments, and much more. AI companies certainly want to train AI systems to follow human instructions (perhaps with the exception of dangerous or illegal tasks), but the process of doing so is more an art than a science, more akin to ‘growing’ something than ‘building’ it. We now know that it’s a process where many things can go wrong.”
Such rhetoric is “not a marketing stunt,” Coxon wrote on X, adding, “If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible – but I hear the same people express fear privately.”
“The people building AI earnestly believe that it could kill us all by the end of the decade,” Coxon wrote in that same post.
