Anthropic-ийн хиймэл оюун ухааны загварт тавьсан хязгаарлалт хэвээр үлдлээ

Published:

Энэхүү мэдээ, нийтлэлийг хиймэл оюун боловсруулав.

АНУ-ын засгийн газар Anthropic компанийн дэвшилтэт AI загваруудад өнгөрсөн долоо хоногт тогтоосон экспортын хяналтыг цуцалсангүй.

Трампын засаг захиргаа Anthropic-ийн “Claude Fable 5” загварын аюулгүй байдлын хамгаалалтыг алдагдуулж, илүү хүчирхэг “Mythos” загварын чадавхийг ашиглах боломжтой гэж үзэж байна. Даваа гарагт Худалдааны яаманд болсон уулзалтаар засгийн газрын төлөөлөгчид болон компанийн удирдлагууд хэлэлцээ хийсэн ч шийдэлд хүрсэнгүй. Anthropic-ийн зүгээс аюулгүй байдлын эрсдэлийг хэтрүүлэн дүгнэж байна гэсэн байр сууриа илэрхийлсээр байна.

Уг асуудал Amazon компанийн гүйцэтгэх захирал Энди Жэсси Сангийн сайд Скотт Бессентэд хандсанаар эхэлсэн бөгөөд Үндэсний аюулгүй байдлын агентлаг (NSA) уг загварын эмзэг байдлыг шалгах үүрэг хүлээжээ. Үүний дараа Худалдааны сайд Ховард Лютник Anthropic-ийн гүйцэтгэх захирал Дарио Амодей болон бусад төлөөлөгчидтэй хэд хэдэн удаа яриа хэлэлцээ хийсэн байна.

Салбарын мэргэжилтнүүд болон кибер аюулгүй байдлын судлаачид засгийн газрын энэхүү шийдвэрийг эсэргүүцэж, нээлттэй захидал илгээжээ. Тэдний үзэж буйгаар, Anthropic-ийн загварууд нь аюулгүй байдлын аудит хийхэд чухал ач холбогдолтой бөгөөд экспортын хяналт тогтоосон нь АНУ-ын хиймэл оюун ухааны салбар дахь манлайлалд эрсдэл учруулж, зах зээлд тодорхойгүй байдал үүсгэж байна гэв. Талууд асуудлыг шуурхай шийдвэрлэхээр ажиллаж байна.

Дэлгэрэнгүйг эх сурвалжаас харах

Эх сурвалжийг нээх ↓

Trump administration officials concluded talks with Anthropic on Monday without lifting export controls that were imposed last week on the company’s most advanced AI models in response to jailbreaking concerns, according to three people briefed on the matter.

The administration continues to believe that there are ways to disable some of the guardrails on Anthropic’s Claude Fable 5, effectively allowing users to access the more powerful cybersecurity capabilities of the company’s Mythos model, the people said.

Anthropic has said for days that the administration’s concerns are overblown, a position it reiterated in working group meetings held at the Commerce Department with government researchers from Center for AI Standards and Innovation (CAISI) and the Office of the National Cyber Director Sean Cairncross, one of the people said.

The meetings were also attended by Commerce secretary Howard Lutnick, who dialed in by conference call from the G7 summit in Evian, France. Cairncross himself did not participate, the person said.

On Anthropic’s side, cofounder and chief compute officer Tom Brown and head of external affairs Sarah Heck have been leading the discussions. Anthropic’s head of frontier red teaming, Logan Graham, and senior security researcher Nicholas Carlini flew to Washington, DC for the talks.

“Both parties are working quickly to get this resolved,” an Anthropic spokesperson said in a statement to WIRED. A White House spokesperson declined to comment.

It was not immediately clear how any next steps might play out. The Commerce Department expressed a willingness to find a way to bring Fable 5 back online for consumer use, but it would likely be contingent on Anthropic fully resolving the jailbreak concerns, the person said.

Ringing the Alarm

The emergency talks have come at a fraught political moment for Anthropic, which was already in a prolonged fight with the Pentagon over whether its AI models could be used for certain military applications.

The Trump administration was first alerted to the jailbreak concerns last week. Amazon CEO Andy Jassy called Treasury secretary Scott Bessent directly about the alleged vulnerabilities, which played a role in spooking the administration, the people said. Jassy’s conversation with the Trump administration was first reported by The Information.

Alarmed White House officials tasked the NSA to help review the vulnerabilities. The NSA responded that it believed it was indeed possible to strip away Fable 5’s guardrails, prompting the administration to impose restrictions on the model.

Lutnick then spoke with Anthropic chief executive Dario Amodei on Friday, as the Commerce Department drew up its letter imposing export controls on Fable 5. Over the weekend, after Anthropic cut off access to the model for all users, Lutnick was on multiple calls with Brown and Heck, according to a person with knowledge of the events.

It’s unclear why Amazon, one of the largest investors in Anthropic, rang the alarm on Fable 5. “As a leading cloud provider that serves a large number of private and public sector customers, it’s not uncommon for governments to seek our counsel on potential security risks,” an Amazon spokesperson tells WIRED. “When they occur, we don’t share the details of these discussions.”

Security Disconnect

At the core of the conversations between Anthropic and the administration is a disagreement over the severity of the Claude Fable 5 jailbreaking concerns.

In a blog post on Friday, Anthropic implied that the administration’s characterizations of the potential risks are overblown. Some cybersecurity researchers reiterated this position to officials on Monday, sending an open letter arguing that the export control action taken against Anthropic was unjustified.

“Anthropic’s Mythos-class models are quite good at finding flaws and weaponizing exploits. However, they are not uniquely good at these tasks, and many of the undersigned individuals regularly use other foundation and open-source models for security audits and red-teaming every day,” the open letter reads. “As a result, this action has taken the best models away from defenders, created market uncertainty, and risked America’s AI leadership without any real risk to justify it.”

- Зар сурталчилгаа -

Та юу гэж бодож байна?

Сэтгэгдлээ оруулна уу!
Please enter your name here

MFC.mn сайтад сэтгэгдэл оруулахад анхаарах зүйлс

Холбоотой

spot_img

Шинэ

spot_img