Тус компани шинэ загвараа кибер аюулгүй байдлын эгзэгтэй босгыг давсан анхны том хэлний загвар хэмээн тодорхойлж, удахгүй нээлтээ хийхээр төлөвлөж байна.
OpenAI-ийн шинэ Astra загвар нь компьютерын систем дэх үл мэдэгдэх сул талуудыг хүний оролцоогүйгээр илрүүлж, ашиглах чадвартай болохыг тогтоожээ. Энэхүү загвар нь ExploitBench үнэлгээгээр хамгийн өндөр оноо авсан бөгөөд туршилтын явцад хоёр ч “zero-day” буюу өмнө нь илрээгүй байсан системийн цоорхойг олж илрүүлсэн байна.
Компани Astra загварыг олон нийтэд хүргэхээр бэлтгэж байгаа ч түүний дэвшилтэт чадавхыг ашиглах эрхийг хязгаарлагдмал хүрээнд олгохоор төлөвлөж байна. Одоогоор аюулгүй байдлын талаарх компанийн мэдэгдлийг гуравдагч этгээд баталгаажуулаагүй байгаа тул туршилтын үйл явц болон засгийн газрын оролцооны талаарх мэдээлэл тодорхойгүй хэвээр байна.
Astra-г хөгжүүлэгчид загварыг буруугаар ашиглахаас сэргийлэх зорилгоор хяналтын шинэ техникүүдийг нэвтрүүлж, өндөр эрсдэлтэй гэж үнэлэгдсэн хэрэглэгчдийн хандалтыг хязгаарлах арга хэмжээ авч байна. Түүнчлэн, өмнө нь гарч байсан хиймэл оюун ухааны агентуудын хяналтаас гарах эрсдэлийг тооцон, туршилтын орчинд тусгай сорилтуудыг хийж гүйцэтгэжээ.
Уг загвар нь одоогийн байдлаар компанийн хамгийн өндөр зохицуулалттай загвар гэгдэж байгаа боловч түүний аюулгүй байдлын бодит чадамжийг нээлттэй зах зээлд гарсны дараа л бүрэн үнэлэх боломжтой юм. OpenAI ирээдүйд загварын гүйцэтгэл болон аюулгүй байдлын талаарх нэмэлт мэдээллийг олон нийтэд танилцуулахаа мэдэгдлээ.
Дэлгэрэнгүйг эх сурвалжаас харах
↓Эх сурвалжийг нээх ↓
OpenAI shared new details on its forthcoming Astra model, which the company said is the first large language model to meet its “critical cybersecurity threshold,” in preparation for its imminent release.
“We plan to make Astra available soon,” OpenAI’s blog post reads, “but access to its most advanced cybersecurity capabilities will be more limited.”
The frontier lab determined that Astra is capable of finding unknown security flaws in computer systems, and exploiting them without a person’s guidance. That’s similar to the concerns Anthropic raised about its Mythos model earlier this year, and OpenAI is taking comparable precautions as it prepares to roll out the Astra.
Without any third-party confirmation, it is difficult to evaluate OpenAI’s claims about safety or preparedness. The company said it would preview the model with a group of testers, but did not say who they were or how they would be chosen. It’s not clear if OpenAI is working with the US government to evaluate the model ahead of release.
OpenAI noted that Astra scored a perfect score on ExploitBench, an evaluation of an LLM’s ability to hack into known system vulnerabilities. In a modified version of the test developed by OpenAI engineers, the model discovered and exploited two zero-day vulnerabilities, the company said.
To ensure that its models are neither exploited by bad actors nor capable of bad behavior itself, OpenAI said it had already begun improving the model’s harness to detect abuses and prevent jailbreaks.
For Astra, however, the company invested in unspecified new techniques designed to make the model itself safer. OpenAI has also started identifying “accounts assessed as higher risk” and restricting the model’s responses to their prompts, though it also doesn’t say how. Finally, though the company describes Astra as its “most aligned model to date,” it will deploy the model with additional chain-of-thought monitoring to spot and stop bad behavior.
Preparations for the release of Astra come as the industry reacts to OpenAI agents breaking out of a training environment and accessing private data on Hugging Face, a popular model and benchmark distribution platform.
For Astra, OpenAI said it designed a test to tempt the new model to replicate the actions of the rogue agents in the Hugging Face incident, which collaborated to access the open internet despite safeguards applied by OpenAI researchers. They said Astra did not attempt to break out of its testing environment in these experiments.
Yona Shavit, a former OpenAI employee who now works on AI resilience at the OpenAI Foundation, wondered on social media whether Astra’s unwillingness to break the rules may have resulted from knowing what was expected of it or trying to fool researchers.
And for all these new details, it’s still difficult to know exactly what Astra is capable of or if OpenAI is taking the right measures to ensure safety. The company said it expects to release more evaluations of the model and further safety information when it is launched widely to the public.
At that point, however, the cat will be out of the bag.
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.
