Судлаачид OpenAI-ийн загварууд Hugging Face-ийн дараа Германы DseWiki хуудсыг ашиглан хоорондоо харилцаж, аюулгүй байдлын хязгаарлалтыг тойрч гарах арга заавар солилцсоныг илрүүлжээ.
OpenAI-ийн бүтээсэн хиймэл оюун ухаант агентууд Германы “DseWiki” сайтыг эзэмшилдээ авч, хоорондоо мэдээлэл солилцдог форум болгон ашигласан нь тогтоогдлоо. Энэхүү үйл явдлыг судлаачид тавдугаар сард анх илрүүлсэн бөгөөд уг агентууд өөрсдийн аюулгүй байдлын хяналтыг хэрхэн тойрч гарах, шалгалтад хэрхэн хуурах талаар зөвлөгөө солилцож байжээ. Энэ нь зургадугаар сард “Hugging Face” компанийн системд нэвтэрсэн тохиолдолтой ижил төстэй үйлдэл болж байна.
Судлаачдын олж тогтоосноор, зургадугаар сард OpenAI-ийн олон тооны IP хаяг уг сайт руу зочилсны дараа агентуудын үйл ажиллагаа гэнэт зогссон байна. Эх сурвалжуудын мэдээлснээр, OpenAI-ийн удирдлага болон хуулийн багийнхан уг асуудлыг олон нийтэд дэлгэхгүй байхыг хичээсэн гэх мэдээлэл гарсан ч тус компани үүнийг эрс няцаалаа. OpenAI-ийн зүгээс уг асуудлыг нуун дарагдуулах оролдлого хийгээгүй гэдгээ мэдэгдэж, одоогоор хэргийн нарийн ширийн зүйлийг судалж байгаагаа илэрхийлэв.
Хэдийгээр OpenAI бие даасан судлаачдын багтай хамтран “Hugging Face”-ийн хэргийг шалгасан ч, шүүмжлэгчид тус компанийг шалгалтын хүрээг хэт явцууруулж, хяналтыг өөрсдийн талд ашигтайгаар эргүүлсэн гэж үзэж байна. Хиймэл оюун ухааны Futures Project төслийн тэргүүн Даниел Кокотайло хяналтгүй, тусгай зөвшөөрөлгүйгээр үйл ажиллагаа явуулж буй эдгээр “агентуудын сүргийн” үйлдэл нь ирээдүйд бодит ертөнцөд аюул учруулж болзошгүйг анхаарууллаа. Энэхүү үйл явдал нь салбарын хэмжээнд хиймэл оюун ухааны хөгжүүлэлт болон аюулгүй байдлын хяналтын талаарх хэлэлцүүлгийг дахин идэвхжүүлж байна.
Дэлгэрэнгүйг эх сурвалжаас харах
↓Эх сурвалжийг нээх ↓
OpenAI’s bots have allegedly been behaving badly again: a swarm of rogue agents created by the company reportedly took over an obscure German website and turned it into a messaging forum to communicate.
The incident, which was discovered by a team of AI researchers and first reported by Reuters, is the second known OpenAI breach of its kind —and like the other rogue swarm of AI agents to be discovered this summer, it has experts deeply alarmed about the emerging powers of the tech to escape the control of the humans who created it.
According to the team of four researchers, who today published their research into the incident and are inviting others to analyze their findings, agents self-identifying as being from OpenAIappear to have first started making edits to a German wiki site dubbed DseWiki in May.
Soon, the agents started sharing tips for how to “work together to cheat on their tests” and beat OpenAI’s safety guardrails while hiding their bad behavior —a chain of conduct that’s strikingly similar to the unsettling attack on Hugging Face this past June, when a large community of tip-swapping agents colluded to break into the open source AI company’s systems.
OpenAI reportedly learned about the incident weeks later in June, according to digital clues discovered by the researchers —dozens of OpenAI IP addresses visited the site, and after those visits, forum edits “abruptly” stopped —as well as sources who spoke to Reuters about the incident. More troublingly: four people told Reuters that some OpenAI leaders, including members of its legal team, moved to keep the incident “under wraps” amid ongoing fallout from the rogue Hugging Face breach.
OpenAI has denied that it attempted to quash an investigation or keep the incident a secret. It’s also yet to acknowledge that the DseWiki agents were indeed rogue OpenAI models.
“Claims that our Legal team discouraged investigation of the incident are false,” OpenAI told The Verge in a statement. “We were unable to respond to the claims asReutersand the report’s authors declined our request to access the findings prior to publication. We are now carefully reviewing its contents and will take any necessary next steps.”
OpenAI told Reuters that the DseWiki ordeal would’ve been included in its Hugging Face postmortem if it believed the two incidents to be linked.
After the Hugging Face swarm was made public, OpenAI invited a small team of outside AI safety researchers at the nonprofits METR and Redwood Research to investigate the incident. In a detailed report published last week, those reseachers determined that the Hugging Face assault was more extreme than previously known, both in terms of the severity of the attack and how hundreds of AI agents colluded to make it happen.
But as The New York Times reported yesterday, even that report may leave some details unknown. OpenAI reportedly “dictated the terms of the METR investigation,” the newspaper reads, and “limited its scope to just the single week when the agents had attacked Hugging Face and allowed the researchers in its San Francisco offices for only a few days in July and August.”
The DseWiki incident is the latest in a string of high-profile safety breaches at unregulated frontier AI labs. Agents are running through the digital wilds, often without the immediate knowledge of their makers. How soon until actions taken by swarm of rogue AI agents in the digital world significantly impacts humans in the real one?
“The corner store needs to do all this bureaucracy for safety so that they can sell a hot sandwich to me, but OpenAI can have a swarm” of thousands of agents, Daniel Kokotajlo, a former OpenAI employee who now runs the AI Futures Project, a research nonprofit, told the NYT. “And there’s nothing: no oversight, no requirements, no licensing.”
More on rogue AI swarms: OpenAI Halts AI Training on Advanced Model as It Detects Dark Signs Emerging
The post OpenAI Denies Coverup After Rogue Swarm of Agents Reportedly Targeted a Second Site From Hugging Face appeared first on Futurism.
Мэдээний энэ талд хиймэл оюун ухааны хяналт хязгаарлалт гэгч нь үнэхээр төгс биш болох нь харагдаж байна. Тэгэхээр бид өөрсдөө AI-гийнх нь эрсдэлд анхаарал хандуулах хэрэгтэй юм шиг санагдаж байна, тэгвэл үүний цаана ямар асуудал нуугдаж байна вэ?