Хиймэл оюун ухаан нь программ хангамжийн эмзэг байдлыг илрүүлэх, засах үйл явцыг хурдасгасан ч бие даан шинэ халдлагын арга зам боловсруулахад хязгаарлагдмал хэвээр байгаа аж.
Агент хэлбэрийн хиймэл оюун ухаан нь программ хангамжийн эмзэг байдлыг илрүүлэх, засах эсвэл зэвсэг болгох процессыг хурдан бөгөөд хялбар болгосноор кибер аюулгүй байдлын салбарыг өөрчилсөн байна. Вэб аюулгүй байдлын судлаач Жеймс Кеттл Лас Вегас хотноо болсон “Black Hat” бага хурлын үеэр хиймэл оюун ухааны кибер аюулгүй байдлын чадавх болон түүний хязгаарлалтын талаарх судалгааны үр дүнг танилцуулжээ. Тэрээр агентийн шинжтэй хиймэл оюун ухаан нь хүний оролцоогүйгээр цэвэр бие даасан байдлаар шинэ халдлагын аргуудыг зохион бүтээх тал дээр маш хязгаарлагдмал болохыг тогтоосон байна. Гэсэн хэдий ч чухал мөчүүдэд хүний зөвлөгөө, ойлголттой хосолсон үед хиймэл оюун ухаан нь халдлагын шинэ стратегийг боловсруулах, илрүүлэхэд хүчирхэг хамтрагч болж чадаж байгааг онцолжээ.
Кеттл 2025 оны есдүгээр сараас эхлэн Anthropic болон OpenAI-ийн хамгийн сүүлийн үеийн загваруудыг ашиглан сар гаруй хугацаанд туршилт хийсний үр дүнд “Shared-Parser Confusion” буюу вэб серверүүд хүсэлт болон хариуг боловсруулахдаа хуваалцсан код ашигладагтай холбоотой цоо шинэ эмзэг байдлын хүрээг илрүүлжээ. Энэхүү олдвор нь хиймэл оюун ухааны систем бодит болон баталгаажсан өгөгдөлд дүн шинжилгээ хийж таамаглал дэвшүүлсний үндсэн дээр судлаач үнэлж баталгаажуулсан хүний болон хиймэл оюун ухааны хамтын ажиллагааны үр дүн юм. Туршилтын явцад хиймэл оюун ухаан нь судлаачийн өөрийнх нь илрүүлж чадахаас ч хурдацтай үр дүнд хүрч, бүтээмжтэй судалгааны эргт холбоог үүсгэсэн байна.
Энэхүү олдвор нь маш ховор төрлийн эмзэг байдалд хамаарч байсан бөгөөд тухайн үеийн боломжит байдалд шууд ашиглагдах боломжгүй байжээ. Гэсэн хэдий ч энэ нь хиймэл оюун ухааны системүүд хамгаалалтын болон халдлагын кибер аюулгүй байдлын ажилд хэрхэн хүчтэй хувь нэмэр оруулж болохыг харуулсан чухал жишээ болсон байна. Судлаачийн үзэж буйгаар хиймэл оюун ухаан үүнийг дангаараа баталж чадахгүй байсан ч хүний тусламжгүйгээр хэзээ ч олж илрүүлж чадахгүй байсан чухал нээлтийг хамтран хийж чаджээ.
Дэлгэрэнгүйг эх сурвалжаас харах
↓Эх сурвалжийг нээх ↓
Agentic AI has permanently changed cybersecurity by making it quicker and easier to discover vulnerabilities in software and fix them—or develop so-called exploits to weaponize them. But longtime web security researcher James Kettle wanted to look beyond the bug-hunting apocalypse to explore a question that has taken on even more urgency as major AI organizations disclose real-world examples of rogue AI hacking: Can agentic AI develop novel, abstract hacking methods, from concept through to practical attacks?
At the Black Hat security conference in Las Vegas on Wednesday, Kettle presented his findings, which illustrate both AI’s rapidly advancing cybersecurity capabilities and its limitations. For now, the answer to Kettle’s question is nuanced. He concluded that AI is perhaps minimally capable but extremely limited in its ability to devise new attack paths in a fully autonomous way. Importantly, though, when paired with human guidance and insight in key moments, Kettle found that AI is an extremely powerful partner in conceptualizing and uncovering new strategies for hacking.
After spending years researching web security vulnerabilities, Kettle now says he has uncovered an entirely new area of potential vulnerability—dubbed Shared-Parser Confusion—as the result of an AI revelation about web servers using shared code to process both requests and responses.
“This is an absolutely massive deal, because if you think about it, requests to a website are completely untrusted, they could be anything, but responses are trusted,” Kettle told WIRED ahead of his conference talk. “So this is a major attack surface and potentially spills into a lot of different attack types.”
The finding came out of months of experiments that began in September 2025 using Anthropic and OpenAI’s latest models at the time. Kettle wanted to explore AI’s ability to do theoretical security research, but quickly realized that one obstacle was that the systems were attempting to pass existing research off as original by returning findings about extremely esoteric topics that were difficult to vet. With this in mind, he decided to scope his tests more narrowly so the AI systems were working within his own area of web security expertise. This way he had total command of the material and knew that AI couldn’t trick him. Additionally, Kettle realized that by synthesizing his own research methodology and training models on it, he could probe deeper into what the systems were capable of extrapolating on their own.
“I’m interested in pushing AI to the absolute limit to see where it fails and where you need a human,” Kettle says. “There are still very few people talking about where the limits are, especially in the security space, because there aren’t incentives to talk about that angle. Everyone wants to be seen as AI native, not talk about where their system falls apart completely.”
As Kettle honed his experiments—providing models with more methodological data and more refined parameters—and as time passed and more powerful models debuted, he says the systems had more and more findings at a rate far surpassing his own, creating what he describes as a productive research feedback loop.
“It was really interesting going through the process. It would have notable findings maybe every two days without me even logging into the system, to the point that it was making me anxious,” Kettle says, “like I almost don’t want to know. It was so many research leads that you have FOMO about not exploring all of them, so it forces you to automate more analysis.”
In addition to finding more proven examples of certain vulnerabilities in a few months than Kettle could likely find in a few years, he also hoped that the AI system could find an entire novel class of those types of bugs. And in a way it did succeed, he says, but the finding related to an extremely rare type of bug and was not actually exploitable in the one vulnerable target available. Kettle emphasizes, though, that the Shared-Parser Confusion finding was so significant, even though it was a human/AI collaboration, because it illustrates the reality of how AI systems can contribute most powerfully to cybersecurity work right now for both defensive and offensive hacking.
“It wasn’t able to prove this itself, but it analyzed some real, proven findings and came up with the hypothesis, and I evaluated it and confirmed it,” Kettle says. “That’s probably going to be the discovery that has the biggest long-term impact. It couldn’t do that on its own, but I would never have found that on my own for sure. Even if you gave me the single line from the [documentation], I wouldn’t have seen it. But together we managed to find it.”
