Хэлний загвар дээр суурилсан хиймэл оюун ухаан нь физик орчныг ойлгож, бодит ертөнцийн нарийн төвөгтэй үйлдлийг бие даан гүйцэтгэх чадамжтай болж байна.
Axiom стартапын инженерүүд болох Адитя Рамабадран, Саймон Манс, Тобиас Гесслер нар OpenAI-ийн GPT-6 Astra загварыг ашиглан 2024 оны Toyota Corolla автомашиныг жолоодуулж, түргэн хоолны газрын үйлчилгээний цонх хүртэл амжилттай хүргэжээ. Тэд автомашины салхины шилэнд суурилуулсан камер болон жолоодлогын системийг чат интерфэйстэй холбосон бөгөөд аюулгүй байдлыг хангах үүднээс жолооч хяналт тавьж байв. Энэхүү туршилт нь тусгайлан бэлтгэгдээгүй, ерөнхий зориулалттай хэлний загвар бодит ертөнцийн физик орчинд хэрхэн зохицож ажиллаж буйг харуулсан чухал алхам боллоо.
Технологийн салбарт хиймэл ерөнхий оюун ухаан (AGI) хөгжүүлэлтийн хүрээнд физик орчныг танин мэдэх чадварыг сайжруулах нь гол сорилт болоод байна. Одоогийн хиймэл оюун ухааны загварууд дижитал орчинд өндөр үр дүнтэй ажилладаг ч бодит ертөнцийн нөхцөл байдалд төөрөгдөх нь түгээмэл байдаг. Иймд Elorian AI зэрэг компаниуд робот техник болон бусад салбарт ашиглах зорилгоор хиймэл оюун ухааны физик дүгнэлт хийх чадварыг хөгжүүлэхэд анхаарч байна.
Elorian болон Scale AI компаниуд хамтран хиймэл оюун ухааны загваруудын физик орчныг ойлгох чадварыг хэмжих “Humanity’s Sixth Sense” нэртэй шинэ хэмжүүрийг танилцуулаад байна. Мэргэжилтнүүд энэхүү чадвар нь ирээдүйд гэрийн нөхцөлд ажиллах роботууд болон бусад дэвшилтэт технологийг бүтээхэд зайлшгүй шаардлагатай гэж үзэж байгаа юм. Гэсэн хэдий ч ерөнхий зориулалтын загварыг хөдөлгөөнт техник удирдах үйл явцад ашиглах нь эрсдэлтэй тул цаашид аюулгүй байдлын өндөр шаардлага тавигдах нь тодорхой байна.
Дэлгэрэнгүйг эх сурвалжаас харах
↓Эх сурвалжийг нээх ↓
Aditya Ramabadran, Simon Mahns, and Tobias Gessler, three AI engineers at a startup called Axiom, recently fancied In-N-Out Burger for lunch.
They weren’t about to drive themselves, though. Sitting in a 2024 Toyota Corolla near the Bay Area restaurant’s drive-thru lane, they opened a laptop and asked OpenAI’s GPT-6 Astra to take the wheel. They linked a chat interface to a server, which was connected to several windscreen-mounted cameras and the car’s power steering system. A safety driver kept one foot above the brake, just in case.
The AI model, which is normally tasked with generating text, code, and the odd image, slowly but surely navigated the vehicle up to the take-out window so they could collect their food.
“Maybe AGI is here after all,” one of the engineers remarked, referring to artificial general intelligence, the much-ballyhooed idea of machines that can match human intelligence.
Self-driving cars are nothing new, of course, but they’re normally operated by algorithms specifically trained and engineered for the task. In this case, the operation came from a model designed to output text, and it happened on the fly, with no prior coaching by the trio. The fast-food stunt, as well as a number of other experiments, suggest that language-based AI models are starting to gain a rudimentary but useful understanding of the physical world.
Though nothing overtly alarming happened during the trio’s lunchtime jaunt, they admit that putting a general-purpose model in charge of a fast-moving, two-ton hunk of steel is a high-stakes undertaking. As physical understanding improves, we could see AI models reach into the real world in impressive—and perhaps dangerous—new ways.
Getting Physical
Today’s smartest models are incredibly good at answering complex questions and even performing some virtual tasks autonomously, but their skills tend to be limited to the world of computers and the internet. Take these models into the real world and they quickly become befuddled. Despite claims that AGI has arrived, AI companies evidently see physical reasoning as a yet-to-be-conquered frontier for AI.
Some researchers have left big companies to found startups focused on solving physical reasoning. Andrew Dai, the CEO of one such outfit, called Elorian AI, previously worked as a researcher at Google DeepMind. He says better visual reasoning will open up a lot of new applications for AI, like systems that understand whether diners are enjoying their meal in a restaurant or robots capable of functioning in a home. Dai says robotics is a crucial test case for physical reasoning skills. “It’s pretty essential for robotics,” he says. “You can’t really imagine home robotics without this.”
Elorian and Scale AI, a company that provides training data to big AI labs, recently developed a new benchmark, Humanity’s Sixth Sense, which measures models’ ability to understand physical scenes.
