“Project Lily” нэртэй төслийн хүрээнд хиймэл оюун ухааны хариултыг сайжруулах зорилгоор хэрэглэгчдийн нууц мэдээллийг хянаж байгаа нь нууцлалын асуудлыг хөндлөө.
404 Media-гийн мэдээлснээр, OpenAI компани ChatGPT-ийн хариултын чанарыг сайжруулах зорилгоор олон зуун гэрээт ажилтныг ажиллуулж, хэрэглэгчдийн яриаг хянуулж байна. Энэхүү үйл ажиллагаа нь модератор хийх бус, харин хиймэл оюун ухааныг хэт хүний зан авир гаргах болон хэт дагасан хариулт өгөхөөс сэргийлэхэд чиглэж байгаа аж. Гэрээт ажилтнууд хэрэглэгчийн нууц мэдээлэл агуулсан чатуудыг ч уншиж, үнэлгээ өгдөг байна.
Уг үйл явц нь “Project Lily” хэмээх төслийн хүрээнд хэрэгжиж байгаа бөгөөд хэрэглэгчид өөрсдийн харилцан яриаг хүн уншиж байгаа гэдгийг мэдэх боломжгүй байна. Хэдийгээр OpenAI яриаг аноним байдлаар боловсруулдаг гэх боловч зарим тохиолдолд хэрэглэгчийн амьдардаг газар болон хувийн мэдээлэл илрэх эрсдэлтэйг хүлээн зөвшөөрчээ. “Privacy Filter” хэмээх нууцлалын систем нь алдаа гаргах магадлалтай гэдгийг тус компанийн цахим хуудсанд дурдсан байна.
Тус компанийн зүгээс хэрэглэгчид “моделийн гүйцэтгэлийг сайжруулах” тохиргоог идэвхгүй болгосноор энэхүү хяналтаас татгалзах боломжтой гэж тайлбарлаж байгаа ч энэ нь анхдагчаар идэвхтэй байдаг. Ардчилал ба технологийн төвийн судлаач Михал Луриагийн үзэж буйгаар, чатбот нь хэрэглэгчдэд хувийн нууцлалтай мэт хуурамч мэдрэмж төрүүлдэг нь олон нийтийн сүлжээний контентын хяналтаас эрс ялгаатай аюултай тал юм. OpenAI өмнө нь аюулгүй байдлын үүднээс хяналт тавьдаг байсан ч хэрэглэгчийн хувийн яриаг сайжруулалт хийх зорилгоор уншиж байгаагаа тодорхой зарлаагүй нь шүүмжлэл дагуулж байна.
Дэлгэрэнгүйг эх сурвалжаас харах
↓Эх сурвалжийг нээх ↓
If you ever feel like spilling your guts to ChatGPT, just know that you may have an audience.
404 Media reports that OpenAI is hiring hundreds of employees to sift through and read users’ prompts — including messages that contain sensitive personal information.
This isn’t part of a moderation effort. Instead, by reviewing the prompts, OpenAI hopes to improve the responses that ChatGPT gives. The contractors rate and critique each of the AI’s replies, with internal documents showing a focus on nudging ChatGPT away from anthropomorphizing itself and to be less sycophantic, 404 found.
Both qualities — anthropomorphizing and sycophancy — have been heavily scrutinized for their role in so-called AI psychosis, cases in which an AI incites and drives a user’s delusional behavior. Numerous lawsuits allege that an older, less restrained version of ChatGPT powered by GPT-4o drove their users to suicide.
Still, there are tradeoffs. Many users would probably find this surveillance of their chats, part of an operation dubbed “Project Lily,” to be an alarming invasion of privacy — if they had any idea this was happening.
Asked if they thought ChatGPT users knew about humans reading their chats, one of the employees replied: “No.”
“I don’t think they would imagine some contractor somewhere… is analyzing the conversations,” they told 404.
It’s unclear how many prompts are being read or how OpenAI decides to select them. But some of them include chats in which the user explicitly asks ChatGPT to keep their conversations private, 404 found.
The prompts that’re selected are anonymized, but sometimes include personal information. The dashboard that the employees use also includes a “user memories summary” that can give details about previous conversations, which can produce details on where the user lives. When 404 reached out to OpenAI, the company said it used a “Privacy Filter” model to anonymize conversations, which its website states “can make mistakes.”
OpenAI could reasonably be accused of acting quite shifty about this practice. It’s well known at this point that it has employees read messages for moderation and safety purposes. But it didn’t respond to 404’s question about if it explicitly told users that humans are reading prompts to improve the AI. Later, after 404 published its piece, it pointed to a page on its website stating that humans may review prompts to “improve model performance.” Users can opt-out of this practice by turning off the “improve the model for everyone” setting, but this is enabled by default.
Michal Luria, a senior research fellow at the Center for Democracy and Technology, told 404 that while human review can be “essential to safety,” she noted that “chatbot interfaces automatically create a false sense of intimacy and privacy.”
“This is quite distinct from content moderation on social media, where publishing content already carries expectations of platform moderation and public exposure,” Luria added.
In any case, it does seem like OpenAI is feeling conscious about how its AI models sound. Employees, for example, flagged and wrote down cases of “AI-speak” and“unnecessary use of emojis,” which are common tell-tales of chatbot usage.
“It would be appropriate to include a tree emoji when planning Arbor Day celebrations,” a document given to the employees explained, “but skull emojis when discussing death, or plane emojis when giving updates on a fatal crash, are not.”
The iceberg may go deeper. An FAQ section provided to the reviewers says that they don’t need to worry about fact-checking the responses, and alludes to other project teams that “handle content verification.”
More on OpenAI: OpenAI Faces Congressional Probe Over Swarm Hacking Incident
The post OpenAI Has Hundreds of Workers Reading People’s Private Chats appeared first on Futurism.
