"Screenshots included in the report show a purported romance scam that OpenAI said likely originated in Cambodia. The report said users asked ChatGPT to create a logo for a fake high-end dating service, generate images of fake women, and provide tax advice. OpenAI estimated that the scam, which it said targeted Indonesian men interested in luxury lifestyle content, was 'likely defrauding hundreds of victims a month.'"
"The operation worked by getting users to choose from a list of fictitious women and relationship types. After building trust, an AI chatbot posing a flirty receptionist directed the conversation over to Telegram. On Telegram, a mixture of humans using ChatGPT and API would use 'romantic and sexually-explicit language' to direct users to fake dating services and eventually entice them to do a series of 'tasks' or 'missions' that 'required increasingly large payments via bank transfers or digital payment wallets.'"
"The AI company also said it banned 'a cluster of ChatGPT' accounts that posed as law firms, individual attorneys, and US law enforcement. OpenAI said the scammers asked ChatGPT to generate a fake New York State Bar Association credentials and other fraudulent legal documents."
OpenAI released an intelligence threat report documenting malicious use of ChatGPT by scammers and state actors. The report details a romance scam originating from Cambodia targeting Indonesian men, using ChatGPT to create fake dating service logos, generate images of fictitious women, and provide financial advice. The operation defrauded hundreds of victims monthly by building trust through AI chatbots before directing users to Telegram for increasingly expensive payment schemes. OpenAI also identified banned accounts impersonating law firms, attorneys, and US law enforcement, generating fraudulent credentials. Additional threats included disinformation operations targeting political figures, demonstrating ChatGPT's misuse across financial fraud, legal impersonation, and state-sponsored information warfare.
#chatgpt-misuse #romance-scams #fraud-and-impersonation #state-sponsored-disinformation #ai-security-threats
Read at Business Insider
Unable to calculate read time
Collection
[
|
...
]