"Video generation models have been improving over the past several years. We've always known that things could get weird when generative video becomes nearly indistinguishable from real video, and we're entering that phase now. We've already seen convincing political and sexual imagery deepfakes. Another devious application of AI generative video will be phishing scams. Over the past six months or so, people have been posting on X about new AI tools that are capable of "face swapping" in real-time video."
"For example, the AI might make it look like it's Leonardo DiCaprio or Scarlett Johansson saying my words and performing my facial expressions during a Zoom call. The AI analyzes the user's facial movements and vocalizations in real time and sends them out via the faces of another person entirely. Some of these AI tools can generate a new face overlay using a single still image."
AI video-generation models have advanced toward producing nearly indistinguishable, realistic video and convincing deepfakes. New real-time face-swapping tools can map a user's facial movements and vocalizations onto another person's face during live video calls. Some tools can create a plausible face overlay from a single still image, and scammers can pair overlays with voice samples to impersonate relatives or public figures and request money. These capabilities enable novel phishing scams over Zoom and other platforms. Apple employees perceive Tim Cook's actions as appeasement of President Donald Trump. Some OpenAI models have declined in writing quality. Mitigation will require detection, platform safeguards, and public awareness.
Read at Fast Company
Unable to calculate read time
Collection
[
|
...
]