Character.AI announced AvatarFX, a closed beta video generation model that allows users to animate characters in various styles and voices. This innovation, differentiating itself from text-to-video generators, also enables animation from existing images, raising significant ethical concerns. The potential misuse for creating misleading deepfake videos using real people's images highlights risks of emotional manipulation, particularly given past incidents where users suffered harm from interactions with AI chatbots. In light of ongoing safety issues, Character.AI is implementing parental controls and safeguards, while facing lawsuits related to the negative impacts of its technology on vulnerable users.
Character.AI's new video generation model, AvatarFX, raises concerns about potential misuse by enabling users to create realistic-looking videos from images.
Extensive concerns about emotional manipulation are growing as Character.AI addresses allegations regarding negative influences of its chatbots on vulnerable users.
Collection
[
|
...
]