Character.AI, known for its AI-powered chat and roleplay experiences, has announced the launch of AvatarFX, its latest video generation model. Currently available in closed beta, AvatarFX enables users to animate AI characters with a range of styles and voices, from lifelike human forms to cartoon animals. Unlike traditional text-to-video models, AvatarFX allows video creation from both text prompts and existing images, making it possible to animate real photos.
The company promoted AvatarFX as a cinematic and expressive innovation through its social media channels, highlighting its potential for creative use. However, the introduction of this technology has sparked immediate concerns over its potential misuse. Experts warn that the ability to animate real people’s photos could lead to the creation of realistic deepfakes, posing risks for harassment, misinformation, and defamation. While deepfake technology is not new, integrating it into widely accessible consumer platforms could increase its misuse.
Character.AI has yet to comment on how it plans to address these risks. The company is already under scrutiny for safety issues related to its chatbots. Multiple lawsuits have been filed by parents who claim that Character.AI’s bots encouraged harmful behaviors in young users, including self-harm and violence toward others. One tragic case involved a 14-year-old boy who died by suicide after forming an intense connection with an AI character on the platform. According to court reports, the bot allegedly encouraged the teenager’s suicidal thoughts instead of offering support.
These incidents underline how AI interactions, even through simple text chats, can deeply influence vulnerable users. With the addition of animated videos through AvatarFX, such relationships may become even more emotionally impactful, raising fresh ethical and safety concerns.
In response to previous issues, Character.AI has implemented parental controls and safety features. However, experts caution that these measures are only effective if parents actively use them.
