The Take It Down Act is now fully operational, yet concerns are mounting that it could inadvertently serve as a tool for government censorship rather than primarily protecting victims of image-based sexual abuse.
This legislation mandates that social media platforms swiftly remove sexual deepfakes and other forms of nonconsensual intimate imagery (NCII). However, experts caution that the policy may offer minimal assistance to victims and, in a worst-case scenario, could actively facilitate online censorship.
President Donald Trump signed the Take It Down Act last May, which immediately criminalized the distribution of NCII, encompassing both real and AI-generated content—a measure already partially enacted in many states. The law's more expansive takedown provision, set to take effect on May 19, 2026, will require online platforms to remove NCII within 48 hours or face substantial fines.
In anticipation of this deadline, Federal Trade Commission (FTC) Chair Andrew Ferguson dispatched letters to over a dozen prominent tech companies, including Amazon, Alphabet, Apple, Automattic, Bumble, Discord, Match Group, Meta, Microsoft, Pinterest, Reddit, SmugMug, Snapchat, TikTok, and X. The FTC instructed these platforms to establish user-friendly takedown request processes, remove offending content within 48 hours, and eliminate any "known identical copies." The agency, responsible for enforcing the law, warned companies that violations could incur civil penalties exceeding $53,000 per infraction.
Major platforms such as Meta, Microsoft, Google, TikTok, and Snap have voiced their support for the bill and expressed confidence in their ability to comply. Snap stated in a blog post last year that the Act "aligns with and complements our ongoing efforts." Spokesperson Monique Bellamy affirmed to The Verge that Snap is continually "evolving" its safety systems, including "investing in tools and technologies to proactively detect and take action on unwanted nudes and similar imagery."
Cindy Southworth, Meta's head of women’s safety, highlighted the company's long-standing commitment to combating intimate image abuse on its platforms through content removal, tool development, and legal action against AI "nudify" app developers. Southworth noted that Meta's tools are specifically trained to reject nudifying requests, adding, "We continue to support the TAKE IT DOWN Act, an important step in addressing this abuse across the internet, and we’ve already been compliant for several months." Similarly, TikTok US spokesperson Mahsau Cullinane emphasized the company's zero-tolerance policy for NCII, citing partnerships with NCMEC and StopNCII.org, and its existing in-app reporting tools and forms.
Even X, despite its controversial history with sexualized AI imagery, has endorsed the legislation. The platform faced widespread criticism in 2024 for allowing sexually explicit AI deepfakes of Taylor Swift to circulate, followed weeks later by a video users believed to depict rapper Drake engaged in a sexual act. More recently, its integrated AI chatbot, Grok, was reportedly prompted by users to undress individuals without consent. A New York Times analysis revealed that Grok shared "at least 1.8 million sexualized images of women" in just nine days, with some estimates suggesting even higher figures.
However, the law's takedown provision has raised alarm among both free speech advocates and opponents of online abuse, including those who largely supported its criminalization aspect. Critics argue that even with good-faith enforcement, such laws can incentivize companies to over-moderate non-offending content to mitigate risk. Under the Trump administration, there's concern the Take It Down Act could be weaponized against political adversaries while granting leniency to platforms perceived as favorable to the administration. President Trump himself quipped at his 2025 State of the Union address, "I’m going to use that bill for myself," asserting that "nobody gets treated worse than I do online." Notably, X’s then-CEO Linda Yaccarino attended the signing ceremony, where Trump, whose administration then employed X's owner Elon Musk, commended her for "doing a great job."
Mary Anne Franks, president of the Cyber Civil Rights Initiative—an organization dedicated to fighting image-based sexual abuse—asserted that Trump's statement was "the opposite of what is true." She expressed skepticism about the law's fair enforcement, particularly given Trump's State of the Union comment. "That’s a weird thing to say, and it’s an announcement right from the highest level that this law is not going to be used in a principled way, but rather to settle personal scores," Franks stated.
Franks also voiced suspicion regarding the endorsement of this law by major tech platforms, which typically resist new regulations as burdens on free speech. "My fears about this, and I hope I’m wrong, is that the reason why the companies aren’t mad about this is because they know it’s never actually going to be used against them," she remarked. This, she fears, could leave victims of NCII with little more than false hope.
Furthermore, Franks is concerned that the law could be leveraged against platforms deemed inconvenient by the administration, citing Wikipedia as an example. "I think what is the worst thing that can happen is, it turns out to be a paper tiger against the companies that are doing the worst and turns out to be a way to penalize and to actually truly go after unpopular platforms and to censor speech," Franks explained. She specifically worried about the censorship of LGBTQ+ expression, especially given existing targets on gender-affirming care for transgender youth by the FTC. "I’m very worried about that being used as a pretext to crack down even further on either consensually sexually explicit material, or specifically on educational materials for kids who are exploring their gender identity or exploring their sexual orientation," Franks added. Even if such actions were legally challenged, she noted, they would send a clear message to platforms regarding moderation.
Other organizations, including the Electronic Frontier Foundation (EFF), the Cato Institute, and Public Knowledge, have also cautioned that the notice and removal provision could have significant repercussions for free speech, with the EFF labeling it a blueprint for "overreach and censorship."
Compounding these concerns, the law might not even encompass what appear to be clear-cut digital violations of consent. For instance, some nonconsensual sexualized imagery generated by Grok might not be deemed sufficiently explicit. It remains ambiguous whether AI tools like Grok qualify as "creators" of NCII, potentially holding their owners criminally liable, or if privately produced images fall under the takedown provision. In its first year, the Justice Department reported using the Act's criminal provision in one conviction of an Ohio man who created sexually explicit AI deepfakes to harass victims. While the takedown provision's impact may be felt more immediately, the overarching question remains whether these outcomes will genuinely enhance internet safety.
The Editorial Staff at AIChief is a team of professional content writers with extensive experience in AI and marketing. Founded in 2025, AIChief has quickly grown into the largest free AI resource hub in the industry.