California AG sends cease and desist to xAI over Grok’s explicit deepfakes

California Attorney General Rob Bonta has sent a cease and desist letter to xAI, days after his office launched an official investigation into the company over reports that Grok was generating nonconsensual

If you’ll recall, xAI and Grok have been under fire for taking images of real individuals and putting them in revealing clothing like bikinis upon random users’ requests.

Bonta’s office demands that xAI immediately cease and desist from creating “digitized sexually explicit material” when the depicted individual didn’t consent to it or if the individual is a minor. It also demanded that xAI stop “facilitating or aiding and abetting the creation… or publication of digitized sexually explicit material” of nonconsenting individuals and persons under 18 years of age.

X changed its policies after the issue broke out and prevented the Grok account from being able to edit images of real people into revealing clothing. xAI also moved Grok’s image-generating features behind a paywall and geoblocked paying users’ ability to edit images of real people into bikinis, but only in regions where it’s illegal.

In his announcement, Bonta said xAI developed a “spicy mode” for Grok to generate explicit content and used it as a marketing point. The California AG also said that Grok-generated sexual images are being used to harass both public figures and ordinary users. “Most alarmingly, news reports have described the use of Grok to alter images of children to depict them in minimal clothing and sexual situations,” Bonta’s announcement reads.

“The actions above violate California law, including California Civil Code section 1708.86, California Penal Code sections 311 et seq. and 647(j)(4), and California Business & Professions Code section 17200,” it said. The state’s Department of Justice now expects to hear from xAI on the steps it’s taking to address these issues within the next five days.

This article originally appeared on Engadget at https://www.engadget.com/ai/california-ag-sends-cease-and-desist-to-xai-over-groks-explicit-deepfakes-140000574.html?src=rss

Read more @ Engadget

Latest posts

Discord says ‘vast majority’ of users won’t see its new age verification setup

On Tuesday, Discord released an update clarifying that the "vast majority of people can continue using Discord exactly as they do today," without needing...

My favorite Switch 2 controller is 30 percent off for today only

The EasySMX S10 is a fantastic wireless controller for the Switch 2 that offers nearly as many features as Nintendo’s $90 gamepad. I ranked...

Ayaneo’s new Windows handheld will cost up to $4,299 with maxed out specs

The Next 2 features a 9.06-inch OLED screen with an adjustable refresh rate. | Image: Ayaneo Ayaneo opened preorders for its next Windows 11 handheld...

Fitbit’s AI health coach is now available on your iPhone

Google announced on Tuesday that the public preview of Fitbit's AI personal health coach is rolling out to iOS users in the U.S. as...

Trump’s new ‘Buy American’ requirement for EV charging would dramatically curtail build-out

It seems clear at this point to say that Donald Trump does not want to spend a single dime on EV charging. He tried...

Samsung’s next Unpacked is confirmed for later this month

Samsung's annual Galaxy S-series reveal is later than usual this year, but we finally have a confirmed date to circle on the calendar: February...

ChatGPT’s deep research tool adds a built-in document viewer so you can read its reports

OpenAI is updating ChatGPT's deep research tool with a full-screen viewer that you can use to scroll through and navigate to specific areas of...

Bezos could have saved The Washington Post’s local news and sports reporters

Demonstrators hold a "Save The Post" sign next to a cutout image of Jeff Bezos during a "Save The Post" rally outside the Washington...

Boston Dynamics CEO Robert Playter is stepping down after six years

Robert Playter, CEO of Boston Dynamics, announced on Tuesday that he is stepping down from his role effective immediately and leaving the company on...

Facebook is offering Meta AI-powered animations for profile photos

Meta has been going all in on AI, whether people want it or not, and now it's bringing more features in that vein to...