Controversial AI picture platform Civitai dropped by its cloud computing supplier after stories of potential CSAM

OctoML says it has ended its enterprise relationship with Civitai days after an investigation by 404 Media revealed the text-to-image platform was getting used to generate photos that “may very well be categorized as baby pornography.” Civitai beforehand relied on OctoML’s OctoAI for picture technology. Whereas OctoML initially indicated it might proceed working with Civitai and launched new measures to curb the creation of dangerous photos, 404 Media reported on Saturday that it has now determined to chop ties with the platform altogether.

Based on 404 Media’s December 5 report, inner communications confirmed that OctoML was conscious some Civitai customers had been creating sexually express materials that included nonconsensual photos of actual folks and pornographic depictions of kids. In a followup report this weekend, the publication famous that OctoML rolled out a filter to dam the technology of all NSFW content material on Civitai earlier than saying its choice to tug out. Civitai additionally added new moderation strategies in response to the investigation earlier this week, together with a compulsory embedding referred to as Civitai Protected Helper (Minor) that bars the mannequin from producing photos of kids if “a mature theme or key phrase is detected,” based on 404.

Andreessen Horowitz-backed Civitai has beforehand come under scrutiny for its “bounties” feature that challenges customers to generate reasonable photos of actual folks for rewards. In November, 404 Media discovered it was getting used to make nonconsensual deepfakes of celebrities, influencers and even a non-public citizen that had been, in lots of instances, sexual in nature. The themes had been primarily girls. Based on 404 Media, Civitai has since added a filter to stop the creation of NSFW content material that includes “sure” celebrities.

Nonetheless, OctoML — which makes use of Amazon Internet Companies’ servers — not needs to be concerned. In an announcement to 404 Media on Saturday, OctoML stated, “We have now determined to terminate our enterprise relationship with Civitai. This choice aligns with our dedication to making sure the protected and accountable use of AI.”

This text initially appeared on Engadget at https://www.engadget.com/controversial-ai-image-platform-civitai-has-been-dropped-by-its-cloud-computing-provider-195530538.html?src=rss

Trending Merchandise

0
Add to compare
Corsair 5000D Airflow Tempered Glass Mid-Tower ATX PC Case – Black

Corsair 5000D Airflow Tempered Glass Mid-Tower ATX PC Case – Black

$174.99
0
Add to compare
CORSAIR 7000D AIRFLOW Full-Tower ATX PC Case, Black

CORSAIR 7000D AIRFLOW Full-Tower ATX PC Case, Black

$269.99
.

We will be happy to hear your thoughts

Leave a reply

AmazDealzHub
Logo
Register New Account
Compare items
  • Total (0)
Compare
0
Shopping cart