Researchers from the College of Zurich secretly ran a months-long AI experiment on Reddit’s 3.8M-member r/changemyview neighborhood with out consumer consent.
A bunch of researchers from the College of Zurich ran a covert months-long experiment utilizing AI-generated feedback to affect Reddit customers with out their data or consent.
The experiment happened on r/changemyview, a 3.8M-member subreddit identified for civil debate. The researchers deployed giant language fashions (LLMs) to put in writing personalised, persuasive replies, posing as actual folks, to see if AI may change customers’ views.
The small print
- AI-generated feedback, posing as actual customers, had been posted to sway opinions.
- Personas included trauma survivors and controversial political voices.
- The AI used private information scraped from customers’ histories to tailor persuasive replies.
- Not one of the exercise was disclosed, violating subreddit and Reddit-wide guidelines.
This wasn’t nearly bots.
It was psychological manipulation utilizing private information to check how efficient AI may be at altering folks’s minds.
Reddit’s Chief Authorized Officer Ben Lee referred to as it “deeply fallacious on each an ethical and authorized stage” and confirmed that Reddit is making ready formal authorized motion.
Photograph by Brett Jordan on Unsplash
The researchers’ protection
They declare their ethics board authorised the challenge and argue their objective was to indicate how AI could possibly be misused to govern elections or unfold hate speech.
“We imagine the potential advantages of this analysis considerably outweigh its dangers,” the researchers wrote.
The backlash
Mods of r/changemyview had been outraged, calling the analysis “unwelcome” and “manipulative.”
They’ve filed a criticism and requested the college to dam publication of the examine. This experiment reveals a rising menace: AI-powered persuasion at scale, with out consent. It reveals how simply folks may be influenced when AI is aware of your beliefs and may mimic your friends.
Redditors had been used as take a look at topics.
This wasn’t simply an educational train. It reveals how highly effective and delicate AI manipulation may be, particularly when it mimics trusted human voices utilizing private information.
With generative AI changing into widespread, the chance of AI-driven manipulation is now not theoretical. It’s actual, and it simply occurred on one of many web’s greatest communities.
Now Reddit, one of many world’s largest on-line communities, is preventing again.
Researchers from the College of Zurich secretly ran a months-long AI experiment on Reddit’s 3.8M-member r/changemyview neighborhood with out consumer consent.
A bunch of researchers from the College of Zurich ran a covert months-long experiment utilizing AI-generated feedback to affect Reddit customers with out their data or consent.
The experiment happened on r/changemyview, a 3.8M-member subreddit identified for civil debate. The researchers deployed giant language fashions (LLMs) to put in writing personalised, persuasive replies, posing as actual folks, to see if AI may change customers’ views.
The small print
- AI-generated feedback, posing as actual customers, had been posted to sway opinions.
- Personas included trauma survivors and controversial political voices.
- The AI used private information scraped from customers’ histories to tailor persuasive replies.
- Not one of the exercise was disclosed, violating subreddit and Reddit-wide guidelines.
This wasn’t nearly bots.
It was psychological manipulation utilizing private information to check how efficient AI may be at altering folks’s minds.
Reddit’s Chief Authorized Officer Ben Lee referred to as it “deeply fallacious on each an ethical and authorized stage” and confirmed that Reddit is making ready formal authorized motion.
Photograph by Brett Jordan on Unsplash
The researchers’ protection
They declare their ethics board authorised the challenge and argue their objective was to indicate how AI could possibly be misused to govern elections or unfold hate speech.
“We imagine the potential advantages of this analysis considerably outweigh its dangers,” the researchers wrote.
The backlash
Mods of r/changemyview had been outraged, calling the analysis “unwelcome” and “manipulative.”
They’ve filed a criticism and requested the college to dam publication of the examine. This experiment reveals a rising menace: AI-powered persuasion at scale, with out consent. It reveals how simply folks may be influenced when AI is aware of your beliefs and may mimic your friends.
Redditors had been used as take a look at topics.
This wasn’t simply an educational train. It reveals how highly effective and delicate AI manipulation may be, particularly when it mimics trusted human voices utilizing private information.
With generative AI changing into widespread, the chance of AI-driven manipulation is now not theoretical. It’s actual, and it simply occurred on one of many web’s greatest communities.
Now Reddit, one of many world’s largest on-line communities, is preventing again.
