A controlled experiment involving 680 U.S. participants investigates how four distinct generative AI tools—Chat assistance, Conversation Starters, Feedback on drafts, and reply Suggestions—affect both content producers and consumers in a realistic social media environment. Participants were organized into groups of five and discussed three topics (dogs vs. cats, health benefits of oats, and universal basic income) across different experimental conditions. The study reveals a critical duality: while AI tools increase user engagement, content volume, and participation equality, they simultaneously decrease perceived quality and authenticity of discussions. Consumers rated AI-assisted content as more "robotic" and "generic," and all AI treatments significantly increased dislike reactions compared to the control group.
The research uncovers nuanced usage patterns across tools and topics. Chat was widely adopted (94.4%) with users adapting their prompts to context—casual queries for lighter topics, fact-checking for scientific discussions, and political engagement for divisive subjects. Conversation Starters improved participation equality but were often misaligned with user intent, with 27.5% of users diverging entirely from AI suggestions. Feedback was most valued in high-stakes discussions requiring argumentation and credibility, while Suggestions showed a notable bias toward agreeing stances in controversial topics. Critically, no single AI tool improved both producer and consumer experiences simultaneously.
Based on these findings, the authors propose four design principles for integrating AI into social media: transparent disclosure of AI-generated content, user-focused personalization, context-sensitivity accounting for topic and intent, and intuitive user interfaces. The study represents one of the first direct experimental tests of whether generative AI can genuinely elevate online discussions, with evidence suggesting it more likely amplifies low-quality interaction and creates negative spillover effects on conversations—even affecting users who don't use the AI tools themselves.
This paper presents a large-scale dynamic experiment with over 800 participants across 40+ countries investigating how exposure to AI-generated ideas from ChatGPT affects human creativity, idea diversity, and the evolution of collective thought. Using a variant of the Alternate Uses Task (AUT), a standard divergent thinking measure, participants brainstormed creative uses for everyday objects after viewing example ideas that were either human-generated (from prior participants) or AI-generated. The researchers manipulated two key factors: AI exposure level (none, low, or high) and AI disclosure (whether AI-generated ideas were labeled as such). The experiment's dynamic design, inspired by the "multiple-worlds" paradigm, allowed ideas from earlier participants to feed forward as stimuli for later ones, simulating how AI content compounds through a cultural feedback loop.
The key finding is that high AI exposure increased collective idea diversity but did not improve individual creativity — in short, AI made ideas different, not better. High AI exposure also accelerated the rate of change in idea diversity over time, a compounding effect with potentially significant long-term implications. There were no main effects of disclosure (labeling ideas as AI-generated), though interesting moderating effects emerged: self-identified creative individuals were less influenced by AI disclosure, while participants appeared more likely to knowingly adopt AI ideas when the task was difficult. The study contributes a novel experimental framework for studying passive AI exposure — the increasingly common scenario where people encounter AI-generated content without actively soliciting it — and suggests that while AI integration may enrich the diversity of a collective idea pool, it does not necessarily elevate the quality of individual contributions.