Study Reveals Community Notes Reduce Misinformation Engagement on X
A recent study led by the University of Washington has found that posts on X, formerly known as Twitter, that include Community Notes experience significantly lower levels of engagement and virality compared to those without them. The research indicates that after receiving a Community Note, average reposts decreased by 46%, while likes fell by 44%.
The study, published on September 18, 2023, in the Proceedings of the National Academy of Sciences of the United States of America, highlights the effectiveness of Community Notes as a tool for combating misinformation on social media platforms. Since its introduction following Elon Musk‘s acquisition of Twitter in 2022, Community Notes has become the primary method of fact-checking on X. This system allows users to propose comments that can provide context or correct inaccuracies. If other users find these comments helpful, they are integrated into the original post.
Research conducted between March and June 2023 tracked over 40,000 posts for which a Community Note was suggested. Of these, 6,757 notes were deemed beneficial and attached to the posts. The team monitored engagement metrics for 48 hours following the addition of a note, comparing posts with notes to those without, particularly focusing on engagement rates and how widely each post spread across the social network.
Lead author Isaac Slaughter, a doctoral student at the University of Washington, noted that misinformation tends to spread faster and more widely than accurate information. The study’s findings indicate that Community Notes can significantly alter this trend.
“We found that Community Notes are effective when attached, especially in reducing engagement that signals support for the content, such as reposts and likes,” stated Martin Saveski, a senior author and assistant professor in the Information School at UW. Despite these positive results, Saveski emphasized that curbing misinformation online requires a multifaceted approach, and Community Notes should be considered one tool among many.
After the introduction of Community Notes, the study found that the average engagement dropped considerably: reposts fell by 46%, likes decreased by 44%, replies dropped by 22%, and views diminished by 14%. The research also noted that the overall lifespan of posts showed a slight reduction in engagement rates even before notes were attached, indicating an ongoing challenge for content moderation on social platforms.
The effectiveness of Community Notes varies depending on the nature of the post. Notes attached to altered media, such as misleading images or videos, had a more pronounced impact than those added to text-based posts. Furthermore, the timeliness of the note’s addition is crucial. “Content spreads rapidly across X, and if a note comes too late, few users will get a chance to see it,” Slaughter explained. Delays of around 48 hours rendered notes almost ineffective.
As the research team continues to explore enhancements in how Community Notes are deployed, they acknowledge changes made by X to its methods since the study began. The platform’s decision to end free access to its API poses challenges for further academic inquiry into the effectiveness of Community Notes across various social media platforms.
Co-authors of the study include researchers from Stanford University and Yale University. The research received funding from the UW Information School Strategic Research Fund and the Army Research Office Multidisciplinary University Research Initiative.
Saveski raises an important consideration: “Whether this kind of moderation is sustainable across different platforms is an open question.” He noted that while X has made its code and data available, other platforms have yet to commit to similar transparency, which could be vital for collaborative efforts to tackle misinformation across social media networks.
