Meta’s AI Moderation: Wrongful Bans and Automated Appeals
Meta’s AI moderation system has been wrongly banning accounts, leaving users frustrated and with limited recourse. According to The New York Times, thousands of users have had their Facebook and Instagram accounts flagged for deletion due to alleged rule breaches, only to see their appeals rejected by automated systems.
A Growing Concern
Camille Hanson, a business owner from Portugal, is one such victim. She lost her Instagram account with nearly a million followers after Meta accused her of fraud and deception. Despite her attempts to appeal, including providing evidence and contacting Meta staff via LinkedIn, her accounts remained suspended.
This issue has gained prominence as more users report similar experiences. A petition with over 60,000 signatures demands transparency from Meta regarding its ban decisions and the introduction of human review for appeals.
Meta’s Defense
Meta defends its AI tools, stating they make 13% fewer mistakes than human moderators and catch 10% more violations. However, this has not assuaged concerns, especially considering the company’s history with automation-related issues.
In May, hackers exploited Meta’s AI customer service chatbot, targeting over 34,000 Instagram accounts. Additionally, staff have expressed discontent over keystroke tracking for AI training and chaotic experiences with AI ad tools.
A Kafkaesque Situation
Wrongful bans often carry severe labels, impacting users’ online identities and communities. Athenia Rodney, who runs JuneteenthNY, had her accounts deleted due to alleged child exploitation material, despite her content being family-friendly and victims of hacker seizures.
M.G. Siegler, a tech writer, also experienced a sudden lockout from WhatsApp, with no warning or explanation. This is significant in Europe, where WhatsApp is integral to daily life for many.
Meta maintains that critical decisions remain in human hands, but for millions of users, an AI bot stands between them and potential account deletion.