A/HRC/38/35 explaining the selection of specialized flaggers, their interpretations of legal or community standards or their influence over company decisions. 35. Human evaluation. Automation often will be supplemented by human review, with the biggest social media companies developing large teams of content moderators to review flagged content. 108 Flagged content may be routed to content moderators, which will typically be authorized to make a decision — often within minutes — about the appropriateness of the content and to remove or permit it. In situations where the appropriateness of particular content is difficult to determine, moderators may escalate its review to content teams at company headquarters. In turn, company officials — typically public policy or “trust and safety” teams with the engagement of general counsel — will make decisions on removals. Company disclosure about removal discussions, in aggregate or specific cases, is limited.109 36. Account or content action. The existence of inappropriate content may trigger a range of company actions. Companies may limit content removal by jurisdiction, a range of jurisdictions, or across an entire platform or set of platforms. They may apply age limitations, warnings or demonetization.110 Violations may lead to temporary account suspensions, while repeat offences may lead to account deactivation. In very few cases outside of copyright enforcement do the companies provide “counter-notice” procedures that permit users posting content to challenge removals. 37. Notification. A common complaint is that users who post reported content, or persons complaining of abuse, may not receive any notification of removal or other action.111 Even when companies issue notifications, these typically indicate merely the action taken and a generic ground for action. At least one company has attempted to provide more context in its notifications, but it is unclear whether additional detail in stock notifications constitutes sufficient explanation in all cases.112 Transparency and notifications go hand in hand: robust operational-level transparency that improves user awareness of the platform’s approaches to content removals alleviates the pressure on notifications in individual cases, while weaker overall transparency increases the likelihood that users will be unable to understand individual removals in the absence of notifications tailored to specific cases. 38. Appeals and remedies. Platforms permit appeals of a range of actions, from profile or page removals to removals of specific posts, photos or videos. 113 Even with appeal, however, the remedies available to users appear limited or untimely to the point of nonexistence and, in any event, opaque to most users and even civil society experts. It may be, for instance, that reinstatement of content would be an insufficient response if removal resulted in specific harm — such as reputational, physical, moral or financial — to the person posting. Similarly, account suspensions or content removals during public protest or debate could have significant impact on political rights and yet lack any company remedy. Transparency 39. Companies have developed transparency reports that publish aggregated data on government requests for content removal and user data. Such reporting demonstrates the kinds of pressures the companies face. Transparency reporting identifies, country by 108 109 110 111 112 113 See Sarah Roberts, “Commercial content moderation: digital laborers’ dirty work”, Media Studies Publications, paper 12 (2016). Cf. Wikipedia: BOLD, revert, discuss cycle. Reddit moderators are encouraged to offer “helpful rule explanations, tips and links to new and confused users” (Reddit Moddiquette). YouTube policies (nudity and sexual content policies); YouTube Help, “Creator influence on YouTube”. Submissions by ARTICLE 19, p. 7 and Association for Progressive Communications, p. 16. See https://twitter.com/TwitterSafety/status/971882517698510848/. Electronic Frontier Foundation and Visualizing Impact, “How to appeal”, onlinecensorship.org. Facebook and Instagram allow only the appeal of account suspensions. Cf. Github submission, p. 6. 13

Select target paragraph3

Connect to a paragraph
Connect to an entity
Disable highlights
Add to table of contents