The Civic Commons Access to tools for building community where you live
Recipe · from the prosocial design collection

Warning that Topic is Sensitive

When specific language is detected in a draft comment or post about predefined topics, some visual element warns the author that conversations around these topics are hard and emotionally intense.

Warning that Topic is Sensitive

Goal: Reduce likelihood of sharing triggering content Evidence rating (PDN): Inference Civic signal: Welcome — Ensure user safety When to use: Proactive

What it is

When specific language is detected in a draft comment or post about predefined topics, some visual element warns the author that conversations around these topics are hard and emotionally intense.

For example, on the social media platform NextDoor, every Fourth of July in the USA there are frequent, heated arguments about fireworks. Some people love them; some people hate them. So, any time in a three day range around July 4th, whenever NextDoor detects the word "firework" in a post, a just-in-time alert will appear reminding them that conversations about fireworks are hard and that people have very strong feelings about them.

Intended impact

  • Reduces the likelihood that someone initiates a harder conversation than they intended by broaching a topic they didn't realize was one that is emotional for others.
  • Prompts people to recognize that people hold strongly divergent views from their own on a given topic without being confronted directly by other angry people

Evidence that it works

This intervention is in use by large platforms, most notably Twitter. While it's reasonable to assume platforms' internal testing showed some measure of success, without further evidence, we cannot yet give it a higher grade of confidence.

Why it matters

Special Considerations

Use of this intervention can feel insensitive when not combined with enforcement of community norms. For example, if someone is targeted with racist behavior on your platform, there aren't any obvious repercussions for the abusers, and the recipient says something about their experience, their report could well be flagged as "intense," which can feel unjust to the person on the receiving end of both the original abuse and this automated warning.

Similarly, this may annoy people who specifically and intentionally participate in conversations online around sensitive topics to raise awareness. It may be helpful to offer an option to hide this warning for a certain amount of time.

It's worth also being transparent about what keywords will trigger this popup. If you are not transparent, people will come up with their own theories about what topics are and aren’t included and why. This will likely include people claiming that your platform is targeting them personally.

Trolls may specifically seek out these topics in order to be provocative and contrarian. Such behavior could be tracked (percent of posts by users that triggered this label and were posted anyway) and acted upon by other interventions.

Citations

  • **

---

From the Prosocial Design Network's Digital Intervention Library (https://www.prosocialdesign.org/library/warning-that-topic-is-sensitive), licensed CC BY-SA 4.0. Reformatted for the RT Commons; text otherwise as published. Library citation: Prosocial Design Network (2024), Digital Intervention Library, https://doi.org/10.17605/OSF.IO/Q4RMB. Anything built from this pattern should credit the Prosocial Design Network and the researchers cited above.

Details

  • goal: Reduce likelihood of sharing triggering content
  • citations: [object Object]
  • image alt: A mockup of a comment. It has a prompt on top of it that says 'heads up, topics like this can get heated'.
  • image url: https://cdn.prod.website-files.com/647f696dc653a97c26f42a0b/647f696dc653a97c26f42b41_220712_PDN_heads_up_hero_PDN.png
  • pdn rating: Inference
  • when to use: Proactive
  • civic signal: Welcome
  • pdn library doi: 10.17605/OSF.IO/Q4RMB
  • civic signal goal: Ensure user safety
Related by topic

Contributed by Prosocial Design Network · prosocialdesign.org · CC BY-SA 4.0

Original source: https://www.prosocialdesign.org/library/warning-that-topic-is-sensitive

See something to fix or add? Suggest an edit on GitHub — the commons lives in git too, and its history is the changelog.

prosocial-designdesign patternpdn-rating:inferencewhen:proactivecivic-signal:welcomeensure user safety

Remix this in Relational Builder  Browse the commons