Instagram Has a Massive Harassment Problem

Via Charles Arthur, The Atlantic on Instagram (owned by Facebook so don’t be surprised if they share the same values):

When Instagram introduces new features, the moderation-team members receive no warning, Andy [who works as a moderator; that’s not his real name] said. Consequently, they are left scrambling to understand how they work and what constitutes harassment on each format. “When the Questions feature rolled out, same way as every other new feature, we had no idea,” he said. “We didn’t know which part is the question, which is the answer, who says what? That makes such a big difference on whether you’re going to delete or ignore the post. The mods are just totally not kept up to date on how people use features.”

Alex, the current Instagram employee who asked to be referred to by a pseudonym, said the company prioritizes growth above all else, often at costs to user experience. “The focus is still on getting people to spend more time, getting more users, getting more revenue. That doesn’t change much internally,” Alex said. “There’s been a lot of effort to shape the narrative, but the reality is that it doesn’t drive business impact.”

At Instagram and Facebook, Alex said, “features can make whatever progress … but can’t hurt the other metrics. A feature might decrease harassment 10 percent, but if it decreases users by 1 percent, that’s not a trade-off that will fly. Internally right now, no one is willing to make that trade-off.”

Allie, a former employee at Instagram, agreed. “Instagram has terrible tools. I think people haven’t really focused on it much because so many harassment campaigns are just more visible on other platforms,” she said. Throughout her time there, she said, “many of the efforts to reduce harassment were oriented toward PR, but very few engineering and community resources were put toward actually decreasing harassment.”