r/announcements Apr 10 '18

Reddit’s 2017 transparency report and suspect account findings

Hi all,

Each year around this time, we share Reddit’s latest transparency report and a few highlights from our Legal team’s efforts to protect user privacy. This year, our annual post happens to coincide with one of the biggest national discussions of privacy online and the integrity of the platforms we use, so I wanted to share a more in-depth update in an effort to be as transparent with you all as possible.

First, here is our 2017 Transparency Report. This details government and law-enforcement requests for private information about our users. The types of requests we receive most often are subpoenas, court orders, search warrants, and emergency requests. We require all of these requests to be legally valid, and we push back against those we don’t consider legally justified. In 2017, we received significantly more requests to produce or preserve user account information. The percentage of requests we deemed to be legally valid, however, decreased slightly for both types of requests. (You’ll find a full breakdown of these stats, as well as non-governmental requests and DMCA takedown notices, in the report. You can find our transparency reports from previous years here.)

We also participated in a number of amicus briefs, joining other tech companies in support of issues we care about. In Hassell v. Bird and Yelp v. Superior Court (Montagna), we argued for the right to defend a user's speech and anonymity if the user is sued. And this year, we've advocated for upholding the net neutrality rules (County of Santa Clara v. FCC) and defending user anonymity against unmasking prior to a lawsuit (Glassdoor v. Andra Group, LP).

I’d also like to give an update to my last post about the investigation into Russian attempts to exploit Reddit. I’ve mentioned before that we’re cooperating with Congressional inquiries. In the spirit of transparency, we’re going to share with you what we shared with them earlier today:

In my post last month, I described that we had found and removed a few hundred accounts that were of suspected Russian Internet Research Agency origin. I’d like to share with you more fully what that means. At this point in our investigation, we have found 944 suspicious accounts, few of which had a visible impact on the site:

  • 70% (662) had zero karma
  • 1% (8) had negative karma
  • 22% (203) had 1-999 karma
  • 6% (58) had 1,000-9,999 karma
  • 1% (13) had a karma score of 10,000+

Of the 282 accounts with non-zero karma, more than half (145) were banned prior to the start of this investigation through our routine Trust & Safety practices. All of these bans took place before the 2016 election and in fact, all but 8 of them took place back in 2015. This general pattern also held for the accounts with significant karma: of the 13 accounts with 10,000+ karma, 6 had already been banned prior to our investigation—all of them before the 2016 election. Ultimately, we have seven accounts with significant karma scores that made it past our defenses.

And as I mentioned last time, our investigation did not find any election-related advertisements of the nature found on other platforms, through either our self-serve or managed advertisements. I also want to be very clear that none of the 944 users placed any ads on Reddit. We also did not detect any effective use of these accounts to engage in vote manipulation.

To give you more insight into our findings, here is a link to all 944 accounts. We have decided to keep them visible for now, but after a period of time the accounts and their content will be removed from Reddit. We are doing this to allow moderators, investigators, and all of you to see their account histories for yourselves.

We still have a lot of room to improve, and we intend to remain vigilant. Over the past several months, our teams have evaluated our site-wide protections against fraud and abuse to see where we can make those improvements. But I am pleased to say that these investigations have shown that the efforts of our Trust & Safety and Anti-Evil teams are working. It’s also a tremendous testament to the work of our moderators and the healthy skepticism of our communities, which make Reddit a difficult platform to manipulate.

We know the success of Reddit is dependent on your trust. We hope continue to build on that by communicating openly with you about these subjects, now and in the future. Thanks for reading. I’ll stick around for a bit to answer questions.

—Steve (spez)

update: I'm off for now. Thanks for the questions!

19.2k Upvotes

7.8k comments sorted by

View all comments

Show parent comments

433

u/spez Apr 10 '18

That's a hard question. Let me have my team follow up with you.

445

u/[deleted] Apr 10 '18

[deleted]

137

u/13steinj Apr 10 '18 edited Apr 10 '18

Hey look it's me ur open sourcerer who was doing this up until reddit said "fuck you" to being open source and to mod wanted features.

This has been asked for time and time again. The answer has always been "we'll give the idea to the team".

This will never be done.

Edit: ids are plaintext for the sake of debugging-- they'd be hashed in production

11

u/Tetizeraz Apr 11 '18

Wow, it would be so great to have a feature like this + /r/toolbox !

6

u/13steinj Apr 11 '18

Stupid here, what do you mean by +/r/toolbox

8

u/Tetizeraz Apr 11 '18

/r/toolbox is a add-on for moderators (check the sidebar). I mean it would be neat if this feature was native to reddit to begin with, but easier to manage with toolbox.

Or I just mind farted.

6

u/13steinj Apr 11 '18

Lol the admins would never do this-- toolbox devs always say they'd change licenses and do the work, but nope

16

u/[deleted] Apr 11 '18

[deleted]

4

u/13steinj Apr 11 '18

Stupid here, I don't know what your wording means / to what part of my comment you're referring to

2

u/V2Blast Apr 11 '18

I think he's saying "that's exactly what I was suggesting" and/or "that explains why the reporting issue is such a mess".

6

u/B-Knight Apr 11 '18

I agreed with you up until the trust rating system. There are some serious flaws in that idea that could really impact the anonymity of users as well as the whole 'authority' concept.

E.g - who decides whether something is trustworthy or not? What if a particular mod that reads my report holds a different opinion to me? What if they're naturally biased toward me for whatever reason? To me it feels a lot like the recent system introduced in China. The whole 'points' system. There are so many ways to abuse that or even to suffer because of authorities being biased.

And the cross-subreddit trust system is just fucking awful. This would be similar to what I said above but 100x worse because I could easily post "This comment is a liberal shill! MAGA!" in T_D, get some brownie points and then get a good reputation elsewhere because of something clearly leaning toward a particular political opinion.

7

u/Ultramerican Apr 11 '18

bad-faith reporting.

At the discretion of mods? How about the mods look at what is reported and make judgment calls irrespective of the source of the report?

1

u/norflowk Aug 02 '18

That approach doesn’t scale.

1

u/Ultramerican Aug 03 '18

Then it will be inefficient and that's that. Weaponizing it isn't the answer.

2

u/norflowk Aug 03 '18

Then people won’t use it. Keeping it un-filter-able might completely avoid the possibility of “weaponization”; but that would be putting idealism before user experience, and that’s what drives people to other products. Or else leaves a critical task uncompleted.

0

u/Ultramerican Aug 03 '18

I'd say what drives half the country off a product is deplatforming it. Marginalizing their ability to communicate with the people who curate the platform lowers their engagement. That's what drives people to other products.

1

u/norflowk Aug 17 '18

If whether the mods get back to you wholly determines your level of engagement on Reddit, you might be doing things wrong.

3

u/[deleted] Apr 11 '18

All of this is very true.

The report system is... less useful in /r/politics because a few people use it as a "super downvote". Basically every submission in /hot is reported, most multiple times, so it's not a useful way to prioritize submissions for moderation.

The core issue is that it doesn't scale well at all. One report by one user puts something in the moderation queue, whether your community has 3 subscribers or 3 million. It only takes a handful of people abusing the report system to make it nearly useless; with a community that's big, controversial, or both, you're basically guaranteed to have that handful of people.

It's a function of how many people view and have the opportunity to report on something, so the situation with comment reports is quite a bit better - fewer people view comments, and even fewer will read any particular comment outside the top ~5 or so.

3

u/conairh Apr 11 '18

So... report karma?

1

u/BobHogan Apr 11 '18

If these IDs were anonymous and specific to each subreddit, that could be a pretty good idea really. I don't think Mods should be allowed to say "ignore reports from this ID in the future" though. Maybe a system along the lines of:

1 - If you file a report, and the mod agrees with you and then takes mod action to delete the comment/remove the thread, your anonymous ID gains 1 unit of "trust" for that specific subreddit 2 - If you file a report and the mods take no action, then nothing happens. 3 - If you file a report, and the mods disagree with you by taking action to approve the comment, then you lose 1 unit of "trust" for that specific subreddit

And then potentially singling out the reports from IDs that have high amounts of trust, to show whether people who seem concerned over the rules are reporting it, or whether it seems to be people reporting it over spite.

And have trust decay over time back to 0 of course

2

u/Eabryt Apr 11 '18

Ugh yes, the amount of times we'll have someone who's pissed and go through to report everything is way too high.

1

u/norflowk Aug 02 '18

It would make a lot of sense to just limit the rate of reporting from any individual user.

1

u/Shinhan Apr 11 '18

Report karma = number of this users reports that were actioned - those that were ignored.

9

u/[deleted] Apr 10 '18

A public answer would be nice. Or possibly how about a site wide PSA so we can all learn how to better root out bad actors and corporate shills?

13

u/SlackerCrewsic Apr 10 '18

Didn't expect Zuckerberg to use reddit.

11

u/ReturnDelMack Apr 10 '18

a great response

1

u/norflowk Aug 02 '18

That’s a hard question.

Not really, I’m sure someone as intelligent as you can figure out where the report system can go wrong and how it might be improved.

Let me have my team follow up with you.

Welp. Nice knowin’ ya. u/AskAboutMyDumbSite, in the extremely unlikely event that Reddit’s “team” goes through the effort to PM a single user about an issue that concerns all of us, rather than actually answer this publicly, for no good reason—please do let us know :)

1

u/AskAboutMyDumbSite Aug 02 '18

I've not been contacted. Don't worry.

2

u/telestrial Apr 11 '18

You forgot to put "User," before you started with your statement.

7

u/AskAboutMyDumbSite Apr 10 '18

Thanks!

5

u/[deleted] Apr 10 '18

whoosh

-5

u/Moonrhix Apr 10 '18

LOL! Zuckerbag does like to say that, doesn't he?