Objective: Taken from working doc Related to Hypothesis 1 - Research Question #3: Does Automoderator help patrollers spend their time on other activities of their interest?
The goal of the survey is to
- Broadly understand various work streams patrollers engage in (including patrolling)
- Broadly understand various work streams patrollers would like to engage in (given Automoderator reduces patrolling workload)
Sub-goal: Learn things for annual planning.
This survey will be paired with analysis of logged edits in order to compare how stated intent matches to post-AM deployment activities.
Meta research question
- Does Automoderator help patrollers spend their time on other activities of their interest?
- Is there any significant shift in distribution between areas of activity on wiki by patrollers post Automoderator?
- What should we track to gauge moderator behaviour?
Research questions
(Ranked)
- What kinds of activities do moderators engage in and how much time do those activities take?
- What affects perceptions of Automod judgement trustworthiness?
- What kinds of activities do moderators want to spend more time doing?
- What challenges or frustrations do moderators face?
Note: The goal of the survey is not to infer the impact caused by Automoderator, but rather to get a general understanding of various areas patrollers engage in, on Wikimedia projects. This will be further used to monitor and/or test the hypothesis using MediaWiki data and logs.
Sampling and distribution
Wikis
- En.wiki
- Id.wiki (requires localization, but we have ambassador)
- Fr.wiki (requires localization)
- Hi.wiki
Target respondents
50-200 patrollers / moderators
Distribution - took place on June 13th and it closed on July 3rd
Use QuickSurveys for recruitment - invite them to take a survey, “yes” brings them to a screener (either integrated or separate)
Above 500 edits and 6 months tenure