48
$\begingroup$

As announced a little while back, MathOverflow moderators are participating in a network-wide moderation strike (currently at 121 moderators striking; see the background post for more details). The short explanation is that the company has been making life difficult for moderators in rolling out changes to policy that binds how moderators can operate around dealing with AI-generated content, after many sites on the network set up their own policies (which is how it's supposed to work) banning it. The policy as announced privately to mods and what got announced publicly were slightly different, and the private one essentially tied all our hands.

Stack Exchange the company released internal data analytics that it felt showed that moderators were taking too much action on allegedly AI-content, leading to many false positives, but that analysis is by all accounts not that solid. The 35 responses at this post pull it apart in many ways. The biggest failing of the analysis is that it proceeds via a proxy count that by now demonstrably doesn't agree with what is seen on the ground by moderators, as the behaviour of users changed since the release of ChatGPT (this is the best guess among moderators, it's really unclear).

One concerning matter that arose since the start of the strike was that it was discovered that the latest quarterly data dump of the whole network Q&A data (which is done under a Creative Commons license, and is a way to ensure the knowledge generated by users remains free) was missing. This was secretly turned off, and people were very much not happy about it. Thankfully, as a result of the resulting pressure, the data dump was restarted and is now done.

To add insult to injury, Stack Exchange had announced it was going to roll out a tool for formatting code help on StackOverflow, the biggest site on the network. It turns out this was a simplistic wrapper for a query to some generative large language model from OpenAI (the makers of ChatGPT), which a user extracted in ten minutes—complete with typos and instructions the bot happily ignores, as many users found out as they jailbroke the tool within half a day and made it do all kinds of fun things (write a My Little Pony story, answer the question outright, play a game of chess, invent questions out of whole cloth, remove crucial parts of the question). Thankfully, Stack Exchange listened to the criticism, is turning off the experiment and going back to the drawing board. Though, to temper this relief, it's unlikely to go away forever. There's no hint that it will come to MathOverflow, since it's touted as a "code formatting assistant", but the smell on the air is that the company wants to get more out of the AI pie as it's being passed from hand to hand. Watch this space.

You can read the official strike update post here. The biggest move so far is that moderators elected representatives for negotiation and the negotiations have started. There is some movement: see the data dump point above, and another one that I'm not sure I can mention, but it's fairly minor. No one wants the network to fall over, but we might be in this phase for a while.

In the meantime, please be patient with the decrease in moderation here on MO. Keep flagging content, because after the strike this can be returned to and cleaned up. Blatant spam/vandalism should absolutely be flagged as such, as with enough flags it will be destroyed automatically. Downvoting to make it less visible is not enough.

$\endgroup$
9
  • 1
    $\begingroup$ Thanks for the update, David. As far as the AI tool, SO is the main cash cow for the company at large. There's little risk of this tool being deployed here, especially if we don't want it. $\endgroup$
    – Asaf Karagila Mod
    Jun 17, 2023 at 7:13
  • 3
    $\begingroup$ @AsafKaragila wellll, I could imagine an enthusiastic boss wanting every site on the network to have AI-assisted question improvement. As I said: no hint it will come to MO. Why it was even allowed to be tested in the state it was in is a mystery. $\endgroup$
    – David Roberts Mod
    Jun 17, 2023 at 8:14
  • 22
    $\begingroup$ Thank you for keeping the community updated! $\endgroup$ Jun 17, 2023 at 18:43
  • $\begingroup$ @DavidRoberts: Are we sure that there is an ongoing strike? I look at the review queues daily, and I cannot see any significant difference to the period prior to the strike. Moderation (by both moderators and regular users) does not seem affected by the protest (neither on MO, nor on MSE). From the outside, everything looks like "business as usual"; does this mean that most regular users have not joined the strike and are doing their moderating duties as before? $\endgroup$
    – Alex M.
    Jun 19, 2023 at 17:43
  • 6
    $\begingroup$ @AlexM. you cannot see mod-only queues. Much longer than usual. Not all of the moderators have signed the letter. It's not so much about needing regular users to strike, but mods here deciding to join the network-wide strike to support that. If we see not much effect here, that's not terrible, the point is to get SE Inc into negotiation to improve behind-the-scenes matters, which is now happening. $\endgroup$
    – David Roberts Mod
    Jun 20, 2023 at 0:26
  • $\begingroup$ @DavidRoberts: In this situation, will all my flags "age away"? Shall I have to re-flag those posts once the strike is over? $\endgroup$
    – Alex M.
    Jun 22, 2023 at 7:52
  • 4
    $\begingroup$ @Alex no, only some do meta.stackexchange.com/questions/204327/… flagging for moderator attention won't go away, and at the end of the strike we will have a clean up for things that only mods can do $\endgroup$
    – David Roberts Mod
    Jun 22, 2023 at 10:52
  • 3
    $\begingroup$ For those who are wondering if there is any progress: An update on 2023-06-26 is here: meta.stackexchange.com/questions/390106/… $\endgroup$ Jun 27, 2023 at 7:30
  • 1
    $\begingroup$ @JukkaKohonen Thanks. I was going to double check if I was allowed to post the text of the latest update outside the Discord discussion. I will make a new meta post with the latest negotiation update, and a link back, soon. $\endgroup$
    – David Roberts Mod
    Jun 27, 2023 at 7:48

0

You must log in to answer this question.

Browse other questions tagged .