15
$\begingroup$

As far as I remember, there was supposed to be a public dump of the MO database just before the migration: http://dumps.mathoverflow.net/ . Not an urgency by any measure, but something that would be quite helpful.

EDIT: Much of the info in the answers is now obsolete. The current go-to place for the public dumps of both mathoverflow and math.stackexchange is https://archive.org/details/stackexchange .

$\endgroup$
2
  • 3
    $\begingroup$ I posted a recent dump at dumps.mathoverflow.net. I did grab another full database dump a few hours before migration, but it hasn't been cleaned up yet. $\endgroup$
    – Anton Geraschenko Mod
    Commented Jun 25, 2013 at 20:56
  • $\begingroup$ Very nice; thank you! $\endgroup$
    – darij grinberg
    Commented Jun 26, 2013 at 20:08

5 Answers 5

Reset to default
8
$\begingroup$

The September 2013 dump (the first since we've moved to 2.0) has just become available.

It's in the form of a 14GB torrent for all the Stack Exchange sites, but you can ask your torrent client to only download the MathOverflow specific files (~130mb).

$\endgroup$
1
  • 2
    $\begingroup$ As indicated in Anna Lear's answer, the torrent can be accessed here. $\endgroup$
    – Ricardo Andrade
    Commented Sep 13, 2013 at 13:17
16
$\begingroup$

MathOverflow will be added to our public Data Explorer in a couple of weeks and it will also be included in our network-wide data dump.

All of the data (minus deleted stuff) should also be accessible via our API.

I'm not sure off the top of my head what the options are (if any) for setting up a site-specific data dump. Please let me know if the data explorer is not sufficient for your needs once MathOverflow can be queried there.

$\endgroup$
13
  • $\begingroup$ +1 and ✓ for the network-wide dump which answers my question from the theoretical perspective. I have to admit I'd value site-specific dumps more, though. $\endgroup$
    – darij grinberg
    Commented Jun 25, 2013 at 19:57
  • $\begingroup$ Could you give an updated estimate of how long it will be until MO is added to the Stack Exchange Data Explorer? $\endgroup$
    – Michael Albanese
    Commented Aug 10, 2013 at 9:56
  • 1
    $\begingroup$ @MichaelAlbanese I'm sorry, I don't have a better estimate at the moment. I'm following up with the devs to see what's what. $\endgroup$
    – Adam Lear StaffMod
    Commented Aug 16, 2013 at 17:15
  • $\begingroup$ OK. When you have some idea, it would be great if you could post an answer to this question. $\endgroup$
    – Michael Albanese
    Commented Aug 16, 2013 at 23:57
  • 1
    $\begingroup$ @MichaelAlbanese Will do. $\endgroup$
    – Adam Lear StaffMod
    Commented Aug 16, 2013 at 23:58
  • 1
    $\begingroup$ @MichaelAlbanese there was a glitch with the new site imports (which is supposed to be automated, once a site graduates) after the move to NY while we rebuild Oregon. I have just fixed the glitch and the first import of MO has completed. It will update once a week every Sunday now. $\endgroup$
    – Nick Craver
    Commented Aug 18, 2013 at 18:11
  • 1
    $\begingroup$ What happened to clearbits.net? The site doesn't seem to load. $\endgroup$
    – darij grinberg
    Commented Dec 27, 2013 at 19:11
  • 1
    $\begingroup$ @darijgrinberg No idea, unfortunately. We don't run it. We'll try to reach them and see what's up. $\endgroup$
    – Adam Lear StaffMod
    Commented Dec 27, 2013 at 19:29
  • 1
    $\begingroup$ By now it seems that clearbits is dead. Care to look for a replacement? By now I suspect that even piratebay is less likely to go down... $\endgroup$
    – darij grinberg
    Commented Jan 10, 2014 at 9:37
  • 1
    $\begingroup$ @darijgrinberg We had no warning whatsoever and Clearbits shutting down took us entirely by surprise. We are actively looking for a replacement and are in talks to move our data dumps elsewhere, but it's probably gonna take some time still to sort this out. $\endgroup$
    – Adam Lear StaffMod
    Commented Jan 10, 2014 at 16:35
  • 2
    $\begingroup$ @Adam since you're still on staff, I guess I should ping you to ask if we are going to get a data dump now, regardless of the rest of the network. People are unhappy particularly because MO is slightly special in this regard. $\endgroup$
    – David Roberts Mod
    Commented Jun 12, 2023 at 2:54
  • 1
    $\begingroup$ @DavidRoberts I don't know but let me see if I can find out. $\endgroup$
    – Adam Lear StaffMod
    Commented Jun 13, 2023 at 13:07
  • 1
    $\begingroup$ @DavidRoberts Please reach out to Philippe. His email is in his profile bio. $\endgroup$
    – Adam Lear StaffMod
    Commented Jun 13, 2023 at 13:15
14
$\begingroup$

Just to bump this question: StackExchange Inc. turned off the periodic network-wide data dump earlier this year, and it can apparently only be resumed with permission from very high in the company. I guess this includes MO. I haven't heard otherwise.

So we are probably missing some of our more recent data.

Edit: now reinstated https://meta.stackexchange.com/a/390200/226541 after a lot of push-back.

$\endgroup$
6
$\begingroup$

The Stack Exchange Data Explorer is an alternative.

$\endgroup$
6
$\begingroup$

The data dumps happen quarterly, so I think we can expect the next one to appear in September. For anyone who needs to know asap, here's the RSS feed that reports the availability of new dumps:

http://www.clearbits.net/feeds/creator/146-stack-exchange-data-dump.rss

Note that these dumps are a torrent for the entire stack exchange network; there's a separate file inside for each site. Most bittorrent clients can be told to only download specific files, and this should let you just pull out the MathOverflow specific parts.

$\endgroup$
0

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .