11
$\begingroup$

As far as I remember, there was supposed to be a public dump of the MO database just before the migration: http://dumps.mathoverflow.net/ . Not an urgency by any measure, but something that would be quite helpful.

EDIT: Much of the info in the answers is now obsolete. The current go-to place for the public dumps of both mathoverflow and math.stackexchange is https://archive.org/details/stackexchange .

$\endgroup$
  • 2
    $\begingroup$ I posted a recent dump at dumps.mathoverflow.net. I did grab another full database dump a few hours before migration, but it hasn't been cleaned up yet. $\endgroup$ – Anton Geraschenko Jun 25 '13 at 20:56
  • $\begingroup$ Very nice; thank you! $\endgroup$ – darij grinberg Jun 26 '13 at 20:08
8
$\begingroup$

The September 2013 dump (the first since we've moved to 2.0) has just become available.

It's in the form of a 14GB torrent for all the Stack Exchange sites, but you can ask your torrent client to only download the MathOverflow specific files (~130mb).

$\endgroup$
  • 2
    $\begingroup$ As indicated in Anna Lear's answer, the torrent can be accessed here. $\endgroup$ – Ricardo Andrade Sep 13 '13 at 13:17
12
$\begingroup$

MathOverflow will be added to our public Data Explorer in a couple of weeks and it will also be included in our network-wide data dump.

All of the data (minus deleted stuff) should also be accessible via our API.

I'm not sure off the top of my head what the options are (if any) for setting up a site-specific data dump. Please let me know if the data explorer is not sufficient for your needs once MathOverflow can be queried there.

$\endgroup$
  • $\begingroup$ +1 and ✓ for the network-wide dump which answers my question from the theoretical perspective. I have to admit I'd value site-specific dumps more, though. $\endgroup$ – darij grinberg Jun 25 '13 at 19:57
  • $\begingroup$ Could you give an updated estimate of how long it will be until MO is added to the Stack Exchange Data Explorer? $\endgroup$ – Michael Albanese Aug 10 '13 at 9:56
  • $\begingroup$ @MichaelAlbanese I'm sorry, I don't have a better estimate at the moment. I'm following up with the devs to see what's what. $\endgroup$ – Adam Lear Aug 16 '13 at 17:15
  • $\begingroup$ OK. When you have some idea, it would be great if you could post an answer to this question. $\endgroup$ – Michael Albanese Aug 16 '13 at 23:57
  • $\begingroup$ @MichaelAlbanese Will do. $\endgroup$ – Adam Lear Aug 16 '13 at 23:58
  • $\begingroup$ @MichaelAlbanese there was a glitch with the new site imports (which is supposed to be automated, once a site graduates) after the move to NY while we rebuild Oregon. I have just fixed the glitch and the first import of MO has completed. It will update once a week every Sunday now. $\endgroup$ – Nick Craver Aug 18 '13 at 18:11
  • 1
    $\begingroup$ What happened to clearbits.net? The site doesn't seem to load. $\endgroup$ – darij grinberg Dec 27 '13 at 19:11
  • $\begingroup$ @darijgrinberg No idea, unfortunately. We don't run it. We'll try to reach them and see what's up. $\endgroup$ – Adam Lear Dec 27 '13 at 19:29
  • 1
    $\begingroup$ By now it seems that clearbits is dead. Care to look for a replacement? By now I suspect that even piratebay is less likely to go down... $\endgroup$ – darij grinberg Jan 10 '14 at 9:37
  • $\begingroup$ @darijgrinberg We had no warning whatsoever and Clearbits shutting down took us entirely by surprise. We are actively looking for a replacement and are in talks to move our data dumps elsewhere, but it's probably gonna take some time still to sort this out. $\endgroup$ – Adam Lear Jan 10 '14 at 16:35
6
$\begingroup$

The data dumps happen quarterly, so I think we can expect the next one to appear in September. For anyone who needs to know asap, here's the RSS feed that reports the availability of new dumps:

http://www.clearbits.net/feeds/creator/146-stack-exchange-data-dump.rss

Note that these dumps are a torrent for the entire stack exchange network; there's a separate file inside for each site. Most bittorrent clients can be told to only download specific files, and this should let you just pull out the MathOverflow specific parts.

$\endgroup$
5
$\begingroup$

The Stack Exchange Data Explorer is an alternative.

$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .