Timeline for ChatGPT strikes MathOverflow
Current License: CC BY-SA 4.0
9 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Apr 4, 2023 at 4:32 | comment | added | Steven Landsburg | One more data point for what it's worth: I have just submitted to ChatGPT a nine-question exam consisting entirely of questions taken from recent exams in my sophomore-level intermediate economics class. Every single one of the answers was pure gibberish, though they all appeared at first glance like they might be meaningful. A student who turned in this exam would have earned a score of zero. Obviously math and economics are different subjects, but these are problems with unambiguous right and wrong answers, and so far more like math than they are like (say) history or literature. | |
| Dec 19, 2022 at 14:31 | comment | added | Peter LeFanu Lumsdaine | @LSpice: Regarding your first question, writing good prompts/queries for such AI’s is itself a non-trivial skill — just like e.g. using Google well. (Indeed, I find it useful to think of GPT not as “a very stupid essay-writer”, but as “a rather clever search engine”.) I can imagine, some years down the line, a situation where mathematician A tries their question on a GPT-like AI, doesn’t get a good answer, so posts the question here, but then person B (who knows the AI better) is able to rewrite the question into a form which gets a good answer from the AI. | |
| Dec 14, 2022 at 2:13 | comment | added | LSpice | @TimothyChow, aha, so we need to focus on training AI not to understand mathematics better, but to enjoy the reputation and procrastination boost as humans do. 😄 | |
| Dec 13, 2022 at 21:43 | comment | added | Timothy Chow | @LSpice One can imagine a future in which the competent AIs typically charge for their services, but under certain circumstances provide some free services. Sort of like, I dunno, human mathematicians get paid a salary, yet sometimes post answers on MO for free. | |
| Dec 12, 2022 at 5:03 | comment | added | Yemon Choi | @AbhimanyuPallaviSudhir My instinctive thought is that en.wikipedia.org/wiki/Brandolini%27s_law will apply | |
| Dec 11, 2022 at 16:37 | comment | added | Federico Poloni | @AbhimanyuPallaviSudhir So basically this XKCD? | |
| Dec 10, 2022 at 20:10 | comment | added | Abhimanyu Pallavi Sudhir | @LSpice So if ChatGPT became sufficiently advanced, you could imagine adding an automatic answer from ChatGPT that people could vote on as if it were a regular user. | |
| Dec 10, 2022 at 18:42 | comment | added | LSpice | Not to be facile or short-sighted, but, since one of the appeals of utilities like ChatGPT is that anyone can use them, what utility could ChatGPT-generated answers, even if sensical, ever add? Rather than my asking a question and having someone else feed it to a bot for an answer, I could just do that myself. | |
| Dec 9, 2022 at 22:22 | history | answered | Tim CampionMod | CC BY-SA 4.0 |