"Scoring forecasts from the 2016 “Expert Survey on Progress in AI”" by PatrickL

06/03/2023 19 min
"Scoring forecasts from the 2016 “Expert Survey on Progress in AI”" by PatrickL

Listen ""Scoring forecasts from the 2016 “Expert Survey on Progress in AI”" by PatrickL"

Episode Synopsis

---client: ea_forumproject_id: curatedfeed_id: ai, ai_safety, ai_safety__forecastingnarrator: pwqa: mdsnarrator_time: 1h30mqa_time: 0h30m---This document looks at the predictions made by AI experts in The 2016 Expert Survey on Progress in AI, analyses the predictions on ‘Narrow tasks’, and gives a Brier score to the median of the experts’ predictions. My analysis suggests that the experts did a fairly good job of forecasting (Brier score = 0.21), and would have been less accurate if they had predicted each development in AI to generally come, by a factor of 1.5, later (Brier score = 0.26) or sooner (Brier score = 0.29) than they actually predicted.Original article:https://forum.effectivealtruism.org/posts/tCkBsT6cAw6LEKAbm/scoring-forecasts-from-the-2016-expert-survey-on-progress-inNarrated for the Effective Altruism Forum by TYPE III AUDIO.Share feedback on this narration.