Funding requirements

Reach min funding
Get Manifund approval
2

Developing materials on forecasting for governments

ProposalGrant
Closes February 10th, 2024
$7,060raised
$7,000minimum funding
$25,000funding goal

Offer to donate

0 hoursleft to contribute

You're pledging to donate if the project hits its minimum goal and gets approved. If not, your funds will be returned.

Sign in to donate

Longer description of your proposed project

CSF-methods, including Forecasting Tournaments and Prediction Markets, use the collective intelligence of diverse groups to predict future events. These approaches are great at aggregating varied perspectives, mitigating individual biases, and revealing a more nuanced and accurate understanding of the future. Such tools seem ideal for governments navigating the complexities of the 21st century...

Since the forecasting revolution sparked by Tetlock's work, there has been the emergence of excellent forecasting platforms and tools like Manifold, Metaculus, Confido, and Cultivate Labs, fostering a robust forecasting community. Despite this, the integration of these methods into government decision-making has been incredibly slow. This project aims to merge the outside-game, bottom-up strategy employed by the forecasting community with an inside-game, top-down approach. This new focus targets specific problems that Forecasting and CSF methods can address for policymakers and decision-makers. Through this strategy, the project seeks to accelerate the adoption of these methods among EU decision-makers.

Project Objectives

  • By mid-2024: Develop and publish material to assist policymakers in incorporating forecasting into decision-making.

  • By mid-2024: Conduct at least 5 workshops for targeted EU policymakers (and potentially journalists) on the utilization of forecasting tools.

  • By end-2024: Provide 5 EU organizations / units with tailored advice on how to implement CSF-methods and tool in their decision-making.

  • By end-2025: Persuade an EU DG or advisory institution to adopt CSF methods for foresight or strategy.

  • By end-2025: If viable, launch a non-profit to advocate for the broad adoption of CSF methods.

  • Beyond 2025: Achieve widespread adoption of CSF methods in EU governments.

Project Plan

Stage 1: Development and Dissemination of Online Material:

This stage focuses on creating an accessible, practical online manual on forecasting methods, specifically targeted to policymakers without CSF-experience. This manual will encompass various forecasting methods, but will largely focus on how policymakers can use them to address their problems. The goal is to make this manual as accessible and practical as possible, ensuring it serves as a valuable tool in the decision-making process. Drawing from a workshop I regularly conduct, the manual will simplify the practical process of using forecasting, how to deal with quantified uncertainty in the policy domain and explaining SMART-Forecasting (using CSF-techniques to Forecast on whether SMART goals will be met). It aims to make forecasting tools easily understandable and usable for policymakers without needing extensive prior knowledge.

The dissemination strategy involves leveraging my network within the Dutch government and politics, Effective Altruism, and the JRC (The EU's internal think-tank). I plan to use JRC-organized meetings for feedback and spreading this material, as well as helping identify targets for stage 2 and 3.

Stage 2: Interactive Workshops: The second stage involves conducting interactive, hands-on workshops for EU policymakers. These workshops are designed to not only impart knowledge of these methods, but also to practice forecasting skills and apply them to a strategic question facing the unit straight away. Deliverables include conducting these workshops, creating resources for participants, and compiling feedback for future improvements.

Stage 3: Personalized Forecasting Strategy Sessions:

In the final stage, I hope to build on the previously given workshops by offering entities that participate free support implementing CSF-methods to guide their strategic decisions, by taking an organisation's plan, key uncertainties, and targets, and translating them into good forecasting questions and markets. Follow-ups will ensure the successful application of forecasting strategies, and are also a valuable source of feedback. My aim is to explore a sustainable model through consultancy and expertise sharing as well, potentially transitioning the project into a self-sustaining entity.

Selecting Target Organisations: Many attempts at implementing CSF fail due to internal politics. I am convinced this problem can be largely solved through working with an organisation that is relatively independent and already has the mandate to work on keeping other organisations accountable. The focus must be on organisations with significant policy influence and visibility within the EU policy ecosystem to facilitate wider adoption of these methods down the line, as well as entities with mandates for horizontal accountability, clear outcome metrics, experience with Foresight, and strategic influence in EU policymaking. Lastly, for me to have a pre-existing network within the organisation will likely significantly increase the chance of success. I have already identified several good candidates based on these criteria.

Describe why you think you're qualified to work on this

Redacted

Other ways I can learn about you

Redacted

How much money do you need?

$3,300 USD - For publishing an online manual focused on Forecasting for policymakers. This will be disseminated through word of mouth, Dutch government, EA, and JRC networks, followed by a series of online meetings to further promote these ideas.

$7,000 USD - As described above, but also includes conducting several workshops on CSF methods for EU and member-state policymakers and journalists.

$25,000 USD - As outlined previously, but with the addition of offering free Forecasting Strategy sessions and guidance over several months of the project's duration, with the potential to become self-sustaining through CSF consulting projects.

Links to any supporting documents or information

No response.

Estimate your probability of succeeding if you get the amount of money you asked for

95% - By mid-2024: Develop and publish material to assist policymakers in incorporating forecasting into decision-making.

80% - By mid-2024: Conduct at least 5 workshops for targeted EU policymakers (and potentially journalists) on the utilization of forecasting tools.

70% - By end-2024: Provide 5 EU organizations / units with tailored advice on how to implement CSF-methods and tool in their decision-making.

5% - By mid-2025: Persuade an EU DG or advisory institution to adopt CSF methods for foresight or strategy.

20% - By mid-2025: If viable, launch a non-profit to advocate for the broad adoption of CSF methods.

5% - Beyond 2025: Be counterfactually responsible for bringing forward widespread adoption of CSF methods in EU governments by at least 3 years.

offering $60
brgadsby avatar

Ben Gadsby

10 months ago

I work in policy in the UK. I have pledged to this, because in my view:

Government spending is very large. Individuals with mid level seniority often have an outsized ability to influence relatively large sums of money (read the Statecraft blog if you'd like some examples of what an effective individual can do - https://www.statecraft.pub/). This project only needs to reach a relatively small number of people, and improve a relatively small number of decisions, to have a significant net positive impact. This feels very achievable.

Austin avatar

Austin Chen

11 months ago

Reposting my notes on this while evaluating for ACX:

Okay so Scott put "Ask Austin?" for this, but really I feel much more qualified to evaluate software/startup proposals rather than forecasting ones. Also despite founding a prediction market startup, I'm not, like, an inherent cheerleader for forecasting, and actually have some deep skepticisms about the viability of Tetlock-style "forecasting for government policy"; such approaches seem sexy but like, if corporations aren't effectively using forecasting internally, I'm skeptical that the govt will be able to do so too.

So with those biases in mind: I'm not especially excited by the proposal, but if anyone seems like the right person to do this kind of thing, it seems like S has the right background for it. I would be extremely happy if they succeeded at convincing policymakers to take forecasts more seriously. The win condition would be similar to that from Dylan Matthew's talk at Manifest: legitimizing forecasts in the eyes of people who work on policy. My hesitancies are 1) I'm not sure if funding this would make such adoption likely to happen (it seems like a long shot), and 2) as above, I'm not even that sure that such adoption would be significantly beneficial to the world.