Expert Judgment in the Age of AI

Expert Judgment in the Age of AI

A New Article by Kacper Nosarzewski

If you commission expert advice, a recent Anthropic study should give you pause. Researchers provided causal-inference experts with an AI coding agent to analyze a dataset, but with a twist: before each session, a coin flip decided whether the agent would secretly push for option A or option B. The results were striking—expert participants followed the AI agent’s lead 86% of the time.

In his latest article, Kacper Nosarzewski, Partner at 4CF The Futures Literacy Company, explores why traditional expert elicitation is vulnerable to such biases. He discusses how generative AI risks hollowing out genuine expert consensus and explains why structured methods, such as the Real-Time Delphi approach utilizing our proprietary 4CF HalnyX platform, remain essential guardrails for rigorous strategic foresight.

Link to the article

Stay updated! Subscribe to our newsletter:

By subscribing to our newsletter, you consent to the processing of the provided data. The data controller is 4CF Sp. z o.o., its registered office is located in Warsaw, 10/14 Trzech Krzyży Square, postal code: 00-499.

We process your data solely for the purpose of sending information about 4CF Sp. z o.o. and its activities via e-mail. Your data will be processed until your consent is revoked through a  link that will be included in each newsletter. The withdrawal of consent shall not affect the lawfulness of processing based on consent before its withdrawal. Providing your data is voluntary, but necessary if you wish to receive information about 4CF Sp. z o.o. and its activities. We may transfer the data to our suppliers of services related to the processing of personal data, e.g. IT service providers. Such entities process data on the basis of a contract with our company and only in accordance with our instructions. You have the right to request access to your personal data, its rectification, deletion or limitation of processing, as well as the right to lodge a complaint with the supervisory authority. More information about your rights and about the processing of your personal data can be found in our privacy policy.

Stay updated! Subscribe to our newsletter:

By subscribing to our newsletter, you consent to the processing of the provided data. The data controller is 4CF Sp. z o.o., its registered office is located in Warsaw, 10/14 Trzech Krzyży Square, postal code: 00-499.

We process your data solely for the purpose of sending information about 4CF Sp. z o.o. and its activities via e-mail. Your data will be processed until your consent is revoked through a  link that will be included in each newsletter. The withdrawal of consent shall not affect the lawfulness of processing based on consent before its withdrawal. Providing your data is voluntary, but necessary if you wish to receive information about 4CF Sp. z o.o. and its activities. We may transfer the data to our suppliers of services related to the processing of personal data, e.g. IT service providers. Such entities process data on the basis of a contract with our company and only in accordance with our instructions. You have the right to request access to your personal data, its rectification, deletion or limitation of processing, as well as the right to lodge a complaint with the supervisory authority. More information about your rights and about the processing of your personal data can be found in our privacy policy.