{"id":3356,"date":"2026-10-20T16:22:03","date_gmt":"2026-10-20T15:22:03","guid":{"rendered":"https:\/\/weknow0.co.uk\/?p=3356"},"modified":"2026-10-20T16:29:04","modified_gmt":"2026-10-20T15:29:04","slug":"10-years-ago-actuaries-and-the-new-manhattan-project","status":"publish","type":"post","link":"https:\/\/weknow0.co.uk\/?p=3356","title":{"rendered":"10 Years Ago: Actuaries and the New Manhattan Project"},"content":{"rendered":"\n
\"\"<\/a>
Source: Universal Pictures Publicity, Fair use, https:\/\/en.wikipedia.org\/w\/index.php?curid=71354716<\/a><\/em><\/figcaption><\/figure>\n\n\n\n

10 years ago I was working my way through Cathy O’Neill’s excellent Weapons of Math Destruction<\/a><\/em>, the first really loud warning about the inappropiate application of algorithms, and blogging about it<\/a>. In the book she set out the case against devolving important decisions to mathematical models without adequate feedback loops. Yes, 10 years ago!<\/p>\n\n\n\n

I concluded that post by paraphrasing Robert Oppenheimer’s words about the Manhattan Project:<\/p>\n\n\n\n

If mathematical models are to be the dominant regulatory tool of a financial world, and of the consultancies and financial firms competing in that world, then the time will come when mankind will curse the names of the highly paid professionals who followed inappropriate rules rather than exercising their own expert judgement when it mattered.<\/em><\/p>\n\n\n\n

I think that is still a work in progress. Although at least they have made a film about the Manhattan Project in the meantime. And you could say the United States certainly appear to be embracing the analogy:<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n

Meanwhile Cathy O’Neill has done a lot more than just wring her hands about these risks. She has set up her own consultancy (O’Neil Risk Consulting & Algorithmic Auditing or ORCAA<\/a>) to audit your algorithms for you. As she says:<\/p>\n\n\n\n

Whether it\u2019s a hiring algorithm, healthcare AI, predictive scoring system, or generative AI platform, we are here to think about how it could fail, for whom, and what you can do to monitor and mitigate these risks. We are actively developing frameworks and governance approaches to help companies and organizations use algorithms and AI safely \u2013 confirming these technologies perform as intended and operate within sensible guardrails. We help our clients realize the transformative benefits of AI, while avoiding discrimination, bias, and other problems.<\/em><\/p>\n\n\n\n

Their offering includes:<\/p>\n\n\n\n