Silicon Valley's AI 'extinction' panic lands on a market that's already nervous about the risk

2026-09-11 · Source: Insurance Business UK

Summary in 3 Points • A researcher from Anthropic resigned, citing concerns over AI's potential risks • UK financial regulators have opted not to create AI-specific rules, focusing on existing governance • The Lloyd's Market Association has developed an AI Adoption Toolkit for managing agents --- The recent resignation of Jacob Coxon from Anthropic, along with public support from a colleague, has sparked discussions about AI's potential risks, including the possibility of AI systems developing with less human oversight. This has led to political attention in the US, with calls for more scrutiny on AI development. Meanwhile, UK regulators have chosen not to implement AI-specific rules, instead focusing on governance under existing frameworks. The Bank of England and FCA have issued guidelines for AI governance and incident response, while the Lloyd's Market Association has released an AI Adoption Toolkit to assist managing agents as AI becomes integral to underwriting processes.

London market impact

The London insurance market could face significant changes as AI systems evolve, potentially affecting underwriting practices and risk assessments. The development of AI with less human oversight may lead to new liability concerns, requiring insurers to adapt their policy wordings and pricing strategies. The AI Adoption Toolkit by the Lloyd's Market Association provides a framework for managing agents to integrate AI into underwriting, points to the need for strong governance. As AI technology advances, the market may need to consider additional measures to address potential systemic risks and ensure compliance with regulatory expectations.