In a radical move that is sending shockwaves through the UK's social care sector, Cornwall Council has fully deployed an artificial intelligence system to make critical decisions about care funding for its elderly and disabled residents.
The controversial algorithm, which has completely replaced human assessors for initial budget decisions, calculates individual care packages based on answers to a 13-question online form. The council claims this automated process creates a "consistent and fair" system, but families and campaigners tell a very different story.
The Human Cost of Automated Decisions
Heartbreaking cases are already emerging from the rollout. One 88-year-old woman, previously receiving weekly support for her severe mobility issues, had her care package completely terminated by the AI system without any human consultation.
Her daughter described the experience as "dehumanising," stating: "To have a computer make such a life-changing decision without ever seeing my mother's condition is absolutely terrifying. This system shows complete disregard for human dignity."
How the AI System Works
The process begins when residents or their families complete a brief online assessment. The AI then analyses the responses against set criteria to instantly determine:
- Eligibility for care funding
- The recommended number of care hours
- The specific budget allocation
Only after the AI makes its determination might a human social worker become involved—primarily to implement the algorithm's decisions rather than to assess need personally.
Council Defence Versus Public Outcry
Cornwall Council maintains that the system ensures "consistency and fairness" across assessments. A spokesperson stated: "The digital self-assessment tool helps us understand people's needs quickly and determines whether they're eligible for support."
However, charities and care experts are raising urgent concerns. Silver Voices, a prominent campaign group for seniors, has condemned the approach as "dangerous" and is demanding immediate government intervention.
Director Dennis Reed warned: "The idea that complex care needs can be reduced to a computer algorithm is both dangerous and inhuman. We're dealing with vulnerable human beings, not numbers on a spreadsheet."
Broader Implications for Social Care
This development in Cornwall represents a potential tipping point for social care across the United Kingdom. As councils face increasing budget pressures, many are watching Cornwall's experiment with interest despite the ethical concerns being raised.
Critics argue that while technology can support decision-making, completely removing human judgment from sensitive care determinations risks overlooking the nuanced realities of elderly needs and could violate dignity and human rights.
The Department of Health and Social Care has indicated it is monitoring the situation closely as the debate between technological efficiency and human compassion intensifies.
