UK Law Enforcement Agencies Lobbied to Employ Biased Face Scanning Systems
Police forces across the United Kingdom successfully lobbied to use a face scanning system known to be biased against females, youths, and members of ethnic minority groups, following complaints that a more accurate version generated fewer potential suspects.
How the System Works
British police utilize the police national database (PND) to carry out retrospective facial recognition searches. This process entails matching a “probe image” of a suspect against a database of over 19 million mugshots to identify possible hits.
Acknowledged Discrimination
The UK interior ministry conceded last week that the system was flawed. This acknowledgment came after a study by the government's National Physical Laboratory found it incorrectly matched Black and Asian people and women at much greater frequency than white men. The Home Office stated it “took steps on the findings”.
“This raises the question of whether facial recognition only becomes effective if users tolerate discrimination in ethnicity and gender. Operational ease is a poor argument for overriding fundamental rights.”
Long-Standing Problem
Official papers reveal that this bias has been known about for more than a year. Furthermore, law enforcement lobbied to reverse an earlier ruling that was designed to mitigate the problem.
Senior officers were informed of the system's bias in late 2024. The government-ordered laboratory study found the system was had a higher probability to produce false positives for images depicting females, Black people, and those aged 40 and under.
A Policy U-Turn
In reaction, the national police leadership body mandated that the accuracy setting required for potential matches be raised to a point where the bias was greatly diminished.
However, this decision was reversed the next month following complaints from police that the adjusted system was producing fewer “useful lines of inquiry”. Internal records indicate the stricter setting reduced the proportion of queries resulting in possible identifications from 56% to a just under 15%.
Severe Disparities
Although the authorities refused to say what setting is currently used, the recent independent review found the system could generate false positives for Black women nearly a hundred times more often than for Caucasian women at certain settings.
The Home Office commented on these results: “The testing identified that in a specific scenarios the software is more likely to wrongly flag some demographic groups in its match reports.”
Operational Effectiveness vs. Bias
Outlining the impact of the brief increase to the system's confidence threshold, the NPCC documents state: “The change greatly lessens the effect of discrimination across protected characteristics of race, age and sex but had a substantially detrimental effect on operational effectiveness”. The documents add that forces argued that “a previously useful tool returned results of limited benefit”.
Wider Implementation Proposals
Meanwhile, the government has launched a ten-week consultation on its plans to expand the use of facial recognition technology. Policing minister the relevant minister has described the technology as the “biggest breakthrough since DNA matching”.
Expert and Oversight Concerns
Abimbola Johnson, head of the independent scrutiny and oversight board for the police race action plan, commented: “We observed scant consideration through equality strategy sessions of the facial recognition rollout even with clear relevance with the strategy's goals.
“This disclosure show yet again that the pledges to combat discrimination policing has undertaken through the race action plan are failing to be integrated into broader operations. Independent assessments have warned that innovative tools are being rolled out in a context where ethnic inequalities, weak scrutiny and poor data collection already persist.
“Any use of facial recognition must meet strict national standards, be subject to external review, and demonstrate it reduces rather than compounds ethnic bias.”
Home Office Response
A government representative said: “We treat the conclusions of the report with utmost gravity and we have implemented changes. A new algorithm has been independently tested and procured, which has demonstrated no measurable discrimination. It will be trialled in the coming months and will be undergo further assessment.
“Our priority is ensuring public safety. This revolutionary tool will support police to apprehend and prosecute offenders. There is officer review in every step of the process and no further action would be taken without trained officers carefully reviewing the results.”