7

Share fairness impact assessment results for machine learning to reassure against unfair claimant treatment.

Conclusion
We remain concerned about the potential negative impact on protected groups and vulnerable customers of DWP’s use of machine learning to identify potential fraud. The previous Public Accounts Committee repeatedly raised concerns about the impact of data analytics and machine learning on legitimate benefit claims being delayed or reduced, the number of people affected, and whether this is affecting specific groups of people. Written evidence from the Public Law Project raises a series of risks around DWP’s use of machine learning to tackle fraud. In particular, it notes the risk of machine learning taking on human biases when it is trained on historical data and the potential for wide–scale detrimental impacts on claimants if there is a system–error. DWP has undertaken a fairness impact assessment on its use of data analytics, which it says raised no concerns about the impact on customers. However, it has not published the results because it says it wants to avoid releasing information that could assist fraudsters. recommendation DWP should share with us – in confidence if necessary – the results of its 2024 fairness impact assessment in order to provide reassurance that its use of machine learning is not resulting in claimants being treated unfairly. 6 1 Customer service Introduction
Government Response

A response document is linked to this report, dated 6 May 2025. Response attribution to this conclusion has not been verified. Read the response document.

Addressee Bodies
HM Treasury
Timeline
Recommendation age 1.6 yrs
Report published 31 Jan 2025