We questioned DSIT on how it is evaluating and sharing learning from AI pilot activity across government to avoid reinventing the wheel and to support AI adoption at scale. It told us that it was taking a range of approaches including developing guidance and identifying good practice case studies, establishing communities of AI practitioners, and adopting an ‘open build’ approach to developing AI tools, publishing their results to make them available to others in the public and private sectors.47 41 C&AG’s Report, para 12 42 C&AG’s Report, para 12 and Figure 7 43 Qq 17, 24 44 Q 3 45 Q 3 46 C&AG’s Report, para 3.5 47 Q 21 15 A witness from the Department said that “you want to run pilots, work out what works and then scale them”.48 It also confirmed that the AI Knowledge Hub that it is piloting is intended to bring together advice and guidance in one place and make it accessible and user–friendly.49 On the issue of robust evaluation of AI pilots, the Cabinet Office told us that the Evaluation Taskforce had recently published guidance for evaluating the impact of AI tools. It also told us there is a lot of guidance on evaluating programmes from a financial, commercial and technological perspective, but the next challenge was to ensure that these techniques were understood and people knew where to go for support.50 AI procurement