AI model access for safety research
Lack of access for AI Safety Institutes to advanced AI models for safety research, including developers refusing access.
32 items
1 source
Source spread
Where this theme appears
AI model access for safety research has been flagged across 1 independent accountability source:
32 committee recs
This theme has been identified in one data source. As more data is added, cross-references may emerge.
Browse by source
Source-grouped records are useful for tracing where a concern came from. Large sections show the 50 strongest matches for that source; counts still show the full theme total.
Committee Recommendations (32)
#45 — Insufficient details provided on access to dedicated AI Research Resource and supercomputer cluster.
Recommendation: We welcome the Government’s moves to establish a dedicated AI Research Resource and a cluster of supercomputers but are concerned that it has yet to set out further details of how researchers and startups will be able to access the …
Gov response: The Government recognises the importance of compute in enabling the research and innovation that drives growth and increases opportunities for people across the UK. DSIT is working alongside UKRI to develop a long-term plan for …
Accepted
#26 — Confirm models the AI Safety Institute could not access and name refusing developers.
Recommendation: The Government should also confirm which models the Institute has been unable to secure access to, and the reason for this. If any developers have refused access— which would represent a contravention of the reported agreement at the November 2023 …
Gov response: Our intention is for legislation to put the AI Safety Institute (AISI) on a statutory footing and there will be further detail about this in the coming months. We are proud of the work of …
Not Accepted
#24 — AI Safety Institute's limited access to unreleased models undermines safety testing capabilities.
Recommendation: However, we are concerned by suggestions that the Institute has been unable to access as-yet unreleased AI models to perform the pre-deployment safety testing it was set up to undertake. If true, this would undermine the delivery of the Institute’s …
Gov response: Our intention is for legislation to put the AI Safety Institute (AISI) on a statutory footing and there will be further detail about this in the coming months. We are proud of the work of …
Under Consideration
#28 — Require generative AI providers to share internal data with independent online safety researchers.
Recommendation: Principle 5 is crucial for addressing potential harms from generative AI, as there is currently a serious shortfall in transparency and oversight of the platforms and systems that allow users to create AI-generated content. The government should require providers of …
Gov response: More widely, provisions inserted by the Data (Use and Access) Act empower DSIT’s Secretary of State to create a framework for independent researchers to access online safety data, which will – once implemented - give …
Not Addressed
#9 — Commission independent research into social media algorithms amplifying harmful content with full data access
Recommendation: There is a shortfall in data needed to accurately analyse the scale of the problem and identify policy solutions. In line with our Principle 4, the government should commission a large-scale research project into how far social media recommendation systems …
Gov response: The government believes that the quickest way to fill the shortfall in data is through Ofcom. Ofcom’s role as the UK’s independent online safety regulator means it is best placed to exercise judgement about whether …
Not Addressed
#7 — Social media technology is insufficiently transparent and accessible to public authorities
Recommendation: The technology used by social media companies should be transparent, explainable and accessible to public authorities, as stated in our Principle
Gov response: The OSA’s duties will deliver greater transparency and accountability from providers, ensuring Ofcom is well informed, adult users are empowered, and companies are publicly held to account for keeping their users safe online. The strongest …
Accepted
#46 — Publish AI Research Resource action plan and undertake National Compute Cluster feasibility study.
Recommendation: The Government, or its successor administration, should publish an action plan and proposed deliverables for both the AI Research Resource and its cluster of supercomputers, and further details of the terms under which researchers and innovative startups will be able …
Gov response: The Government recognises the importance of compute in enabling the research and innovation that drives growth and increases opportunities for people across the UK. DSIT is working alongside UKRI to develop a long-term plan for …
Accepted
#44 — Facilitate UK AI startups' access to anonymised public datasets through a National Data Bank.
Recommendation: The Government and future administrations should support the emergence of more AI startups in the UK by ensuring they can access the high-quality datasets they need to innovate. This could involve facilitating access to anonymised public data from data.gov.uk, the …
Gov response: DSIT will be establishing a National Data Library, aiming to transform the way the Government manages our national data assets and to unlock the full value of our public data assets. This will provide simple, …
Accepted
#32 — Scientific research and development are crucial for advancing AMR diagnostics, treatments, and vaccines.
Recommendation: Taking advantage of scientific research and developments will be very important in addressing the threat of AMR. Research and development can improve tools such as diagnostics to improve prescribing of antimicrobials, as well as producing new antimicrobials and vaccines.82 It …
Gov response: 6.1 The government agrees with the Committee’s recommendation. Recommendation implemented 6.2 The government is committed to ensuring evidence informs AMR policy, through providing research funding aligned with the NAP top 10 research priorities, collaborating on …
Accepted
#6 — Mandate health bodies to keep updated on scientific AMR developments and fund vital research.
Recommendation: It is vital that government keeps up to date with scientific developments that might help tackle the threat of AMR. Research can help identify better ways of mitigating AMR and treating those with AMR infections, including through the use of …
Gov response: The government agrees with the Committee’s recommendation. Recommendation implemented The government is committed to ensuring evidence informs AMR policy, through providing research funding aligned with the NAP top 10 research priorities, collaborating on public sector …
Accepted
#5 —
Recommendation: Former Chief Constable Guildford was not informed ahead of giving oral evidence on 6 January that Microsoft Copilot AI had been used to generate the erroneous information about a match between West Ham and Maccabi Tel Aviv. On this basis …
Response Pending
#50 — Utilise best-suited AI models for public sector deployment when procuring solutions.
Recommendation: When procuring AI models for deployment in the public sector the Government and public bodies should utilise those best suited to the task.
Gov response: HMG has set up AI lots in its frameworks, administered by CCS, including a dynamic purchasing system (set up in 2020, running until 2026) to which additional suppliers and products can be added at any …
Accepted
#40 — Dominance of leading AI developers stifles free and open competition in the market
Recommendation: At the so-called ‘frontier’ of AI a small group of leading developers are responsible for and accruing significant benefits from the development of advanced models and tools—thanks in part to their ability to access the necessary training data. This potential …
Gov response: The Government is committed to ensuring that fair and open competition drives growth and innovation in the AI ecosystem. The Digital Markets, Competition and Consumers Act equips the Competition and Markets Authority (CMA) with new, …
Accepted
#37 —
Recommendation: The Government should prioritise the diffusion and adoption of innovation and technologies across the UK. This will require greater emphasis on building skills for smaller businesses; increased advice and support on regulatory matters for smaller businesses; making finance available to …
Response Pending
#41 — Require CMA to identify and address abuses of market power by AI developers
Recommendation: As the regulator responsible for promoting competitive markets and tackling anti- competitive behaviour, the CMA should identify abuses of market power and use its powers to stop them. This could take the form of levying fines or requiring the restructuring …
Gov response: The Government is committed to ensuring that fair and open competition drives growth and innovation in the AI ecosystem. The Digital Markets, Competition and Consumers Act equips the Competition and Markets Authority (CMA) with new, …
Accepted
#25 — Confirm models tested by AI Safety Institute, testing details, findings, and developer changes.
Recommendation: In its response to this Report, the Government should confirm which models the AI Safety Institute has undertaken pre-deployment safety testing on, the nature of the Governance of artificial intelligence (AI) 55 testing, a summary of the findings, whether any …
Gov response: Our intention is for legislation to put the AI Safety Institute (AISI) on a statutory footing and there will be further detail about this in the coming months. We are proud of the work of …
Not Accepted
#16 — NHS Resolution exploring AI to analyse negligence claims data for insights.
Recommendation: Some clinical negligence firms are reportedly using artificial intelligence to triage claims more efficiently and effectively. NHS Resolution holds almost 30 years of experience and data concerning compensation claims.33 NHS Resolution told us it is starting to explore how technology …
Gov response: 3. PAC conclusion: We are concerned there is far too little data on the factors behind clinical negligence, given its huge impact on people’s lives and NHS finances. 3b. PAC recommendation: The Department, NHS England …
Accepted
#25 —
Recommendation: Natural England told us it has made progress in improving its guidance through adding real-life case studies so that businesses can understand what they need to do to comply.66 Defra also explained it has piloted the use of AI tools …
Response Pending
#19 — Mandate deposition of research data in open-access repositories and encourage FAIR principles
Recommendation: Journals should collectively encourage researchers to employ the FAIR (Findability, Accessibility, Interoperability, and Reuse of digital assets) principles within their research and should mandate the deposition of research data in open- access repositories alongside the publication of research outputs.
Gov response: We partially accept this recommendation. 52. The UKRI open access policy seeks to ensure that research articles, monographs, book chapters and edited collections that acknowledge its funding are made freely accessible. From January 2024, UKRI’s …
Partially Accepted
#18 — Mandate researchers to share open-source data and code alongside all published outputs
Recommendation: Currently, research outputs are frequently published without an associated link through to their open-source data and code. This prevents other researchers assessing work for its reproducibility. In all bar the most exceptional ethical and legal situations, researchers should share their …
Gov response: We partially accept this recommendation. 52. The UKRI open access policy seeks to ensure that research articles, monographs, book chapters and edited collections that acknowledge its funding are made freely accessible. From January 2024, UKRI’s …
Partially Accepted
#17 — Implement 100% open access policies for scientific outputs by UKRI and funders by 2025
Recommendation: The trend towards blanket open access in the communication of scientific outputs is positive. UKRI and other research funders should continue to implement open access policies until this figure reaches 100%, by the end of 2025 at the latest.
Gov response: We partially accept this recommendation. 52. The UKRI open access policy seeks to ensure that research articles, monographs, book chapters and edited collections that acknowledge its funding are made freely accessible. From January 2024, UKRI’s …
Partially Accepted
#4 — AI technology offers transformative potential for medical research, drug development, and personalised medicine.
Recommendation: The ability of AI models and tools to process substantial volumes of data, and rapidly identify patterns where human researchers might take months or be unable to, makes it a potentially transformational technology for medical research. Either through the development …
Gov response: In the AI Regulation White Paper, we said that we do not intend to introduce new legislation immediately. We are taking an evidence-based approach to regulation, establishing the Frontier AI Taskforce (and now the AI …
Accepted
#56 — Commission a review into AI's future skills and employment consequences, including retraining for automation.
Recommendation: The current Government, or its successor, should commission a review into the possible future skills and employment consequences of AI, along the lines of the 2017 Taylor Review of modern working practices which examined the landscape, suggested ideas for debate …
Gov response: of artificial intelligence (AI). The Unit for Future Skills (which has now moved into Skills England Analysis and Insight) previously released a report on the impact AI will have on workers in the UK (GOV.UK …
Accepted
#49 — AI marketplace requires diversity to support both open and closed-source models.
Recommendation: The open-source approach has underpinned many technological breakthroughs, including the Internet and AI. Whilst some providers of products and services, such as AI models and their applications, will want to keep elements of their offerings proprietary, a healthy AI marketplace …
Gov response: AI openness has helped support innovation, transparency, and AI safety research. We are committed to defending the importance of openness and supporting the UK’s open-source ecosystem while also taking steps to improve AI safety. Government …
Under Consideration
#3 —
Recommendation: Mr Gurr told us that fiscal constraints mean the CMA cannot expect to hire more people, and it must therefore make the most of those they have. Its 4P transformation programme is vital to achieving this, and he also pointed …
Response Pending
#20 — Continued emphasis on data management plans as a condition of research funding is necessary
Recommendation: We welcome UKRI’s use of data management plans. A continued emphasis on their importance as a condition of research funding is necessary.
Gov response: We accept this conclusion. 54. Data management plans remain an important requirement for most research projects that UKRI funds. As part of the review and development of research data policies and funding application requirements, UKRI …
Not Addressed
#6 — AI offers benefits for teachers and pupils, but raises assessment questions for coursework.
Recommendation: The benefits for time-pressed teachers using AI models and tools to help prepare lesson plans are clear, and increased availability of personalised learning and tutoring tools could benefit many pupils. However, widespread use of AI raises questions about the nature …
Gov response: We welcome the Committee’s analysis of the challenges posed by AI and agree on their importance, as well as the urgency of effective international action to tackle the risks identified. Active international engagement will continue …
Accepted
#3 — AI models demonstrate transformative potential in healthcare diagnostics and professional time-saving.
Recommendation: AI models and tools can transform healthcare provision, by assisting with diagnostics and, perhaps more significantly, freeing up time for the judgement of medical professionals by automating routine processes.
Gov response: As part of our work to establish the UK’s AI regulatory framework, we are working closely with a range of regulators to make sure they have the skills, expertise and powers to deliver on our …
Accepted
#42 — High-quality input data is crucial for effective AI models and tools
Recommendation: AI models and tools rely on access to high-quality input data. The phrase ‘garbage in, garbage out’ is not new, but it is particularly applicable to AI.
Gov response: AI-driven automated decision-making can play an important role in delivering effective services and improving productivity. The UK’s data protection framework strikes a balance between enabling the best use of the technology whilst providing safeguards for …
Accepted
#7 — Prioritise equipping children with digital literacy and critical engagement skills for ubiquitous AI.
Recommendation: Education policy must prioritise equipping children with the skills to succeed in a world where AI is ubiquitous: digital literacy and an ability to engage critically with the information provided by AI models and tools.
Gov response: The UK believes that the dangers of frontier AI risks are increasingly urgent. That is why the UK has convened the inaugural AI Safety Summit. Over two days the Summit brought together approximately 150 representatives …
Accepted
#5 — AI tools already provide useful time-saving benefits for education professionals and students.
Recommendation: AI tools are already useful time-savers for education professionals, and whilst reliable data is hard to come by, it seems highly likely that the technology is this generation of students’ calculator or smartphone.
Gov response: In the first progress update we published about the Taskforce, we announced the first seven expert board members, and details about the first partnerships we have made. The Taskforce is the progenitor for the recently …
Accepted
#2 — AI as a tool, not sentient machines, guided by human instruction.
Recommendation: Nevertheless, the technology should not be viewed as a form of magic or as something that creates sentient machines capable of self-improvement and independent decisions. It is akin to other technologies: humans instruct a model or tool and use the …
Gov response: We welcome the Committee’s analysis of the challenges posed by AI and agree with the need for effective domestic governance and regulation, accompanied by international engagement and alignment, to ensure the UK can drive responsible, …
Accepted