15 May 2024
by Tess Buckley

Navigating the AI safety landscape: a comprehensive overview of the AI Safety Institute (AISI)

Blog from Tess Buckley at techUK as part of our #UnleashInnovation campaign week 2024.

AI innovations, particularly in Generative AI, are evolving swiftly, resulting in the landscape presenting both unparalleled opportunities and unprecedented risks. Consequently, ensuring the safety of AI technologies has emerged as a critical concern for governments, civil societies, and industries worldwide. Getting this right is vital if we are to ensure that the UK remains a trusted global leader in the development and application of emerging technologies. 

This insight is a comprehensive overview of the UK’s AI Safety Insitute, summarising its ambitions, progress on those ambitions, strategic partnerships and approaches to evaluations. Each area is linked to a further explanatory insight which readers can visit if they wish to learn more.  

Origins and objectives of the AISI 

The genesis of the AISI traces back to the Bletchley AI Summit, where it was introduced as the successor to the AI taskforce. While DSIT retains its role in policymaking, the AISI takes charge of research, evaluations, and shaping the future trajectory of AI. Its overarching goal is to safeguard public interests and proactively steer the course of AI development. Additionally, the AISI aspires to position the UK as a global center of excellence in AI safety, with endorsements from governments and leading AI labs worldwide. Read more here. 

Focus areas and strategic partnerships 

The AISI has delineated three priority areas to achieve its objectives: evaluating advanced AI models, conducting foundational AI safety research, and facilitating global information exchange. Through a series of progress reports, it showcases tangible advancements and collaborations towards these goals. 

  • First Progress Report: The AISI lays the groundwork with the establishment of specialised research teams, expert advisory boards, and strategic partnerships with leading organisations. 

  • Second Progress Report: Notable strides include the expansion of research capabilities, the establishment of the UK's AI Research Resource, Isambard-AI, and fostering partnerships for knowledge sharing. 

  • Third Progress Report: The AISI intensifies its focus on evaluating AI systems' technical capabilities, pre-deployment risk testing, and collaboration with diverse stakeholders. Talent acquisition and retention remain pivotal for sustained progress. 

In addition to its domestic endeavors, the AISI has forged strategic partnerships on the international stage. Collaborations with countries like the Republic of Korea and the US exemplify its commitment to global cooperation in advancing AI safety standards. 

Approach to evaluations and role of the AISI 

Central to the AISI's mandate is its role as an independent evaluator of AI systems. Through rigorous evaluation methodologies, including red teaming, human uplift evaluations, and AI agent assessments, it aims to provide early warning signs of potential risks. While maintaining confidentiality in its evaluation process, the AISI pledges transparency by selectively disclosing evaluation results. 

It’s important to note that the AISI doesn't seek to offer definitive safety certifications but rather serves as a supplementary oversight body. The ultimate decision to deploy AI systems rests with the developers, with the AISI providing critical insights to inform responsible decision-making. Read more here. 

What’s next? 

For many UK-based technology companies, understanding the role, purpose and operations of the AISI will be essential if they are to safely and effectively move from the conception and development of AI technologies to their eventual application and commercialisation.  

techUKs AI Safety programme, led by Tess Buckley, will continue to provide more updates on AI safety conversation to ensure communication and understanding of a safe and beneficial AI-powered future. 

You can read more insights in which techUK demystifies key parts of the UK Government and research landscape by viewing our Institutions of Innovation interview series. 

If you found this insight interesting and want to learn more about techUK AI Safety programming, you can check out our website page here or contact [email protected].


 View all campaign week content 

Unleashing Innovation campaign week graphic.png

techUK – Unleashing UK Tech and Innovation 

innovation_icon_badge_final.png

The UK is home to emerging technologies that have the power to revolutionise entire industries. From quantum to semiconductors; from gaming to the New Space Economy, they all have the unique opportunity to help prepare for what comes next.

techUK members lead the development of these technologies. Together we are working with Government and other stakeholders to address tech innovation priorities and build an innovation ecosystem that will benefit people, society, economy and the planet - and unleash the UK as a global leader in tech and innovation.

For more information, or to get in touch, please visit our Innovation Hub and click ‘contact us’. 


Upcoming events:


Latest news and insights:


Get our tech and innovation insights straight to your inbox

Sign-up to get the latest updates and opportunities from our Technology and Innovation and AI programmes.


Learn more about our Unleashing Innovation campaign:

Unleashing the Potential of UK Tech and Innovation.jpg

 

 

Sprint Campaigns

techUK's sprint campaigns explore how emerging and transformative technologies are developed, applied and commercialised across the UK's innovation ecosystem.

Activity includes workshops, roundtables, panel discussions, networking sessions, Summits, and flagship reports (setting out recommendations for Government and industry).

Each campaign runs for 4-6 months and features regular collaborations with programmes across techUK. 

New Space

This campaign explored how the UK can lead on the development, application and commercialisation of space technologies and ultimately realise the benefits of the New Space Economy.

These technologies include AI, quantum, lasers, robotics & automation, advanced propulsion and materials, and semiconductors.

Activity has taken the form of roundtables, panel discussions, networking sessions, Summits, thought leadership pieces, policy recommendations, and a report.

Get in touch below to find out more about techUK's ongoing work in this area.


Event round-ups


Report


Insights


Get in touch

Rory Daniels

Rory Daniels

Senior Programme Manager, Emerging Technologies

Gaming & Esports

This campaign has explored how the UK can lead on the development, application and commercialisation of the technologies set to underpin the Gaming & Esports sector of the future.

These include AI, augmented / virtual / mixed / extended reality, haptics, cloud & edge computing, semiconductors, and advanced connectivity (5/6G).

Activity has taken the form of roundtables, panel discussions, networking sessions, Summits, and thought leadership pieces. A report featuring member case studies and policy recommendations is currently being produced (to be launched in September 2024).

Get in touch below to find out more about contributing to or collaborating on this campaign.


Report


Event round-ups


Insights


Get in touch

Rory Daniels

Rory Daniels

Senior Programme Manager, Emerging Technologies

Web3 & Immersive technologies

Running from July to December 2024, this campaign will explore how the UK can lead on the development, application and commercialisation of web3 and immersive technologies.

These include blockchain, smart contracts, digital assets, augmented / virtual / mixed / extended reality, spatial computing, haptics and holograms.

Activity will take the form of roundtables, workshops, panel discussions, networking sessions, tech demos, Summits, thought leadership pieces, policy recommendations, and reports.

Get in touch below to find out more about contributing to or collaborating on this campaign.


Upcoming events


Event round-ups


Guest insights


Get in touch

Rory Daniels

Rory Daniels

Senior Programme Manager, Emerging Technologies

Campaign Weeks

Our annual Campaign Weeks enable techUK members to explore how the UK can lead on the development and application of emerging and transformative technologies.

Members do this by contributing blogs or vlogs, speaking at events, and highlighting examples of best practice within the UK's tech sector.


Summits

Tech and Innovation Summit 2023

View the recordings

 

Tech and Innovation Summit 2024

View the agenda


Laura Foster

Laura Foster

Associate Director - Technology and Innovation, techUK

Rory Daniels

Rory Daniels

Senior Programme Manager, Emerging Technologies

Tess Buckley

Tess Buckley

Programme Manager - Digital Ethics and AI Safety, techUK

Usman Ikhlaq

Usman Ikhlaq

Programme Manager - Artificial Intelligence, techUK

 

Related topics

Authors

Tess Buckley

Tess Buckley

Programme Manager, Digital Ethics and AI Safety, techUK

Tess is the Programme Manager for Digital Ethics and AI Safety at techUK.  

Prior to techUK Tess worked as an AI Ethics Analyst, which revolved around the first dataset on Corporate Digital Responsibility (CDR), and then later the development of a large language model focused on answering ESG questions for Chief Sustainability Officers. Alongside other responsibilities, she distributed the dataset on CDR to investors who wanted to further understand the digital risks of their portfolio, she drew narratives and patterns from the data, and collaborate with leading institutes to support academics in AI ethics. She has authored articles for outlets such as ESG Investor, Montreal AI Ethics Institute, The FinTech Times, and Finance Digest. Covered topics like CDR, AI ethics, and tech governance, leveraging company insights to contribute valuable industry perspectives. Tess is Vice Chair of the YNG Technology Group at YPO, an AI Literacy Advisor at Humans for AI, a Trustworthy AI Researcher at Z-Inspection Trustworthy AI Labs and an Ambassador for AboutFace. 

Tess holds a MA in Philosophy and AI from Northeastern University London, where she specialised in biotechnologies and ableism, following a BA from McGill University where she joint-majored in International Development and Philosophy, minoring in communications. Tess’s primary research interests include AI literacy, AI music systems, the impact of AI on disability rights and the portrayal of AI in media (narratives). In particular, Tess seeks to operationalise AI ethics and use philosophical principles to make emerging technologies explainable, and ethical. 

Outside of work Tess enjoys kickboxing, ballet, crochet and jazz music.

Email:
[email protected]

Read lessmore