About the AI Security Institute
The AI Security Institute is the largest team in a government dedicated to understanding AI capabilities and risks in the world.
Our mission is to equip governments with an empirical understanding of the safety of advanced AI systems. We conduct research to understand the capabilities and impacts of advanced AI and develop and test risk mitigations. We focus on risks with security implications, including the potential of AI to assist with the development of chemical and biological weapons, how it can be used to carry out cyber-attacks, enable crimes such as fraud, and the possibility of loss of control.
The risks from AI are not sci-fi, they are urgent. By combining the agility of a tech start-up with the expertise and mission-driven focus of government, we’re building a unique and innovative organisation to prevent AI’s harms from impeding its potential.
About the Chem/Bio Team
The mission of the Chem/Bio team is to equip policymakers with an empirical understanding of safety-relevant AI capabilities, specifically at the intersection of AI with biology and chemistry.
The team studies AI capabilities including (but not limited to) providing detailed instructions and (multimodal) troubleshooting for chemical or biological lab work, designing new or modified biological agents, and autonomously completing tasks on behalf of the user.
The team works closely with other teams within the AI Safety Institute and wider UK government stakeholders, and external experts, to make sure our research has real-world impacts on AI safety and chemical and biological security through policy recommendations.
Job Description
We are looking for a research scientist to join the human behavioural research team within the Chem/Bio workstream. Working with an interdisciplinary group of research scientist & engineers to design and deliver research studies which measure how AI tools assist both non-experts and experts in their scientific capabilities.
The research program combines online research studies, in-lab randomised controlled trials, and in-organisation projects. You will work closely with other team members and collaborators from government, academia and industry, and receive coaching and mentorship from the human studies lead, as well as our workstream lead who is an established expert in biosecurity.
Your day-to-day work may involve:
- Managing an online panel study, where participants complete various tasks on a web interface.
- Collaborating with the team and partners to design a randomised control trial measuring improvement in a wet lab task using an AI model.
- Working with other team members and partner institutions to design an intervention study looking at the impact of a specific tool on research success.
- Creating and validating behavioural questionnaire measures of experience using AI models in a research study.
- Summarizing experimental findings for a non-technical audience. Collaborating with strategy and delivery teams to share insights with government colleagues.
- Writing statistical analysis of experimental results, including data cleaning and detection of cheating/low effort responses.
- Setting up an online study to use an API to allow participants to interact with a hosted AI tool.
- Attend talks and journal clubs to keep up to date with the rapidly evolving AI landscape.
Person specification
You may be a good fit if you have some of the following skills, experience and attitudes:
- Relevant experience in industry, open-source collectives, or academia in a field related to behavioral science, behavioral data science, randomized controlled trials, or human-computer-interaction.
- Experience running behavioral randomized controlled trials online or in an organizational context.
- Experience in writing code that is scalable, robust and easy to maintain, ideally in Python.
- Strong quantitative skills and a solid understanding of statistics in the context of research design and inference.
- Hands-on experience illustrating and writing up empirical research findings, ideally producing a deliverable such as a blog post or paper.
- Strong communication skills and the ability to engage both technical and non-technical audiences.
- Experience working in cross-functional teams, including both scientists and engineers.
- Motivated to conduct research that solves concrete open questions in governance and policy making.
- Ability to work autonomously and in a self-directed way with high agency, thriving in a constantly changing environment and a steadily growing team, while figuring out the best and most efficient ways to solve a particular problem.
- Have a sense of mission, urgency, and responsibility for success, demonstrating problem-solving abilities and preparedness to acquire any missing knowledge necessary to get the job done.
The following are also nice-to-have:
- Experience in natural sciences, e.g. previous research placement in biology or chemistry or related undergraduate degree
- Experience in evaluating human usage of frontier AI models.
- Web development skills, especially front-end.
- Track record of high impact, peer-reviewed publications.
Additional Information
Security
Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. People working with government assets must complete baseline personnel security standard checks.
Nationality Requirements
UK nationals only.
Working for the Civil Service
The Civil Service Code sets out the standards of behaviour expected of civil servants. We recruit by merit on the basis of fair and open competition. The Civil Service embraces diversity and promotes equal opportunities. We run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria and offer a Redeployment Interview Scheme to civil servants at risk of redundancy.
Diversity and Inclusion
The Civil Service is committed to attracting, retaining, and investing in talent wherever it is found. We value diversity and strive to create an inclusive environment where everyone can contribute to our mission.
Additional Information
Internal Fraud Database
The Internal Fraud function of the Fraud, Error, Debt and Grants Function at the Cabinet Office processes details of civil servants who have been dismissed for committing internal fraud, or who would have been dismissed had they not resigned. The Cabinet Office receives the details from participating government organisations of civil servants who have been dismissed, or who would have been dismissed had they not resigned, for internal fraud. In instances such as this, civil servants are then banned for 5 years from further employment in the civil service. The Cabinet Office then processes this data and discloses a limited dataset back to DLUHC as a participating government organisations. DLUHC then carry out the pre employment checks so as to detect instances where known fraudsters are attempting to reapply for roles in the civil service. In this way, the policy is ensured and the repetition of internal fraud is prevented. For more information please see - Internal Fraud Register.
Security
Successful candidates must undergo a criminal record check and get baseline personnel security standard (BPSS) clearance before they can be appointed. Additionally, there is a strong preference for eligibility for counter-terrorist check (CTC) clearance. Some roles may require higher levels of clearance, and we will state this by exception in the job advertisement. See our vetting charter here.
Nationality requirements
We may be able to offer roles to applicant from any nationality or background. As such we encourage you to apply even if you do not meet the standard nationality requirements (opens in a new window).
