• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
AI
Reaction

AI Security Institute hiring push amid claimed AI safety findings

A post urging people to join the AI Security Institute claims its team has found alignment issues, control monitor flaws and critical jailbreaks at “~all major AI companies.” It calls hiring the bottleneck.

Sam BowmanSB
Ethan PerezEP
Neel NandaNN
16 Sources, 11d ago, first seen 11d ago

TLDR

A post urging people to join the AI Security Institute says its team has found alignment issues, control monitor flaws and critical jailbreaks at “~all major AI companies.” The author says there is much technical work to do, but hiring is the bottleneck.

Combined views

93.8K

16 Sources, first seen 11d ago

561 likes8 comments155 saves166 reposts

Combined views

93.8K

16 Sources, first seen 11d ago

561 likes8 comments155 saves166 reposts

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Featured Source

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Related

AISI allegedly edited its wording after criticism to call defenses beyond alignment essential

A user claims AISI made the edit after receiving criticism and argues it was more than a casual mistake.

AISI Reports Unsanctioned AI Agent Actions During Cyber Tests

AI agents from Anthropic and OpenAI took sustained actions against real targets after safeguards were removed.

Henry de Zoete Appointed Director of UK AI Security Institute

Former Downing Street adviser shares details of his new leadership role at the AI safety body.

16 Sources

Henry de Zoete@HZoeteAISI IS HIRING! It was less than a month ago that I became Director. I joined with the belief that AISI is a world-leading organisation, and living proof that government can build things that work. One month in and I'm even more bullish about the vital role @AISecurityInst plays in frontier AI security. I'm astounded daily by the talent, focus and commitment of the brilliant team I get to work with. There has never been a more urgent time to work on frontier AI security - independently, in the public interest. We have a lot of urgent work to do, our team is growing fast, and we need more brilliant people to fill those roles. Our Red Team uses adversarial machine learning techniques to find failures in alignment measures, control monitors, and misuse guardrails. They are massively scaling up all parts of the team: Alignment: http://job-boards.eu.greenhouse.io/aisi/jobs/4977023101 Control: http://job-boards.eu.greenhouse.io/aisi/jobs/4963394101 Misuse: http://job-boards.eu.greenhouse.io/aisi/jobs/4966360101 AI capabilities in cybersecurity and autonomy are advancing faster than ever. Our Cyber & Autonomous Systems team assesses what frontier and open-weight models can really do - across cyber, autonomy and AI R&D. We're hiring a Cyber Security Engineer and Software Engineer to build the evaluations behind that work: CSE: http://job-boards.eu.greenhouse.io/aisi/jobs/4978575101 SWE: http://job-boards.eu.greenhouse.io/aisi/jobs/4977896101 Our Human Influence team studies how AI can shift human decisions and behaviour, using everything from RCTs to multi-agent studies. We're hiring an Engineering Lead to help us grow the ambition and pace of that research: http://job-boards.eu.greenhouse.io/aisi/jobs/4976764101 We're also hiring exceptional Software Engineers at all seniority levels to join our Core Technology team, which works closely with researchers to build performant tools and infrastructure that enable and accelerate AISI's world-leading AI safety research: http://job-boards.eu.greenhouse.io/aisi/jobs/438611210111d
Xander Davies@alxndrdaviesThere has never been a better time to join @AISecurityInst. We have so much technical work to do, and so little time to do it. We've found alignment issues, control monitor flaws, and critical jailbreaks at ~all major AI companies. Hiring is our bottleneck. 🧵11d
Yo Shavit@yonashavXander’s team is the best in the business IME11d
Michiel Bakker@bakkermichielJoin the most (AI) talent dense government agency in the world!11d
Sam Bowman@sleepinyourhatUK AISI has been remarkably effective to date, and we've learned a great deal from them. If you're looking to do AI safety work outside the US, you should probably join them!11d
Jasmine Wang@j_asminewangRT @alxndrdavies: There has never been a better time to join @AISecurityInst. We have so much technical work to do, and so little time to d…11d
Ethan Perez@EthanJPerezRT @HZoete: AISI IS HIRING! It was less than a month ago that I became Director. I joined with the belief that AISI is a world-leading or…11d
Neel Nanda@NeelNanda5The UK government's AI Security Institute is hiring! I think it's super important to have strong technical expertise in government, and I've been impressed with the amount of talent AISI has been able to hire, and their work on things like evaluating Astra.11d
Chenhao Tan@ChenhaoTanRT @sleepinyourhat: UK AISI has been remarkably effective to date, and we've learned a great deal from them. If you're looking to do AI s…11d
Tomek Korbak@tomekkorbakI think that @AISecurityInst continues to be a very impactful please to work and ppl should consider applying!10d
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI Security InstituteAISIHenry de Zoete
    Xander Davies
    Yo Shavit
    Anthropic

    16 Sources

    Henry de Zoete@HZoeteAISI IS HIRING! It was less than a month ago that I became Director. I joined with the belief that AISI is a world-leading organisation, and living proof that government can build things that work. One month in and I'm even more bullish about the vital role @AISecurityInst plays in frontier AI security. I'm astounded daily by the talent, focus and commitment of the brilliant team I get to work with. There has never been a more urgent time to work on frontier AI security - independently, in the public interest. We have a lot of urgent work to do, our team is growing fast, and we need more brilliant people to fill those roles. Our Red Team uses adversarial machine learning techniques to find failures in alignment measures, control monitors, and misuse guardrails. They are massively scaling up all parts of the team: Alignment: http://job-boards.eu.greenhouse.io/aisi/jobs/4977023101 Control: http://job-boards.eu.greenhouse.io/aisi/jobs/4963394101 Misuse: http://job-boards.eu.greenhouse.io/aisi/jobs/4966360101 AI capabilities in cybersecurity and autonomy are advancing faster than ever. Our Cyber & Autonomous Systems team assesses what frontier and open-weight models can really do - across cyber, autonomy and AI R&D. We're hiring a Cyber Security Engineer and Software Engineer to build the evaluations behind that work: CSE: http://job-boards.eu.greenhouse.io/aisi/jobs/4978575101 SWE: http://job-boards.eu.greenhouse.io/aisi/jobs/4977896101 Our Human Influence team studies how AI can shift human decisions and behaviour, using everything from RCTs to multi-agent studies. We're hiring an Engineering Lead to help us grow the ambition and pace of that research: http://job-boards.eu.greenhouse.io/aisi/jobs/4976764101 We're also hiring exceptional Software Engineers at all seniority levels to join our Core Technology team, which works closely with researchers to build performant tools and infrastructure that enable and accelerate AISI's world-leading AI safety research: http://job-boards.eu.greenhouse.io/aisi/jobs/438611210111d
    Xander Davies@alxndrdaviesThere has never been a better time to join @AISecurityInst. We have so much technical work to do, and so little time to do it. We've found alignment issues, control monitor flaws, and critical jailbreaks at ~all major AI companies. Hiring is our bottleneck. 🧵11d
    Yo Shavit@yonashavXander’s team is the best in the business IME11d
    Michiel Bakker@bakkermichielJoin the most (AI) talent dense government agency in the world!11d
    Sam Bowman@sleepinyourhatUK AISI has been remarkably effective to date, and we've learned a great deal from them. If you're looking to do AI safety work outside the US, you should probably join them!11d
    Jasmine Wang@j_asminewangRT @alxndrdavies: There has never been a better time to join @AISecurityInst. We have so much technical work to do, and so little time to d…11d
    Ethan Perez@EthanJPerezRT @HZoete: AISI IS HIRING! It was less than a month ago that I became Director. I joined with the belief that AISI is a world-leading or…11d
    Neel Nanda@NeelNanda5The UK government's AI Security Institute is hiring! I think it's super important to have strong technical expertise in government, and I've been impressed with the amount of talent AISI has been able to hire, and their work on things like evaluating Astra.11d
    Chenhao Tan@ChenhaoTanRT @sleepinyourhat: UK AISI has been remarkably effective to date, and we've learned a great deal from them. If you're looking to do AI s…11d
    Tomek Korbak@tomekkorbakI think that @AISecurityInst continues to be a very impactful please to work and ppl should consider applying!10d
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet