Official websites use .gov
A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.
Careers at CAISI
About CAISI
CAISI, within NIST at the Department of Commerce, acts as a startup within government, taking on ambitious projects to make an outsized impact.
CAISI has been designated by Secretary Howard Lutnick to serve as industry’s primary point of contact within the U.S. government to facilitate testing and collaborative research related to harnessing and securing the potential of commercial AI systems. Under President Trump’s AI Action Plan, CAISI received seventeen taskings spanning AI security research, national security evaluations, analysis of global AI competition, measurement science, interagency coordination on AI, and developing voluntary standards.
Leading AI companies partner with CAISI on a voluntary basis for support evaluating their most capable models prior to deployment. Additionally, CAISI maintains close partnerships across the federal government, including the national security community, and has built a reputation for technical excellence.
CAISI maintains offices in Washington, D.C and downtown San Francisco. Work at CAISI is in-person, however some forms of engagement may allow for other arrangements. Employment at CAISI requires U.S. citizenship.
Teams
Teams at CAISI are small and collaboration across the organization is common. Staff members and collaborators at CAISI stand out for their dedication to technical excellence, domain expertise, commitment to scientific rigor, and passion for AI. This includes, but is not limited to, software engineers, AI research engineers and scientists, cybersecurity and biological security experts, and experienced measurement scientists. Descriptions of current team activities are provided below.
Agent Security
Overview of team activities:
- Measuring and improving the security of AI systems.
- Assessing risks such as agent hijacking, data poisoning, jailbreaking, and reward hacking.
- Manual and automated red-teaming of AI agent systems.
- Developing guidelines and best practices for secure development and deployment of AI.
The Agent Security team is not hiring at this time.
Applied Systems
Overview of team activities:
- Multidisciplinary measurement of AI systems in real-world settings, in application or post-deployment, including projects such as field testing to gather user preferences of AI systems in real workflows and uplift studies to measure AI-driven productivity across a range of tasks.
- Developing improved methods for rigorously evaluating AI systems, as well as vetting the measurement instruments themselves (e.g., assessing benchmarks for construct, predictive, and statistical validity).
- Collaborating with subject-matter experts across the field to create guidelines, reports, briefings, and peer-reviewed papers for a wide range of audiences (including inter-agency practitioners and the Intelligence Community) on AI measurement practice.
The Applied Systems team is not hiring at this time.
Applied Systems also participates in the NRC Research Associateship Program through the National Academies (February and August cycles)
Chem/Bio
Overview of team activities:
- Evaluating computational chemical and biological capabilities, including biomolecular prediction and design.
- Creating benchmarks to monitor advancements in performance and utility of chemical and biological AI models.
- Developing, running, and interpreting chem/bio evaluations in order to understand impacts on national security.
- Collaborating with subject matter experts within government, AI industry, and AI evaluators to improve measurement methodologies for chem/bio evaluations.
The Chem/Bio team is not hiring at this time.
Cyber
Overview of team activities:
- Conducting automated and human-assisted evaluations of offensive cyber capabilities for vulnerability research, exploit development, and cyber workflow automation.
- Developing, running, and interpreting cyber evaluations in order to understand impacts on national security.
- Collaborating with subject matter experts within government, AI industry, and AI evaluators to improve measurement methodologies for cyber evaluations.
The Cyber team is not hiring at this time.
Frontier Assessment
Overview of team activities:
- Assessing capabilities of US and foreign AI systems and how those capabilities may evolve over time.
- Assessing general AI capabilities and their national security consequences.
- Collaborating with frontier AI labs on pre-deployment evaluations.
- Producing reports, briefings, and memos on the AI landscape for US government stakeholders.
- Building infrastructure for large-scale, quick-turnaround, high-signal evaluations.
- Designing new methodologies, e.g. for measuring partial progress on hard agent-based tasks, and for making accurate cost efficiency comparisons.
The Frontier Assessment team is not hiring at this time.
Partnerships
Overview of team activities:
- Developing guidelines for the AI industry and government agencies, on topics including, for example, the security and robustness of AI systems and mitigating potential vulnerabilities when deploying AI agents and ensuring that AI evaluations are informative and reproducible.
- Managing CAISI’s partnership agreements and collaborations, including with frontier AI labs and academia.
- Coordinating with other teams at NIST to develop voluntary standards and engage with international standards development organizations.
The Partnerships team is hiring not hiring at this time.