About the Organization:
The organization is a non-profit organization working to reduce extreme risks from powerful technology, especially advanced AI. We do this by conducting policy research, outreach, and grantmaking. We have been instrumental in shaping global conversations and policies related to AI safety and responsible development.
The Role:
We are seeking a highly skilled and experienced Senior Technical Specialist to join our AI Risk Assessment team. This critical role will involve evaluating the safety and societal impacts of cutting-edge AI systems, developing robust assessment methodologies, and informing policy recommendations. You will work at the forefront of AI safety research, collaborating with leading experts in the field.
Responsibilities:
- Develop and implement technical methodologies for assessing the risks posed by advanced AI systems, including capabilities for misuse, alignment failures, and other societal impacts.
- Conduct in-depth technical analyses and evaluations of AI models, algorithms, and architectures to identify potential vulnerabilities and failure modes.
- Stay abreast of the latest advancements in AI research and development, particularly in areas relevant to AI safety, interpretability, and robust AI.
- Collaborate with interdisciplinary teams, including policy experts, researchers, and external stakeholders, to translate technical findings into actionable policy recommendations and public-facing reports.
- Contribute to the development of open-source tools and frameworks for AI risk assessment.
- Present findings to technical and non-technical audiences, including policymakers, researchers, and the general public.
- Mentor junior team members and contribute to a culture of technical excellence and rigorous analysis.
Prerequisites/Qualifications:
Education:
- Master’s or Ph.D. in Computer Science, Machine Learning, AI Ethics, or a related technical field.
Experience:
- Minimum of 5-7 years of experience in AI/ML research, development, or risk assessment.
- Proven track record of working with large-scale AI systems, deep learning models, and complex data environments.
- Experience in areas such as AI safety, interpretability, fairness, robustness, or adversarial machine learning.
- Demonstrated ability to conduct rigorous technical analysis and research, with publications in top-tier conferences or journals preferred.
Skills:
- Strong programming skills in Python, alongside familiarity with relevant AI/ML frameworks (e.g., TensorFlow, PyTorch).
- Excellent analytical, problem-solving, and critical thinking abilities.
- Exceptional written and verbal communication skills, with the ability to convey complex technical concepts to diverse audiences.
- Ability to work independently and collaboratively in a fast-paced, mission-driven environment.
- Deep understanding of the current landscape of AI capabilities, limitations, and potential societal impacts.
Bonus Points (Nice-to-haves):
- Experience with formal verification, causal inference, or control theory.
- Familiarity with policy-making processes related to technology and AI.
- Experience in non-profit or research organizations focused on societal impact.
