Engineering Manager, Safeguards Interventions
San Francisco, CA · 全职 · 工程与基础设施
需要对标的能力
大模型原理 · LLM 基础成本优化 · 性能调优评测 · Eval 方法论多模态 · AI 生图
岗位职责与要求
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
The Safeguards team is responsible for ensuring our models and products are developed and deployed safely. We're looking for an Engineering Manager to lead the Interventions team: the group responsible for what happens when a safety system fires. It owns the composable arsenal of systems that sit between our detection stack (classifiers and probes) and the user, across every Anthropic surface: 1P products, the API, and third-party clouds. This includes inline interventions for areas like bio, cyber, and acceptable usage as well as downstream areas like child safety and copyright. This team is responsible for ensuring that we evolve and drive the quality of our interventions to enable our products to grow safely.
Key responsibilities
· Hands-on lead and grow a team of engineers; own roadmap, OKRs, and execution.
· Drive cross-functional work with ML Infra, Research, Product, Policy, and Legal - and with cloud partners for 3P deployment.
· Set the bar for when an intervention is good enough to ship - backed by measurement - and represent safety and product tradeoffs to leadership and external stakeholders.
· Own production reliability for intervention and compliance systems: incident response, postmortems, SLOs, and the verification processes that prevent repeat incidents.
Minimum qualifications
· Have managed engineering teams shipping production ML or safety-enforcement systems where the system's decisions directly affected users.
· Have run high-stakes, compliance-adjacent production systems: comfortable with on-call, incidents, regulator-driven requirements, and building the process scaffolding that prevents recurrence.
· Care about measurement: you've built (or insisted on) the evals that prove a system does what it claims, and you've killed things that didn't.
· Can drive ambiguous, multi-stakeholder tradeoffs (safety vs UX vs latency vs cost) to a decision and own the outcome.
· Care deeply about AI safety and want your team's work to be the reason advanced models can be deployed at all.
Preferred qualifications
· Have worked in trust & safety, integrity, or abuse-prevention engineering at scale.
· Experience with compliance-driven systems (child safety, copyright, age assurance) and the legal/policy interfaces they require.
· Have shipped systems across multiple cloud providers and understand the parity/verification problems that creates.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$405,000—$485,000 USD
Logistics
Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
查看中文参考译文
Anthropic 的使命是打造可靠、可解释、可控制的 AI 系统。我们希望 AI 对我们的用户和整个社会都是安全且有益的。我们的团队是一支快速成长的队伍,由专注的研究人员、工程师、政策专家和商业领袖组成,共同构建有益的 AI 系统。
关于该职位
Safeguards 团队负责确保我们的模型和产品得到安全开发与部署。我们正在寻找一位 Engineering Manager 来领导 Interventions 团队:该团队负责安全系统触发后的应对措施。它拥有可组合的防御系统体系,部署于我们的检测层(classifiers 和 probes)与用户之间,覆盖 Anthropic 的每一个触点:1P 产品、API 以及第三方云平台。这包括针对生物安全、网络安全、可接受使用等领域的 inline interventions,以及儿童安全、版权等下游领域。该团队负责确保我们不断演进并提升 interventions 的质量,以支持产品安全地增长。
主要职责
· 亲自动手并培养工程师团队;负责路线图、OKR 和执行。
· 推动与 ML Infra、Research、Product、Policy、Legal 的跨职能协作——以及就 3P 部署与云合作伙伴的协作。
· 设定 intervention 达到可发布标准的门槛——以测量为支撑——并向领导层和外部利益相关方呈现安全性与产品之间的权衡。
· 负责 intervention 和 compliance 系统的生产可靠性:incident response、postmortems、SLO,以及防止重复发生的验证流程。
最低资格
· 曾管理过交付生产 ML 或安全执法系统的工程团队,且该系统的决策直接影响用户。
· 曾运营高风险的、与合规相邻的生产系统:熟悉 on-call、incidents、regulator-driven requirements,并能构建防止复发的流程框架。
· 重视测量:你曾构建(或坚持要求)evals 来证明系统确实如其声称的那样工作,并且会淘汰通不过验证的系统。
· 能够推动模糊的、多利益相关方的权衡(safety vs UX vs latency vs cost)并做出决策,对结果负责。
· 深切关注 AI safety,希望团队的工作成为先进模型能够部署的原因。
优先资格
· 曾在 trust & safety、integrity 或 abuse-prevention engineering 领域大规模工作过。
· 具有 compliance-driven 系统(child safety、copyright、age assurance)的经验,以及这些系统所需的法律/政策接口经验。
· 曾在多个 cloud providers 上交付系统,并理解由此带来的 parity/verification 问题。
对于销售岗位,提供的范围是该岗位的 On Target Earnings ("OTE") 范围,这意味着该范围包括销售佣金/销售奖金目标和该岗位的年度 base salary。
年度薪资:
$405,000—$485,000 USD
后勤信息
最低学历:学士学位或同等的教育、培训和/或经验组合
所需专业领域:通过课程、培训或专业经验证明与该岗位相关的领域
最低工作年限:所需工作年限将与该职位的内部 job level 要求相对应
我们相信,最具影响力的 AI 研究将是大科学。在 Anthropic,我们作为一个统一的团队,仅专注于少数几个大规模研究项目。我们重视影响力——推进我们在可控制、可信赖 AI 方面的长期目标——而非研究更小、更具体的课题。我们将 AI 研究视为一门实证科学,它与物理学和生物学的共同点,与传统计算机科学研究的共同点一样多。我们是一个极度协作的群体,我们频繁举办研究讨论,以确保我们在任何时候都在追求最高影响力的工作。因此,我们高度重视沟通技能。
理解我们研究方向的最简单方式是阅读我们近期的研究。这项研究延续了我们团队在加入 Anthropic 之前所从事的多个方向,包括:GPT-3、Circuit-Based Interpretability、Multimodal Neurons、Scaling Laws、AI & Compute、Concrete Problems in AI Safety,以及 Learning from Human Preferences。
译文仅供辅助阅读,具体要求以原始招聘来源为准。