Research Engineer, Post-Training
San Francisco · 全职 · 算法与研究
需要对标的能力
Agent · 智能体设计模型微调 · Post-TrainingAI Infra · 推理部署评测 · Eval 方法论权限 · 沙箱 · 治理AI 产品设计 · 产品化
岗位职责与要求
WE ARE AN APPLIED AI LAB BUILDING END-TO-END SOFTWARE AGENTS.
We're the makers of Devin, the first AI software engineer.
Our team is extremely talent-dense. Among our founding team, we have world-class competitive programmers, former founders, and leaders from companies at the cutting edge of AI including Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub, Modal, Google DeepMind, and Nuro.
Building Devin is just the first step—our hardest challenges still lie ahead. If you’re excited to solve some of the world’s biggest problems and build AI that can reason on real-world tasks, apply to join us.
ROLE MISSION
Post-training is the critical bridge between raw model capability and a system that is actually useful, safe, and effective in the real world. You will shape how our agents learn by iterating on training recipes, evaluations, and alignment methods that directly determine what Devin and our future systems can do. This role blends deep research and hands-on engineering. We don't distinguish between the two.
WHAT YOU'LL ACCOMPLISH
- Post-Training Recipe Development: Iterate on the full stack of datasets, training stages, and hyperparameters that determine model behavior. Measure how choices compound across evals and production performance, not just isolated benchmarks.
- Evaluation Design and Integrity: Build evals that actually capture what matters. The loop never ends: define, optimize, realize the gaps, and rebuild. You'll be responsible for making numbers go up and making sure the numbers mean something.
- Deep Understanding: When training produces results that don't make sense, you dig until you understand why. The goal isn't just to fix it; it's to carry that understanding forward to the next problem.
- Alignment and Agent Behavior: Apply and advance techniques like RLHF, RLAIF, and constitutional approaches to shape how agents reason, act, and collaborate with humans in long-horizon tasks.
- Scaling and Exploration: Measure how performance scales with data and compute, and develop new methodologies when existing ones hit ceilings. We expect both rigor and invention.
EXCEPTIONAL CANDIDATES HAVE DEMONSTRATED
- A track record of advancing ML systems through post-training, alignment, or related methods: RLHF, RLAIF, preference modeling, reward learning, or equivalent
- Strong fundamentals in probability, statistics, and ML theory. The ability to look at experimental data and distinguish real effects from noise and bugs
- Evidence of original contributions: publications at top venues, open-source impact, or equivalent industry results
- Experience with large-scale distributed training and the debugging that comes with it
- Systems-level thinking: not just model optimization, but understanding how training pipelines, data, and evaluation interact
- Comfort with ambiguity and fast-moving research environments where priorities shift quickly
- We care more about demonstrated capability than credentials. A PhD is one signal among many.
RESOURCES & ENVIRONMENT
- Small, highly selective team where research and product move together; prototypes reach real deployment quickly
- Compute is not a constraint: large allocations with training jobs routinely running across thousands of GPUs from day one
- The environment rewards speed, autonomy, and technical depth with minimal process overhead; this is one of the most competitive and fast-moving problems in AI
- Everything needed to operate at frontier scale from day one.
OUR COMMITMENT
Equal Opportunity. Cognition is an equal opportunity employer. We do not discriminate on the basis of any protected characteristic under applicable law. We are committed to providing reasonable accommodations for candidates with disabilities throughout the hiring process - please let us know if you need any. Cognition also considers applicants with criminal histories consistent with the SF Fair Chance Ordinance and similar local laws.
Data Privacy and Arbitration: By submitting your application, you agree to our Global Applicant and Job Candidate Privacy Notice https://cognition.com/documents/Cognition-Global-Applicant-and-Job-Candidate-Privacy-Notice.pdf. For US applicants, by submitting your application, you agree to the Applicant Arbitration Agreement https://cognition.com/documents/Cognition-Applicant-Arbitration-Agreement.pdf.
查看中文参考译文
我们是一家应用 AI 实验室,致力于构建端到端的 software agents。
我们是 Devin 的创造者——全球首位 AI 软件工程师。
我们的团队人才密度极高。创始团队成员包括世界级 competitive programmers、前创始人,以及来自 AI 前沿公司的领导者,包括 Scale AI、Palantir、Cursor、Waymo、Tesla、Lunchclub、Modal、Google DeepMind 和 Nuro。
构建 Devin 只是第一步——最艰巨的挑战仍在前面。如果你渴望解决世界上最大的难题,并构建能够在真实任务中推理的 AI,欢迎申请加入我们。
ROLE MISSION
Post-training 是原始模型能力与真正有用、安全、有效的实际系统之间的关键桥梁。你将通过迭代训练方案、eval 和 alignment 方法,塑造我们的 agents 如何学习,这些方法直接决定 Devin 和我们未来系统的能力。这一角色融合深度研究与实践工程,我们不区分两者。
WHAT YOU'LL ACCOMPLISH
- Post-Training Recipe Development: 迭代数据集、训练阶段和 hyperparameters 的完整栈,这些因素决定 model behavior。衡量选择如何在 evals 和 production performance 中产生复合效应,而非孤立的 benchmarks。
- Evaluation Design and Integrity: 构建真正能捕捉关键问题的 evals。循环永无止境:定义、优化、发现差距、重建。你将负责让数字上升,并确保这些数字真正有意义。
- Deep Understanding: 当训练产生不合理的结果时,你要深入挖掘直到理解原因。目标不仅是修复它,而是将这份理解带到下一个问题中。
- Alignment and Agent Behavior: 应用并推进 RLHF、RLAIF 和 constitutional approaches 等技术,塑造 agents 如何在 long-horizon tasks 中推理、行动以及与人类协作。
- Scaling and Exploration: 衡量性能如何随数据和 compute 扩展,并在现有方法遇到瓶颈时开发新方法论。我们期待严谨与创造并重。
EXCEPTIONAL CANDIDATES HAVE DEMONSTRATED
- 通过 post-training、alignment 或相关方法推进 ML systems 的 track record:RLHF、RLAIF、preference modeling、reward learning 或同等经验
- 概率、统计和 ML theory 的扎实基础。能够审视实验数据,区分真实效应与 noise 和 bugs
- 原创贡献的证明:顶级 venue 的 publications、open-source 影响力,或同等的 industry results
- 大规模 distributed training 经验及其伴随的 debugging
- 系统级思维:不仅是 model optimization,还要理解 training pipelines、data 和 evaluation 如何交互
- 适应模糊性和快速变化的研究环境,priorities 频繁调整
- 我们更看重 demonstrated capability 而非 credentials。PhD 只是众多信号之一。
RESOURCES & ENVIRONMENT
- 小而精的团队,research 和 product 同步推进;prototypes 快速实现 real deployment
- Compute 不是限制:从第一天起就有大量分配,training jobs 经常在数千 GPU 上运行
- 环境奖励速度、自主性和技术深度,process overhead 极小;这是 AI 领域最具竞争力和最快速发展的难题之一
- 从第一天起就具备 frontier scale 运营所需的一切条件
译文仅供辅助阅读,具体要求以原始招聘来源为准。