OpenAISoftware Engineer, Model Inference
San Francisco · 全职 · 工程与基础设施
需要对标的能力
AI Infra · 推理部署成本优化 · 性能调优AI 产品设计 · 产品化AI 工程设计模式
岗位职责与要求
About the Team
Our Inference team brings OpenAI’s most capable research and technology to the world through our products. We empower consumers, enterprise and developers alike to use and access our start-of-the-art AI models, allowing them to do things that they’ve never been able to before. We focus on performant and efficient model inference, as well as accelerating research progression via model inference.
About the Role
We are looking for an engineer who wants to take the world's largest and most capable AI models and optimize them for use in a high-volume, low-latency, and high-availability production and research environment.
In this role, you will:
- Work alongside machine learning researchers, engineers, and product managers to bring our latest technologies into production.
- Work alongside researchers to enable advanced research through awesome engineering.
- Introduce new techniques, tools, and architecture that improve the performance, latency, throughput, and efficiency of our model inference stack.
- Build tools to give us visibility into our bottlenecks and sources of instability and then design and implement solutions to address the highest priority issues.
- Optimize our code and fleet of Azure VMs to utilize every FLOP and every GB of GPU RAM of our hardware.
You might thrive in this role if you:
- Have an understanding of modern ML architectures and an intuition for how to optimize their performance, particularly for inference.
- Own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done.
- Have at least 5 years of professional software engineering experience.
- Have or can quickly gain familiarity with PyTorch, NVidia GPUs and the software stacks that optimize them (e.g. NCCL, CUDA), as well as HPC technologies such as InfiniBand, MPI, NVLink, etc.
- Have experience architecting, building, observing, and debugging production distributed systems. Bonus point if worked on performance-critical distributed systems.
- Have needed to rebuild or substantially refactor production systems several times over due to rapidly increasing scale.
- Are self-directed and enjoy figuring out the most important problem to work on.
- Have a humble attitude, an eagerness to help your colleagues, and a desire to do whatever it takes to make the team succeed.
To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form https://form.asana.com/?d=57018692298241&k=5MqR40fZd7jlxVUh5J-UeA. No response will be provided to inquiries unrelated to job posting compliance.
At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.
查看中文参考译文
关于团队
我们的 Inference 团队通过产品将 OpenAI 最强大的研究和技术带给世界。我们赋能消费者、企业和开发者 alike 使用并访问我们最先进的 AI 模型，让他们能够做到以前无法做到的事情。我们专注于高性能、高效率的模型 inference，以及通过模型 inference 加速研究进展。
关于职位
我们正在寻找一位工程师，希望将全球最大、最强大的 AI 模型进行优化，使其能够在高吞吐量、低延迟、高可用性的生产和研究环境中运行。
在这个职位中，你将：
- 与机器学习研究人员、工程师和产品经理并肩工作，将我们最新的技术投入生产。
- 与研究人员合作，通过卓越的工程能力推动前沿研究。
- 引入新的技术、工具和架构，以提升我们模型 inference 栈的性能、延迟、吞吐量和效率。
- 构建工具以洞察我们的瓶颈和不稳定性来源，然后设计并实施解决方案来解决最高优先级的问题。
- 优化我们的代码和 Azure VM 集群，充分利用硬件的每一个 FLOP 和每一 GB GPU RAM。
如果你具备以下条件，你可能适合这个职位：
- 了解现代 ML 架构，并对如何优化其性能有直觉，尤其是在 inference 方面。
- 能够端到端地负责问题，并愿意学习任何缺失的知识来完成工作。
- 拥有至少 5 年专业软件工程经验。
- 已经或能够快速熟悉 PyTorch、NVidia GPU 及其优化软件栈（例如 NCCL、CUDA），以及 HPC 技术如 InfiniBand、MPI、NVLink 等。
- 有设计、构建、监控和调试生产分布式系统的经验。如果有性能关键型分布式系统的工作经验，将是一个加分项。
- 由于规模快速增长，曾多次需要重建或大幅重构生产系统。
- 具有自驱力，喜欢找出最重要的问题来解决。
- 态度谦逊，乐于帮助同事，并愿意尽一切努力使团队成功。
如需通知 OpenAI 你认为此职位发布不合规，请通过此表单提交报告 https://form.asana.com/?d=57018692298241&k=5MqR40fZd7jlxVUh5J-UeA。与职位发布合规性无关的询问将不予回复。
在 OpenAI，我们相信人工智能有潜力帮助人们解决巨大的全球挑战，我们希望 AI 的收益能够被广泛分享。加入我们，共同塑造技术的未来。
译文仅供辅助阅读，具体要求以原始招聘来源为准。