RL Training Framework
SpaceX Super Intelligence
About the Role
The RL infrastructure team is looking for an engineer to help develop our RL training framework.
Key Responsibilities
- Design and implement the systems backing all RL workloads at SpaceXSI, from small scale ablations to production training runs.
- Profile, debug, and optimize end-to-end training performance.
- Improve scalability and observability of the RL stack.
Requirements & Tech Stack
- Experience building, debugging, and optimizing efficiency of large-scale distributed systems.
- Comfortable diving into unfamiliar areas and solving problems at all levels of the stack.
- Proficiency in Python, Jax, Rust, and/or C++.
Preferred Skills and Experience
- Experience with large scale LLM training infrastructure.
- Strong knowledge of reinforcement learning techniques.
- Experience with RL numerics.