LLM Systems Engineer
People Foundry
Delhi, India1h agovia LinkedIn
About the Role
The LLM Systems Engineer is a full-time, on-site role based in Delhi, India. This role involves designing, implementing, and maintaining systems that support large language model (LLM) workloads, including compute, storage, and networking infrastructure.
Key Responsibilities
- Monitoring system performance.
- Diagnosing and resolving technical issues.
- Ensuring high availability and reliability of LLM platforms.
- Collaborating with data science and engineering teams to optimize deployments.
- Automating workflows.
- Supporting model training and inference environments.
- Creating documentation.
- Implementing security and compliance best practices.
- Contributing to continuous improvement of the underlying systems architecture.
Requirements & Tech Stack
- Systems Engineering skills, including systems architecture design and integration for high-performance and distributed computing environments.
- Experience with Systems Design for scalable, reliable, and secure infrastructure supporting machine learning or LLM workloads.
- Proficiency in System Administration, including operating system management (Linux/Unix), configuration, and automation tools.
- Hands-on Troubleshooting and Technical Support abilities for complex, production-grade systems and services.
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP).
- Familiarity with containerization/orchestration tools (e.g., Docker, Kubernetes).
- Experience working with ML/LLM pipelines or MLOps tools is highly beneficial.
- Solid scripting or programming skills (e.g., Python, Bash) for automation and tooling.
- Strong communication skills and the ability to collaborate effectively with cross-functional teams.
Qualifications
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.