Back End Developer, AI Agentic Infrastructure

About the Role

We are looking for a Backend Developer Intern to help build the infrastructure behind our production Agentic AI systems. This is not a sandbox or tutorial-based internship. You will work on real systems that sit underneath AI agents — APIs, orchestration, state management, tool execution, retries, streaming, observability, and failure recovery.

Building backends for AI agents presents different challenges from traditional CRUD applications. LLM calls can be slow, nondeterministic, and expensive. The interesting engineering work is often everything surrounding the model: handling timeouts without duplicating side effects, streaming partial responses correctly, tracking state across multi-step agent runs, recovering from failures, and designing APIs that remain reliable when an external model takes 20 seconds instead of 200 milliseconds. We are looking for someone who enjoys understanding why a system works, not simply getting it to run.

Key Responsibilities

• Design and build backend services using Python and FastAPI
• Build APIs that power AI agents and LLM-based applications
• Develop asynchronous workflows for long-running LLM and external API calls
• Build orchestration around agent execution, including retries, timeouts, idempotency, and state management
• Manage state across multi-step agent and tool-calling workflows
• Implement streaming responses for long-running AI operations
• Work with relational and/or NoSQL databases for application data, agent state, and execution history
• Design schemas, queries, migrations, and indexes for real workloads
• Implement rate limiting, particularly around expensive LLM/API operations
• Build logging and observability for agent runs and failures
• Write automated tests covering both successful and failure scenarios
• Debug slow queries, race conditions, flaky integrations, and external API failures
• Follow secure development practices, including proper secret and credential management
• Collaborate asynchronously with a small engineering team through clear documentation and written updates

Requirements & Tech Stack

• Python
• FastAPI
• Async Python
• LLMs
• Agent Orchestration
• Databases

Qualifications

• Currently pursuing or recently completed a degree in Computer Science, IT, Engineering, or a related field
• Strong fundamentals in Python
• Hands-on experience with FastAPI, or experience with Flask/Django and an interest in FastAPI
• Understanding of async/await and asynchronous Python
• Understanding of REST APIs and HTTP concepts
• Basic understanding of database design and SQL and/or NoSQL databases
• Comfortable using Git and standard development workflows
• At least one original project on GitHub that you personally built and can explain
• Strong interest in LLMs, AI agents, and production AI infrastructure
• Prior professional experience with Agentic AI is not required.

Strong Signals

The following are not requirements, but they will help your application stand out:

• Experience integrating OpenAI, Anthropic, Gemini, or another LLM API
• Experience building tool-calling or multi-step AI workflows
• Experience with LangGraph, CrewAI, or similar orchestration frameworks
• Experience writing automated tests for personal or academic projects
• Understanding of concurrency, retries, rate limiting, and failure recovery
• Exposure to streaming APIs or WebSockets
• Experience with PostgreSQL, Redis, vector databases, or similar technologies
• Experience with Docker and CI/CD
• Experience deploying applications to AWS, GCP, Azure, Render, Railway, or similar platforms
• Awareness of basic application security and secret management