SDM
AbilityLinks
Posted 20 Nov 2026, 07:08 ET
This job at a glance
AbilityLinks is hiring for SDM - AWS Glue, GenAI for Data Processing, AWS Glue, Glue and GenAI for Data Processing (on-site in East Palo Alto). It is open to new grads and people with up to 3 years of experience. The posting asks for AWS, Product management and System design. 19% of the 99 similar entry-level jobs posted this week also ask for Product management. Pay is not stated.
- Who can apply
- New grads and up to 3 years
- Must know
- AWSProduct managementSystem designMachine learningLLMsSpark
- Work
- On-site in East Palo Alto
- Pay
- Not stated by the employer.
- Skill demand
- Product management19%AWS12%System design5%Machine learning5%of 99 similar entry-level jobs posted in the US this week
- Listed
- Nov 20, 2026 · still open
Sign in free to see which of these skills your resume already shows.
From the original posting on LinkedIn
About the Role
This is a 0→1 product area expanding in scope, offering the opportunity to shape the roadmap for AI-powered developer tools across AWS Analytics. The pace is fast, with a transition from idea to General Availability in under a year. You will work directly with enterprise customers and partner with senior leadership on strategy. There is a clear path to scale your team and impact as new agent capabilities are built.
Key Responsibilities
- Lead and grow an engineering team building AI agents for Analytics.
- Own design, implementation, testing, and deployment end-to-end.
- Drive technical decisions at the intersection of GenAI, distributed systems, big data, and machine learning.
- Mentor engineers on complex technical trade-offs and career growth.
- Partner with senior executives on business targets, resource planning, and technical strategy.
- Hire and develop top engineering talent.
What You'll Own
- Spark Upgrade & Migration Agents: Develop agentic AI systems to automate Spark version upgrades, transforming 6-12 month processes into weeks through automated code transformation, conversational interfaces, and rigorous data quality validation. Expand into broader SQL migration across AWS Analytics services (Athena, SparkSQL, Redshift) over the next 2-3 years.
- Managed Analytics MCP Service: Build a fully managed Model Context Protocol server providing AI assistants (Kiro, Claude, Cline) and agents secure access to Spark upgrade, migration, troubleshooting, and code recommendation tools, built on JSON-RPC with IAM-based permissions and CloudTrail auditability.
Requirements & Tech Stack
- Experience with AWS Glue.
- Experience with GenAI for Data Processing.
- Familiarity with Amazon EMR.
- Familiarity with Amazon Athena.
- Familiarity with SparkSQL.
- Familiarity with Redshift.
- Experience with JSON-RPC.
- Experience with IAM-based permissions.
- Experience with CloudTrail auditability.
Qualifications
- Technical leadership experience.
- Experience building AI agents that solve real problems for data engineers.
- Experience building agentic AI systems across AWS Glue, Amazon EMR, and Amazon Athena.
- Experience with Spark version upgrades and migration.
- Experience with SQL migration across AWS Analytics services.
- Experience with building a managed Model Context Protocol server.
- Experience with leading and growing an engineering team.
- Experience driving technical decisions at the intersection of GenAI, distributed systems, big data, and machine learning.
- Experience mentoring engineers on technical trade-offs and career growth.
- Experience partnering with senior executives on business targets, resource planning, and technical strategy.
- Experience hiring and developing top engineering talent.
- Ability to ship production AI systems to millions of AWS customers.