SDM

AbilityLinks

East Palo Alto, CA0–3 yrs49m agovia LinkedIn

Posted 20 Nov 2026, 07:08 ET

This job at a glance

AbilityLinks is hiring for SDM - AWS Glue, GenAI for Data Processing, AWS Glue, Glue and GenAI for Data Processing (on-site in East Palo Alto). It is open to new grads and people with up to 3 years of experience. The posting asks for AWS, Product management and System design. 19% of the 99 similar entry-level jobs posted this week also ask for Product management. Pay is not stated.

Who can apply
New grads and up to 3 years
Must know
AWSProduct managementSystem designMachine learningLLMsSpark
Work
On-site in East Palo Alto
Pay
Not stated by the employer.
Skill demand
Product management19%AWS12%System design5%Machine learning5%of 99 similar entry-level jobs posted in the US this week
Listed
Nov 20, 2026 · still open

Sign in free to see which of these skills your resume already shows.

From the original posting on LinkedIn

About the Role

This is a 0→1 product area expanding in scope, offering the opportunity to shape the roadmap for AI-powered developer tools across AWS Analytics. The pace is fast, with a transition from idea to General Availability in under a year. You will work directly with enterprise customers and partner with senior leadership on strategy. There is a clear path to scale your team and impact as new agent capabilities are built.

Key Responsibilities

  • Lead and grow an engineering team building AI agents for Analytics.
  • Own design, implementation, testing, and deployment end-to-end.
  • Drive technical decisions at the intersection of GenAI, distributed systems, big data, and machine learning.
  • Mentor engineers on complex technical trade-offs and career growth.
  • Partner with senior executives on business targets, resource planning, and technical strategy.
  • Hire and develop top engineering talent.

What You'll Own

  • Spark Upgrade & Migration Agents: Develop agentic AI systems to automate Spark version upgrades, transforming 6-12 month processes into weeks through automated code transformation, conversational interfaces, and rigorous data quality validation. Expand into broader SQL migration across AWS Analytics services (Athena, SparkSQL, Redshift) over the next 2-3 years.
  • Managed Analytics MCP Service: Build a fully managed Model Context Protocol server providing AI assistants (Kiro, Claude, Cline) and agents secure access to Spark upgrade, migration, troubleshooting, and code recommendation tools, built on JSON-RPC with IAM-based permissions and CloudTrail auditability.

Requirements & Tech Stack

  • Experience with AWS Glue.
  • Experience with GenAI for Data Processing.
  • Familiarity with Amazon EMR.
  • Familiarity with Amazon Athena.
  • Familiarity with SparkSQL.
  • Familiarity with Redshift.
  • Experience with JSON-RPC.
  • Experience with IAM-based permissions.
  • Experience with CloudTrail auditability.

Qualifications

  • Technical leadership experience.
  • Experience building AI agents that solve real problems for data engineers.
  • Experience building agentic AI systems across AWS Glue, Amazon EMR, and Amazon Athena.
  • Experience with Spark version upgrades and migration.
  • Experience with SQL migration across AWS Analytics services.
  • Experience with building a managed Model Context Protocol server.
  • Experience with leading and growing an engineering team.
  • Experience driving technical decisions at the intersection of GenAI, distributed systems, big data, and machine learning.
  • Experience mentoring engineers on technical trade-offs and career growth.
  • Experience partnering with senior executives on business targets, resource planning, and technical strategy.
  • Experience hiring and developing top engineering talent.
  • Ability to ship production AI systems to millions of AWS customers.

Entry-Level Jobs in SF Bay Area · last 7 days

60 openings · 59 need no experience

Most hiring: Applied Materials, Snowflake, Warker LLC

See all 60 →

FirstHire never charges to apply, and real employers don't ask for money for tests, interviews or offer letters. How we list jobs · Report this job