Applied Scientist

Amazon Web Services (AWS)

Bellevue, WA52m agovia LinkedIn

Posted 18 Nov 2026, 19:25 ET

This job at a glance

Who can apply
New grads, no experience needed · Master's degree
Must know
AWSLLMsAuditingMachine learningStakeholder managementStatistics
Nice to have
Data structures & algorithms
Work
On-site in Bellevue
Pay
Not stated by the employer.
Skill demand
Machine learning18%LLMs9%AWS7%Auditing4%of 99 similar entry-level jobs posted in the US this week
Listed
Nov 18, 2026 · still open

Sign in free to see which of these skills your resume already shows.

About the Role

The Artificial General Intelligence (AGI) team at Amazon Web Services (AWS) is seeking an Applied Scientist to build industry-leading technology with Large Language Models (LLMs) and multimodal systems.

Key Responsibilities

  • Collaborate with the core scientist team developing Amazon Nova models.
  • Lead the development of comprehensive quality strategies and auditing frameworks to safeguard data collection workflows.
  • Design auditing strategies with detailed SOPs, quality metrics, and sampling methodologies to improve Nova's performance on benchmarks.
  • Perform expert-level manual audits and conduct meta-audits to evaluate auditor performance.
  • Provide targeted coaching to uplift overall quality capabilities.
  • Develop and maintain LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment.
  • Set up configurations for data collection workflows.
  • Communicate quality feedback to stakeholders.
  • Enhance customer experiences through high-quality training and evaluation data powering LLM products and services.
  • Support quality solution design.
  • Conduct root cause analysis on data quality issues.
  • Research new auditing methodologies.
  • Optimize data quality and set examples for the team on quality assurance best practices and standards.
  • Work closely with engineers, domain experts, and vendor teams to implement quality strategies and automated judging systems.

Requirements & Tech Stack

  • Master's degree in computer science, mathematics, statistics, machine learning or equivalent quantitative field.
  • Experience programming in Java, C++, Python or related language.
  • Experience with SQL and an RDBMS (e.g., Oracle) or Data Warehouse.

Preferred Qualifications

  • Experience implementing algorithms using both toolkits and self-developed code.
  • Publications at top-tier peer-reviewed conferences or journals.

Entry-Level Jobs in the US · last 7 days

60 openings · 59 need no experience

Most hiring: FedEx Office, Warker LLC, UHS

See all 60 →

FirstHire never charges to apply, and real employers don't ask for money for tests, interviews or offer letters. How we list jobs · Report this job