Agent Evaluation & Evolution Machine Learning Engineer Graduate

ByteDance

Seattle, WAFresher4h agovia LinkedInH-1B sponsor · 122 entry-level filings

Posted 20 Nov 2026, 07:29 ET

This job at a glance

ByteDance is hiring for Agent Evaluation & Evolution Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start (on-site in Seattle). It is open to new grads, no experience needed. Degree asked for: Bachelor's degree or Master's degree. The posting asks for Data structures & algorithms, Deep learning and Python. 78% of the 99 similar entry-level jobs posted this week also ask for Python. Pay is not stated.

Who can apply
New grads, no experience needed · Bachelor's degree or Master's degree
Must know
Data structures & algorithmsDeep learningPython
Nice to have
Machine learningLLMsNLPStatistics
Work
On-site in Seattle
Pay
Not stated by the employer.
Skill demand
Python78%Machine learning67%Data structures & algorithms25%Deep learning20%of 99 similar entry-level jobs posted in the US this week
Listed
Nov 20, 2026 · still open

Sign in free to see which of these skills your resume already shows.

From the original posting on LinkedIn

About the Role

ByteDance's Applied Machine Learning Ark team develops and operates Large Language Model (LLM) service platforms offering Model-as-a-Service (MaaS) solutions. The US team focuses on the design, development, and operation of MaaS solutions for US and international markets outside mainland China. The role involves building full-stack, end-to-end solutions for text and multimodal LLM algorithms, LLM training/fine-tuning/inference frameworks, prompt engineering, model alignment, and intelligent agent systems. This includes operating large-scale log analytics pipelines for extracting insights from model invocations.

Key Responsibilities

  • Design evaluation systems for LLM-based agents, covering task success, tool use, reasoning quality, and reliability.
  • Build benchmarks and automated judging pipelines, incorporating rule-based checks, model-based judging, and human review.
  • Analyze agent execution traces and user feedback to identify failure patterns and drive system improvements.
  • Support the closed loop from experience to capability, collaborating with research, platform, and product teams to bring methods into production.

Requirements & Tech Stack

  • Solid foundation in machine learning and deep learning.
  • Hands-on experience with LLM-based systems (e.g., agents, tool calling, retrieval, multi-agent systems) through research, internships, or projects.
  • Strong Python skills.
  • Experience with a mainstream ML or agent evaluation framework.

Qualifications

  • Individuals completing or recently completed a Bachelor's/Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
  • Demonstrated research or engineering ability through publications, substantial projects, internships, or open-source work.

Preferred Qualifications

  • Publications at top-tier ML/NLP venues (e.g., NeurIPS, ICML, ICLR, ACL etc.), especially in agent learning, self-improving/self-evolving/RSI, or agent evaluation.
  • Experience with evaluation methodology: metric design, model-based judging, or annotation and statistical analysis.
  • Familiarity with LLM post-training, reasoning and planning methods, or continual learning.
  • Experience with feedback-driven optimization loops, or with large-scale log and trace analysis.

H-1B sponsor

ByteDance filed 122 entry-level H-1B applications for new hires (Oct 2025 - Jun 2026, Department of Labor).

See their H-1B record →

Entry-Level Jobs in Seattle · last 7 days

60 openings · 57 need no experience

Most hiring: Snowflake, Rocketdyne, Gravity Media

See all 60 →

FirstHire never charges to apply, and real employers don't ask for money for tests, interviews or offer letters. How we list jobs · Report this job