Agent Evaluation & Evolution Machine Learning Engineer Graduate
ByteDance
Posted 20 Nov 2026, 07:29 ET
This job at a glance
ByteDance is hiring for Agent Evaluation & Evolution Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start (on-site in Seattle). It is open to new grads, no experience needed. Degree asked for: Bachelor's degree or Master's degree. The posting asks for Data structures & algorithms, Deep learning and Python. 78% of the 99 similar entry-level jobs posted this week also ask for Python. Pay is not stated.
- Who can apply
- New grads, no experience needed · Bachelor's degree or Master's degree
- Must know
- Data structures & algorithmsDeep learningPython
- Nice to have
- Machine learningLLMsNLPStatistics
- Work
- On-site in Seattle
- Pay
- Not stated by the employer.
- Skill demand
- Python78%Machine learning67%Data structures & algorithms25%Deep learning20%of 99 similar entry-level jobs posted in the US this week
- Listed
- Nov 20, 2026 · still open
Sign in free to see which of these skills your resume already shows.
From the original posting on LinkedIn
About the Role
ByteDance's Applied Machine Learning Ark team develops and operates Large Language Model (LLM) service platforms offering Model-as-a-Service (MaaS) solutions. The US team focuses on the design, development, and operation of MaaS solutions for US and international markets outside mainland China. The role involves building full-stack, end-to-end solutions for text and multimodal LLM algorithms, LLM training/fine-tuning/inference frameworks, prompt engineering, model alignment, and intelligent agent systems. This includes operating large-scale log analytics pipelines for extracting insights from model invocations.
Key Responsibilities
- Design evaluation systems for LLM-based agents, covering task success, tool use, reasoning quality, and reliability.
- Build benchmarks and automated judging pipelines, incorporating rule-based checks, model-based judging, and human review.
- Analyze agent execution traces and user feedback to identify failure patterns and drive system improvements.
- Support the closed loop from experience to capability, collaborating with research, platform, and product teams to bring methods into production.
Requirements & Tech Stack
- Solid foundation in machine learning and deep learning.
- Hands-on experience with LLM-based systems (e.g., agents, tool calling, retrieval, multi-agent systems) through research, internships, or projects.
- Strong Python skills.
- Experience with a mainstream ML or agent evaluation framework.
Qualifications
- Individuals completing or recently completed a Bachelor's/Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related field.
- Demonstrated research or engineering ability through publications, substantial projects, internships, or open-source work.
Preferred Qualifications
- Publications at top-tier ML/NLP venues (e.g., NeurIPS, ICML, ICLR, ACL etc.), especially in agent learning, self-improving/self-evolving/RSI, or agent evaluation.
- Experience with evaluation methodology: metric design, model-based judging, or annotation and statistical analysis.
- Familiarity with LLM post-training, reasoning and planning methods, or continual learning.
- Experience with feedback-driven optimization loops, or with large-scale log and trace analysis.