Visual Generation & Multimodal Evaluation Machine Learning Engineer Graduate
ByteDance
About the Role
The Applied Machine Learning Ark team develops and operates Large Language Model (LLM) service platforms, offering Model-as-a-Service (MaaS) solutions. The US team focuses on the design, development, and operation of MaaS solutions for US and international markets outside mainland China. The team builds full-stack, end-to-end solutions for text and multimodal LLM algorithms, LLM training/fine-tuning/inference frameworks, prompt engineering, model alignment, and intelligent agent systems. The team also operates large-scale log analytics pipelines to process invocation logs from text models, multimodal models, and agent systems.
Key Responsibilities
- Build evaluation systems for image and video models/agents, covering generation quality, instruction following, multimodal understanding, and safety.
- Develop automated metrics and model-based evaluators, and design reproducible human evaluation protocols.
- Design and develop video generation/debugging agents that orchestrate multi-step creative workflows.
- Build large-scale image and video data pipelines, and turn evaluation findings into model and product improvements.
Requirements & Tech Stack
- Solid foundation in deep learning and computer vision, including generative modeling fundamentals.
- Practical experience in at least one of: visual generation, multimodal LLMs, video understanding, or visual quality assessment.
- Strong Python skills and proficiency with PyTorch or an equivalent framework, or multimodal evaluation framework.
- Demonstrated research or engineering ability through publications, substantial projects, internships, or open-source work.
Qualifications
- Individuals who are completing or have recently completed a Bachelor's/ Master's degree in Computer Science, Artificial Intelligence, Machine Learning, Computer Vision, or a related field.
- Successful candidates must be able to commit to an onboarding date by the end of the year. Please state your availability and graduation date clearly in your resume.
Preferred Qualifications
- Publications at top-tier vision or ML venues, e.g., NeurIPS, ICML, CVPR, ICCV, ECCV, etc.
- Hands-on experience with modern visual generation stacks, including diffusion-based models and their post-training.
- Familiarity with visual generation benchmarks, or experience building evaluation frameworks.
- Experience applying agent frameworks to creative workflows, or working with large-scale video data infrastructure.