Research Scientist Graduate, Speech)
ByteDance
About the Role
The mission of the Seed Speech team is to enrich interactive and creative processes through the application of multimodal speech technologies. The team focuses on the forefront of research and product development in speech and audio, music, natural language understanding, and multimodal deep learning. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth. Successful candidates must be able to commit to an onboarding date by the end of the year.
Key Responsibilities
- Develop and scale speech foundation models for understanding and generation tasks.
- Design training pipelines including data construction, instruction tuning, and model alignment.
- Improve core capabilities such as speech recognition, synthesis, reasoning, and robustness.
- Optimize model architectures, training efficiency, and system performance.
- Explore natural and interactive interfaces for speech-based systems.
Requirements & Tech Stack
- Individuals who are completing or have recently completed a PhD degree in Computer Science, Electrical Engineering, Electrical and Computer Engineering, Physics, Mathematics, or a related discipline.
- Excellent coding ability, data structures, and fundamental algorithm skills, proficient in C/C++ or Python.
- Experience in speech processing, audio modeling, or related areas.
- Familiarity with deep learning approaches for speech understanding and generation.
Preferred Qualifications
- Strong research track record in relevant areas.
- Strong problem-solving and collaboration skills.