Associate Life Sciences Analyst, AI Model Training

About the Role

As an Associate Life Sciences Analyst for Model Training at Norstella, you will be embedded within a group of life science model trainers, interfacing with cross-functional teams of data scientists, operations engineers, and data engineers. Your work will focus on the preference and judgment layer of model development.

Key Responsibilities

• Evaluate model outputs across clinical and life sciences tasks by rating individual responses and rewriting outputs to demonstrate the preferred response.
• Assist in maintaining evaluation rubrics, preference dimensions, and quality criteria (e.g., factual accuracy, clinical reasoning quality) that govern model outputs and preference alignment.
• Advise and assist with interpretation of model behavior, bridging desired behavior back to the dataflow inflection point, and working with relevant teams to adjust as needed.
• Partner with data scientists and MLEs to walk feedback into data collection pipelines.
• Conduct red-team and adversarial evaluation of models, surfacing subtle failure modes (hallucinations, citation errors, unsupported clinical claims, regulatory missteps) that automated metrics cannot reliably catch.
• Contribute to Norstella’s knowledge graph and taxonomy work and help design new agentic workflows based on domain-grounded language models.

Requirements & Tech Stack

• Bachelor’s degree in life sciences, medical sciences, computer science or equivalent professional experience. An imminent degree combined with demonstrated project experience will be considered.
• Experience working with structured platforms and data tools.
• Comfort with automation concepts.
• Experience working with large and complex data sets, including data cleaning or preprocessing.
• Excellent problem-solving skills and the ability to work independently.
• Excellent communication skills, especially between technical and non-technical teams.

Bonus Points If You Have Experience In

• Production-grade life science datasets, including with AI-enabled applications.
• Experience working with Generative AI, especially LLMs, including agents, throughout the software development lifecycle (SDLC).
• Experience working with MCPs and consuming them into Agentic workflows.
• Experience in fast-paced, novel product development.

All candidates must be authorized to work in the United States. Norstella does not provide visa sponsorship or transfers and is not currently accepting candidates who are on an OPT visa.