AI/LLM Engineer (Associate)
3Wheels AI
Lucknow, Uttar Pradesh, India0–2 yrs1h agovia LinkedIn
This job at a glance
- Who can apply
- Freshers and up to 2 years
- Must know
- PythonLLMsVulnerability managementNLP
- Work
- On-site in Lucknow
- Pay
- Not stated by the employer.
- Skill demand
- LLMs84%Python73%NLP22%Vulnerability management2%of 99 similar fresher jobs posted in India this week
- Listed
- 2 Nov 2026 · still open
Sign in free to see which of these skills your resume already shows.
About the Role
3 Wheels AI is looking for an AI/LLM Engineer with strong Python programming skills and hands-on knowledge of LLM evaluation, benchmarking, RAG pipelines, and autonomous AI agents. The role focuses on testing and improving the performance, accuracy, and reliability of AI-powered systems.
Key Responsibilities
- Design benchmark datasets, test cases, and evaluation criteria for LLMs.
- Evaluate LLM outputs and analyze model performance.
- Test autonomous agents, tool-calling workflows, and identify execution failures.
- Evaluate RAG pipelines for retrieval accuracy and response quality.
- Implement automated evaluation techniques, including LLM-as-a-Judge.
- Identify hallucinations, inconsistencies, and potential security vulnerabilities.
- Prepare evaluation reports and document performance findings.
Requirements & Tech Stack
- Strong Python programming and problem-solving skills.
- Good understanding of LLMs, Generative AI, and NLP fundamentals.
- Knowledge of RAG, embeddings, and vector databases.
- Familiarity with AI agents, function calling, and tool-use workflows.
- Understanding of LLM benchmarking and evaluation frameworks such as RAGAS and DeepEval.
- Strong analytical and debugging skills.