Prompt Engineer
CGI
Posted 21 Nov 2026, 10:15 IST
This job at a glance
CGI is hiring for Prompt Engineer (on-site in Hyderabad). It is open to freshers. The posting asks for LLMs, Statistics and Stakeholder management. 79% of the 99 similar fresher jobs posted this week also ask for LLMs. Pay is not stated.
- Who can apply
- Freshers
- Must know
- LLMsStatisticsStakeholder managementMachine learningProduct managementGit
- Nice to have
- REST APIsPythonSQLAWS
- Work
- On-site in Hyderabad
- Pay
- Not stated by the employer.
- Skill demand
- LLMs79%Machine learning33%Stakeholder management28%Statistics8%of 99 similar fresher jobs posted in India this week
- Listed
- 21 Nov 2026 · still open
Sign in free to see which of these skills your resume already shows.
From the original posting on LinkedIn
About the Role
The Prompt Engineer – Generative AI role is responsible for designing, developing, evaluating, and optimizing prompt-based solutions using Large Language Models (LLMs) and Generative AI. This role collaborates with product, engineering, data, and business teams to translate business problems into effective AI experiences and workflows, moving Generative AI use cases from experimentation to production.
Key Responsibilities
- Prompt Engineering & Optimization
- Design, develop, and optimize prompts for LLMs and Generative AI applications.
- Create reusable prompt templates and patterns for various business use cases.
- Apply techniques such as: Zero shot prompting, Few shot prompting, Structured prompting, Contextual prompting, Role/task based prompting, Tool/function oriented prompting.
- Systematically experiment with prompt structures, instructions, and context to improve output accuracy, consistency, relevance, and reliability.
- Reduce hallucinations and undesirable model behavior.
- Optimize prompts for quality, latency, and token/cost efficiency.
- Generative AI Solution Development
- Collaborate with AI and software engineers to build Generative AI solutions delivering business value.
- Translate business requirements into effective LLM-based interactions and workflows.
- Support use cases including: Enterprise knowledge assistants, Customer/service agent assistance, Document summarization and analysis, Information extraction, Classification, Content generation, Question answering, Workflow automation, Decision support applications.
- Facilitate the transition of Generative AI capabilities from experimentation to production-ready solutions.
- LLM Evaluation & Testing
- Develop systematic approaches for evaluating prompt and model performance.
- Define evaluation criteria covering: Accuracy, Relevance, Completeness, Consistency, Groundedness, Hallucination, Safety, Response quality.
- Build representative evaluation datasets and test scenarios.
- Conduct comparative testing across prompts, models, and configurations.
- Perform regression testing following prompt or model changes.
- Analyze failure patterns and identify improvement opportunities.
- Establish measurable acceptance criteria before promoting prompts to production.
- Retrieval Augmented Generation (RAG)
- Design prompts for RAG solutions in collaboration with engineering teams.
- Optimize the delivery of retrieved enterprise context to LLMs.
- Design system and user prompts for grounded responses based on approved information.
- Support optimization of retrieval and generation workflows.
- Evaluate response grounding in retrieved source material.
- Identify sources of poor results (retrieval, context, prompt design, model).
- Prompt Libraries & Reusable Patterns
- Develop and maintain a governed library of reusable prompt templates.
- Define standard patterns for common Generative AI use cases.
- Maintain prompt documentation and version history.
- Ensure prompt changes can be tested, reviewed, and traced.
- Promote reuse across AI solutions.
- Capture lessons learned and effective prompting practices.
- Responsible AI, Safety & Guardrails
- Ensure prompt-based solutions comply with security, privacy, governance, and responsible AI requirements.
- Design safeguards against: Prompt injection, Jailbreak attempts, Hallucination, Sensitive information disclosure, Harmful or inappropriate outputs, Unintended model behavior.
- Define system-level instructions and constraints for production AI applications.
- Collaborate with Security, Data, and AI Governance stakeholders to identify and mitigate risks.
- Support testing for bias, safety, privacy, and explainability.
- Ensure human oversight is incorporated where appropriate.
- Business Requirement Translation
- Understand problems that could benefit from Generative AI by working with business and product stakeholders.
- Translate business requirements into clear AI tasks and prompt strategies.
- Facilitate discovery and experimentation sessions with users.
- Understand user journeys and identify areas where AI can improve outcomes.
- Challenge use cases where Generative AI may not be appropriate.
- Convert user feedback into prompt and solution improvements.
- AI Experimentation
- Experiment with different LLMs and model configurations, comparing them based on: Output quality, Accuracy, Reasoning capability, Latency, Cost, Security, Context window requirements.
- Conduct controlled experiments to determine the most effective approach for each use case.
- Document findings and provide evidence-based recommendations.
- Stay current with developments in LLMs, Generative AI, and prompt engineering techniques.
- Production AI & Monitoring
- Integrate prompts into production applications and services with AI engineering teams.
- Ensure prompts are version-controlled and deployed through appropriate engineering processes.
- Define monitoring requirements for prompt/model performance.
- Analyze production feedback and failure patterns.
- Support continuous improvement of live Generative AI services.
- Identify prompt/model drift or degradation.
- Contribute to incident investigation where AI behavior affects production services.
- Collaboration with AI Engineering
- Work closely with AI/ML Engineers, Software Engineers, Data Engineers, Data Scientists, Product Managers/Product Owners, UX/Conversation Designers, Solution Architects, Security teams, Data Governance teams, and Business SMEs.
- Ensure prompt design is integrated into the overall engineering lifecycle.
- Documentation & Governance
- Document prompt purpose, design decisions, and expected behavior.
- Maintain prompt versions and associated evaluation results.
- Document known limitations and failure scenarios.
- Define appropriate usage guidance.
- Support governance reviews for production AI solutions.
- Ensure traceability between business requirements, prompt versions, testing, and production releases.
Requirements & Tech Stack
- Mandatory Skills & Experience:
- Hands-on experience with Large Language Models (LLMs).
- Hands-on experience with Generative AI.
- Experience in prompt engineering and prompt optimization.
- Experience with system/user prompt design.
- Experience with structured prompting and few-shot techniques.
- Experience in LLM evaluation and testing.
- Experience with hallucination and groundedness evaluation.
- Experience with responsible AI and AI safety.
- Experience working with LLM APIs / managed foundation model platforms.
- Understanding of RAG concepts and prompt design.
- Python or equivalent scripting capability.
- Experience with API-based AI integration.
- Experience with Git / source control practices.
- Demonstrated Skills:
- Strong analytical and problem-solving skills.
- Ability to design structured experiments and interpret results.
- Ability to translate business problems into AI use cases.
- Strong written communication and language skills.
- Understanding of data privacy and security.
- Experience collaborating with software and AI engineering teams.
- Strong attention to detail and quality.
- Desirable Technical Skills:
- Python
- SQL
- Azure OpenAI / AWS Bedrock or equivalent managed AI platforms.
- OpenAI compatible APIs.
- LangChain / LangGraph or equivalent orchestration frameworks.
- Vector databases.
- Embeddings and semantic search.
- RAG architectures.
- Agentic AI / tool calling.
- REST APIs.
- CI/CD.
- Docker / containers.
- Cloud native AI deployment.
- Prompt/model observability.
- Automated LLM evaluation frameworks.
Responsible AI Knowledge
Candidates should understand the risks associated with enterprise Generative AI, including:
- Hallucination
- Prompt injection
- Data leakage
- Bias
- Toxic or inappropriate output
- Privacy
- Explainability
- Model reliability
- Human oversight
Qualifications
To be successful in this role, candidates should combine:
- Prompt Engineering
- LLMs
- Evaluation
- RAG
- Python
- Responsible AI
- Production Engineering Awareness
- Ability to work closely with business stakeholders and translate real use cases into effective AI solutions.