GEN AI
Qloron Pvt Ltd
Pune Division, Maharashtra, India1h agovia LinkedIn
About the Role
We are seeking a highly skilled AI Engineer with expertise in High-Performance Computing (HPC), Apache Spark, Databricks, and Generative AI technologies. The ideal candidate will design, develop, and deploy scalable AI/ML solutions, optimize large-scale data processing pipelines, and build innovative GenAI applications leveraging Large Language Models (LLMs).
Key Responsibilities
- Design and develop AI/ML solutions for large-scale enterprise applications.
- Build and optimize distributed data processing pipelines using Apache Spark and Databricks.
- Develop and deploy Generative AI applications using LLMs such as GPT, Llama, Claude, and Mistral.
- Implement Retrieval-Augmented Generation (RAG) frameworks and vector databases.
- Utilize High-Performance Computing (HPC) environments to accelerate AI model training and inference.
- Fine-tune foundation models and optimize model performance for production workloads.
- Develop scalable data engineering and MLOps pipelines.
- Collaborate with Data Scientists, Data Engineers, and Business Stakeholders to deliver AI-driven solutions.
- Monitor, troubleshoot, and optimize AI applications in production environments.
Requirements & Tech Stack
AI & Generative AI
- Generative AI, Large Language Models (LLMs)
- Prompt Engineering
- RAG (Retrieval-Augmented Generation)
- LangChain, LlamaIndex
- Fine-tuning and Model Evaluation
- AI Agents and Multi-Agent Systems
Data Engineering & Big Data
- Apache Spark (PySpark)
- Databricks
- Delta Lake
- Data Modeling and ETL/ELT Pipelines
- SQL and NoSQL Databases
Programming
- Python
- SQL
- REST APIs
High-Performance Computing
- HPC Clusters
- Distributed Computing
- Parallel Processing
- GPU Computing (NVIDIA CUDA preferred)
Cloud & MLOps
- Azure / AWS / GCP
- MLflow
- Docker
- Kubernetes
- CI/CD Pipelines
- Git