Data Engineer
Highbrow Technology Inc
Bengaluru, Karnataka, India2h agovia LinkedIn
About the Role
This role focuses on building and managing data solutions within the Azure AI ecosystem.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF), Azure Synapse Analytics, and Microsoft Fabric.
- Build and optimize enterprise data solutions leveraging Azure Data Lake, Cosmos DB, Azure SQL, and Synapse.
- Implement data ingestion, transformation, and integration processes for structured and unstructured data.
- Develop and support modern data platforms, data warehousing, and analytics solutions.
- Enable AI and GenAI use cases by supporting RAG (Retrieval-Augmented Generation), vector search, and Azure AI Search integrations.
- Collaborate with business, consulting, and engineering teams to deliver data-driven solutions and ensure data quality, security, and governance.
Requirements & Tech Stack
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Microsoft Fabric
- Azure Data Lake
- Cosmos DB
- Azure SQL / Synapse
- SQL
- Python
- ETL/ELT pipelines
- Data models
- Enterprise-scale data solutions
- Cloud-based data architectures
- Data governance
- Performance optimization
- AI and GenAI use cases
- RAG (Retrieval-Augmented Generation)
- Vector search
- Azure AI Search
Qualifications
- Bachelor’s degree in computer science, Information Technology, Engineering, or related field.
- Hands-on experience with mandatory skills: ADF, Synapse, Microsoft Fabric.
- Hands-on experience with Azure Data Lake, Cosmos DB, and Azure SQL/Synapse.
- Strong proficiency in SQL, Python, and data engineering concepts.
- Experience building ETL/ELT pipelines, data models, and enterprise-scale data solutions.
- Understanding of cloud-based data architectures, data governance, and performance optimization.
- Strong analytical, problem-solving, and communication skills.
- Preferred: Experience with Azure AI Search, vector databases, embeddings, and RAG-based AI solutions.
- Preferred: Knowledge of Spark, PySpark, and Fabric Lakehouse architectures.
- Preferred: Experience with DevOps, CI/CD pipelines, and Infrastructure as Code.
- Preferred: Microsoft Azure or Fabric certifications.
- Preferred: Experience working within Agile delivery and consulting environments.