AI Operations Engineer

About the Role

As an AI/ML/LLM Engineer for the Enterprise Data & AI Enablement team, you will focus on improving Cisco's operations by leveraging AI. This role involves developing and integrating advanced AI and large language models (LLMs) into enterprise systems to enhance data insights and customer experience.

Key Responsibilities

• Develop and fine-tune natural language processing (NLP) models for customer matching and deduplication.
• Build and optimize MLOps pipelines to streamline AI/ML workflows.
• Integrate large language models (LLMs) into enterprise systems.
• Contribute to technical decision-making for AI tools and frameworks.
• Stay current on emerging AI technologies and contribute to proof-of-concept projects.
• Work with large datasets, preprocessing data, and ensuring its quality and accuracy for model training.
• Deploy machine learning models into production environments and continuously monitor their performance.
• Keep up with the latest developments in AI and ML technologies, including new algorithms, frameworks, and best practices.

Requirements & Tech Stack

• Proficiency in LangChain/LangGraph or other Orchestration and agentic workflow tools.
• Hands-on experience with vector databases, building and fine-tuning RAG pipelines.
• Knowledge of hybrid search (semantic + keyword), reranking strategies, and "Context Window" management.
• Experience using Tavily or other tools in conjunction with LLMs for web research.
• Familiarity with Google Vertex AI or other providers like AWS, Azure.
• Knowledge in evaluating LLMs based on task complexity and upgrading to newer models without loss of performance.

Qualifications

• Bachelors + 6 years of related experience in AI/ML, OR
• Masters + 4 years of related experience in AI/ML, OR
• PhD + 0 years of related experience.

Preferred Qualifications:

• Implementing safety layers using guardrails to prevent hallucinations and PII leakage.
• Familiarity in building and deploying MCP Servers.
• Knowledge to connect to a deployed MCP server to orchestrate workflows.
• Experience in traditional NLP based techniques including text cleaning, text similarity, clustering.
• Knowledge of using LLM with Grounding.