Site Reliability Engineer 2

About the Role

The Topology Scaling team is responsible for deploying new capacity, new designs, establishing network connectivity for new Oracle Cloud Infrastructure (OCI) regions, and enabling compute connectivity for child sites. This includes building and managing data center fabrics, edge networks, backbone, fiber metro networks, and supporting multi-cloud initiatives. As a Site Reliability Engineer, you will apply software engineering, systems engineering, and networking practices to improve the reliability, availability, performance, and scalability of OCI’s global cloud network. You will develop automation, strengthen observability, and reduce operational toil across infrastructure connecting network devices and millions of servers worldwide. You will own reliability throughout the infrastructure lifecycle—from architecture and deployment through production operations, upgrades, and incident response. Working with network engineering, software development, and program management teams, you will build repeatable deployment processes, improve operational readiness, and deliver resilient infrastructure at scale.

Key Responsibilities

• Design, deploy, and operate highly available global network infrastructure, incorporating resilience, fault isolation, and recovery into architecture and implementation.
• Define and monitor service-level indicators and objectives (SLIs/SLOs), using reliability metrics to prioritize improvements and guide operational decisions.
• Develop automation and tooling for provisioning, configuration management, validation, upgrades, and recovery to reduce manual work and deployment risk.
• Build monitoring, telemetry, and actionable alerting to detect service degradation and accelerate diagnosis and recovery.
• Participate in on-call rotations, lead incident response, and serve as an escalation point for complex infrastructure and connectivity issues.
• Lead blameless post-incident reviews, identify contributing factors, and drive corrective actions that prevent recurrence.
• Improve change safety through automated prechecks, staged rollouts, post-change validation, and tested rollback procedures.
• Plan capacity and evaluate performance to support growth, regional expansion, and changing workload requirements.
• Create and maintain runbooks, operational procedures, and troubleshooting guides that improve response consistency and reduce recovery time.
• Serve as a technical lead for reliability initiatives, contribute to engineering roadmaps, and mentor junior engineers.
• Partner with automation teams and vendors to resolve software defects, qualify firmware and operating system releases, and influence product improvements.

Critical Focus Areas

• Service availability, network resilience, and recovery from infrastructure failures.
• Automation of repetitive operational tasks and reduction of operational toil.
• Observability, actionable alerting, and rapid incident diagnosis.
• Troubleshooting across physical and logical network layers, including cabling, trunks, optics, routing, and connectivity.
• Root cause analysis and measurable, lasting reliability improvements.

Requirements & Tech Stack

• Experience operating production infrastructure in a large cloud provider, ISP, or similarly distributed environment.
• Strong troubleshooting skills across networking, Linux systems, and distributed infrastructure.
• Proficiency in Python or another programming language used to develop operational tooling and automation.
• Understanding of site reliability engineering practices, including SLIs/SLOs, error budgets, incident management, and blameless post-incident reviews.
• Hands-on experience with routing and networking technologies, including BGP, OSPF, IS-IS, TCP/IP, IPv4/IPv6, DNS, DHCP, and MPLS.
• Experience with data center network design, internet peering, inter-domain connectivity, and VPN/SSL technologies.
• Experience with configuration management, automation frameworks, APIs, and network models such as YANG, OpenConfig, and NETCONF.
• Experience using telemetry, monitoring, logging, and performance testing to assess service health and troubleshoot production issues.
• Understanding of network security principles and safe production change practices.
• Strong communication and collaboration skills, with the ability to lead incident response, explain technical tradeoffs, and influence engineering priorities.

Qualifications

• Contributes to the design and architecture of infrastructure and/or service according to terms for reliability and functionality.
• Responds to infrastructure demands and capacity needs.
• Collaborates with the software development team to develop infrastructures in alignment with deployment requirements.
• Identifies opportunities for prototyping and participates in prototyping initiatives.
• Contributes to data collection, triage, technical analysis, and redirection to maintain and optimize operations and infrastructure reliability.
• Monitors services, maintains up-to-date knowledge of their performance, and documents their condition.
• Performs routine incident response and/or maintenance tasks on assigned services and gathers information for root cause analyses.
• Contributes to health and performance reporting and actions taken based on trends in data.
• May perform provisioning to support infrastructure, applications, and services.
• May perform decommissioning (e.g., shutting down servers, removing data from databases).
• Contributes to identifying opportunities for automation and assessing potential benefits.
• Contributes to the development of automation or scripts that provide solutions, gather metrics, monitor, analyze, mitigate, or remediate issues/defects within infrastructures.
• Conducts testing to ensure automation performs tasks correctly and produces expected results, and makes necessary revisions.
• Communicates relevant details regarding the scale, capacity, security, and performance attributes of services and technology within the immediate team.
• Identifies and communicates infrastructure, feature, and tool changes within the immediate team.
• Provides operational support for technology, escalating incidents and other routine issues arising within Oracle services.
• Participates in on-call shifts to address issues.
• Contributes to the resolution of technical issues for a service, investigating and debugging products in order to reach SLOs.
• Documents incidents and performs root cause analyses according to standard reporting methods.
• Contributes to post-mortem procedures to prevent incident reoccurrence.
• Experiments with new tools and technologies to improve infrastructure performance, reliability, and adherence to security standards.
• Identifies and/or executes improvements for performance bottlenecks and deployments, striving for efficient resource utilization, speed, and scalability.
• Develops working knowledge of site reliability trends and shares new insights and information with immediate team members.
• Performs analyses and provides clear data on production to support business development decisions (e.g., design changes).
• Tracks timelines, ensuring work is completed in a timely manner and is in alignment with project requirements.
• Prioritizes and adjusts work as resources or timelines change.
• Collaborates within a team to better understand expectations and achieve shared objectives.
• Leverages a foundational understanding of business, stakeholder, and/or customer needs to build partnerships.
• Actively listens and asks questions to enhance collaboration.
• Identifies and addresses issues, escalating problems to senior staff as needed.
• Compiles and reviews data and/or information from multiple sources to troubleshoot standard and non-standard errors.
• Seeks opportunities to gain knowledge and learn new skills and/or tools aligned with industry trends and best practices.
• Utilizes feedback and training to improve skills.
• Participates in a culture of continuous learning and knowledge sharing.
• Implements updates to processes, protocols, and workflows to increase efficiency and effectiveness as directed.
• Contributes to ideation for future process improvements.