← Search all jobs

Principal AI Back-End Network Systems Lead

Microsoft

Listing collected from Microsoft's career site. NextChapter is independent of Microsoft.

Mountain View, CA · $143k–$275k a year · Posted October 22, 2026

Will your résumé get you an interview here?

Drop your résumé and see in seconds how well it matches what Microsoft asks for. Free, no account needed.

Just laid off? Start here: a plan for the first weeks

See every open role at Microsoft

More in California job market · Technology & Software · Data & Analytics jobs

More roles at Microsoft

Similar jobs

Where Mountain View, CA ranks

Where Mountain View, CA placed in our monthly rankings, month by month. Each month stays online at its own address.

Microsoft has filed 2 layoff notices in the last twelve months, covering 882 workers, most recently September 2026. These are public filings with state labor departments, and an open role can sit alongside them. See the filings

Skills this job asks for

Say which you have and which you want to build. We use it to match you to jobs like this one.

  • Azure

About the job

Overview

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team behind Microsoft's expanding Cloud Infrastructure and is responsible for powering Microsoft's Intelligent Cloud mission. SCHIE delivers the core infrastructure and foundational technologies that support Microsoft Azure and other online services globally. Our focus is on smart growth, high efficiency, reliability, and a trusted experience for customers and partners worldwide.

The Platform Systems Engineering (PSE) team is seeking a Principal AI Back-End Network Systems Lead to serve as the technical lead and end-to-end product development owner for Back End Network across both scale-up and scale-out. The role will lead the product from requirements and architecture through design, integration, validation, manufacturing readiness, deployment, and fleet learning - spanning silicon, network adapters, switches, interconnects, optics/electrical channels, and the fabric as a complete system.

The successful candidate will bring deep expertise in one or more AI/ML scale-up or scale-out networking domains and the product-level thinking to connect decisions across the full system. This lead will work from physical and data-link technologies through network and transport behavior to collectives, workloads, modeling, observability, and datacenter deployment, creating clarity across architecture, execution, quality, performance, reliability, power, cost, and schedule.

#azure #MAIA #AI/ML #Networking #ScaleUp #ScaleOut

Responsibilities

End-to-End Product Ownership & Architecture

Own the Back End Network product definition and execution plan across scale-up and scale-out, from customer/workload needs and product requirements through architecture, development, qualification, deployment, and fleet learning.

Translate AI training and inference requirements into measurable system targets for bandwidth, latency, scale, collective efficiency, reliability, availability, serviceability, power, thermal behavior, cost, security, and schedule.

Make and drive cross-system architecture decisions, interface contracts, feature priorities, and risk tradeoffs; maintain clear ownership, milestones, entry/exit criteria, and product readiness metrics.

Lead NUDD (new, unique, different, and difficult) technology assessments, prototypes, make/buy/partner decisions, and mitigation plans for the highest product risks.

Scale-Up/Scale-Out Systems, Silicon, Switch & Fabric

Lead architecture and integration across accelerator and networking silicon, NICs/DPUs, PHYs/retimers, switch ASICs, switches, cables/backplanes, optics, and fabric topology.

Define scalable scale-up and scale-out architectures, including topology, radix, reach, link speeds, routing, path diversity, oversubscription, failure domains, and resiliency.

Drive silicon, board, switch, firmware, network operating system, and fabric requirements so that components operate as one high-performance and serviceable product.

Partner with silicon, switch, optical, cable, connector, system, manufacturing, and supplier teams to deliver designs from concept through production and datacenter integration.

Optical/Electrical & Cross-Layer Integration

Oversee electrical and optical technologies for high-speed links, including signal integrity, SerDes/PHY, link training, FEC, reach, power, thermal, mechanical, manufacturability, and interoperability tradeoffs.

Drive end-to-end behavior across the relevant OSI layers - physical, data link, network, and transport - and the system/runtime interfaces above them.

Define and validate Ethernet/RDMA or other scale-up/scale-out protocol behavior, including flow control, congestion control, QoS, routing, packet loss/recovery, telemetry, and security.

Ensure hardware, firmware, drivers, network operating systems, management software, orchestration, and datacenter operations are aligned to common specifications and concepts of operation.

Collectives, Workloads, Modeling & Performance

Connect network architecture to distributed AI workloads, parallelism strategies, traffic patterns, and collective operations such as all-reduce, all-gather, reduce-scatter, and all-to-all.

Establish analytical and simulation models for topology, bandwidth, latency, congestion, failure behavior, collective efficiency, workload scaling, power, and cost.

Use models, emulation, prototypes, and lab/fleet data to predict bottlenecks, guide design choices, set performance budgets, and validate architectural assumptions.

Partner with workload, collective-communication, compiler/runtime, and application teams to co-optimize the network and improve job completion time and cluster efficiency.

Validation, Reliability, Deployment & Operations

Own the end-to-end validation strategy covering functionality, interoperability, performance, scale, stress, resiliency, reliability, security, serviceability, and upgrade/recovery behavior.

Lead bring-up and root-cause analysis across silicon, electrical/optical links, switch, fabric, protocol, system software, collective, and workload layers using telemetry, packet captures, counters, diagnostics, and lab characterization.

Define production qualification, manufacturing test, deployment, monitoring, rollback, and fleet-health requirements; use operational learning to drive corrective actions and next-generation improvements.

Drive product readiness reviews and ensure the solution can be safely and repeatably deployed, operated, serviced, and scaled in hyperscale datacenters.

Technical Leadership & Ecosystem Execution

Create clarity and technical alignment across architecture, silicon, hardware, optics, firmware, networking, software, validation, manufacturing, datacenter, and workload teams.

Influence internal roadmaps and external partners, including silicon, switch, optical, interconnect, ODM/OEM, and open-source ecosystems; resolve cross-team gaps and ambiguous ownership.

Communicate product status, architectural decisions, risks, tradeoffs, and executive asks clearly while mentoring engineers and raising the quality of end-to-end systems engineering.

Qualifications

Required Qualifications

Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience

OR equivalent experience

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements in