Principal AI Back-End Network Systems Lead
Microsoft
Listing collected from Microsoft's career site. NextChapter is independent of Microsoft.
Mountain View, CA · $143k–$275k a year · Posted October 22, 2026
Will your résumé get you an interview here?
Drop your résumé and see in seconds how well it matches what Microsoft asks for. Free, no account needed.
Just laid off? Start here: a plan for the first weeks
See every open role at Microsoft
More in California job market · Technology & Software · Data & Analytics jobs
More roles at Microsoft
- Principal Silicon Security Architect · Mountain View, CA
- Principal Group Product Manager · Austin, TX
- Principal + Senior Product Manager- Agentic Security · Redmond, WA
- Principal Quantum Systems Architect · Redmond, WA
- Principal Security Engineer · Santa Clara, CA
- Principal Quantum Design Verification Engineer · Redmond, WA
Similar jobs
- Principal Enterprise AI Architect · Supermicro · San Jose, CA
- Principal Analog Layout Methodology Engineer – AI & Automation - 19299 · Synopsys · Sunnyvale, CA
- Senior Principal, HW Design Engineering (AI/ ML Architect ) · Celestica · San Jose, CA
- Principal Design Verification Engineer (AI Fabric Switches) · Astera Labs · San Jose, CA
- Data Analyst - Health, Principal - HEDIS · Blue Shield of California · Oakland, CA
- Principal Machine Learning Engineer - Matchmaking · Roblox · San Mateo, CA
Where Mountain View, CA ranks
Where Mountain View, CA placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Best cities for AI-skill jobs42% · of 100
- #1Best cities for AI-skill jobs in the West Coast42% · of 67
- #2Best cities for finance pay after cost of living$164k · of 38
- #2Best all-round cities for AI careers95 / 100 · of 100
- #2Best all-round cities for AI careers in the West Coast92 / 100 · of 35
- #2Best cities for entry-level jobs that want AI skills in the West Coast28% · of 56
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,904 openings)
- Best cities for data and analytics pay after cost of living #1 San Mateo ($184k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (606 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
Microsoft has filed 2 layoff notices in the last twelve months, covering 882 workers, most recently September 2026. These are public filings with state labor departments, and an open role can sit alongside them. See the filings
Skills this job asks for
Say which you have and which you want to build. We use it to match you to jobs like this one.
About the job
Overview
Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) is the team behind Microsoft's expanding Cloud Infrastructure and is responsible for powering Microsoft's Intelligent Cloud mission. SCHIE delivers the core infrastructure and foundational technologies that support Microsoft Azure and other online services globally. Our focus is on smart growth, high efficiency, reliability, and a trusted experience for customers and partners worldwide.
The Platform Systems Engineering (PSE) team is seeking a Principal AI Back-End Network Systems Lead to serve as the technical lead and end-to-end product development owner for Back End Network across both scale-up and scale-out. The role will lead the product from requirements and architecture through design, integration, validation, manufacturing readiness, deployment, and fleet learning - spanning silicon, network adapters, switches, interconnects, optics/electrical channels, and the fabric as a complete system.
The successful candidate will bring deep expertise in one or more AI/ML scale-up or scale-out networking domains and the product-level thinking to connect decisions across the full system. This lead will work from physical and data-link technologies through network and transport behavior to collectives, workloads, modeling, observability, and datacenter deployment, creating clarity across architecture, execution, quality, performance, reliability, power, cost, and schedule.
#azure #MAIA #AI/ML #Networking #ScaleUp #ScaleOut
Responsibilities
End-to-End Product Ownership & Architecture
Own the Back End Network product definition and execution plan across scale-up and scale-out, from customer/workload needs and product requirements through architecture, development, qualification, deployment, and fleet learning.
Translate AI training and inference requirements into measurable system targets for bandwidth, latency, scale, collective efficiency, reliability, availability, serviceability, power, thermal behavior, cost, security, and schedule.
Make and drive cross-system architecture decisions, interface contracts, feature priorities, and risk tradeoffs; maintain clear ownership, milestones, entry/exit criteria, and product readiness metrics.
Lead NUDD (new, unique, different, and difficult) technology assessments, prototypes, make/buy/partner decisions, and mitigation plans for the highest product risks.
Scale-Up/Scale-Out Systems, Silicon, Switch & Fabric
Lead architecture and integration across accelerator and networking silicon, NICs/DPUs, PHYs/retimers, switch ASICs, switches, cables/backplanes, optics, and fabric topology.
Define scalable scale-up and scale-out architectures, including topology, radix, reach, link speeds, routing, path diversity, oversubscription, failure domains, and resiliency.
Drive silicon, board, switch, firmware, network operating system, and fabric requirements so that components operate as one high-performance and serviceable product.
Partner with silicon, switch, optical, cable, connector, system, manufacturing, and supplier teams to deliver designs from concept through production and datacenter integration.
Optical/Electrical & Cross-Layer Integration
Oversee electrical and optical technologies for high-speed links, including signal integrity, SerDes/PHY, link training, FEC, reach, power, thermal, mechanical, manufacturability, and interoperability tradeoffs.
Drive end-to-end behavior across the relevant OSI layers - physical, data link, network, and transport - and the system/runtime interfaces above them.
Define and validate Ethernet/RDMA or other scale-up/scale-out protocol behavior, including flow control, congestion control, QoS, routing, packet loss/recovery, telemetry, and security.
Ensure hardware, firmware, drivers, network operating systems, management software, orchestration, and datacenter operations are aligned to common specifications and concepts of operation.
Collectives, Workloads, Modeling & Performance
Connect network architecture to distributed AI workloads, parallelism strategies, traffic patterns, and collective operations such as all-reduce, all-gather, reduce-scatter, and all-to-all.
Establish analytical and simulation models for topology, bandwidth, latency, congestion, failure behavior, collective efficiency, workload scaling, power, and cost.
Use models, emulation, prototypes, and lab/fleet data to predict bottlenecks, guide design choices, set performance budgets, and validate architectural assumptions.
Partner with workload, collective-communication, compiler/runtime, and application teams to co-optimize the network and improve job completion time and cluster efficiency.
Validation, Reliability, Deployment & Operations
Own the end-to-end validation strategy covering functionality, interoperability, performance, scale, stress, resiliency, reliability, security, serviceability, and upgrade/recovery behavior.
Lead bring-up and root-cause analysis across silicon, electrical/optical links, switch, fabric, protocol, system software, collective, and workload layers using telemetry, packet captures, counters, diagnostics, and lab characterization.
Define production qualification, manufacturing test, deployment, monitoring, rollback, and fleet-health requirements; use operational learning to drive corrective actions and next-generation improvements.
Drive product readiness reviews and ensure the solution can be safely and repeatably deployed, operated, serviced, and scaled in hyperscale datacenters.
Technical Leadership & Ecosystem Execution
Create clarity and technical alignment across architecture, silicon, hardware, optics, firmware, networking, software, validation, manufacturing, datacenter, and workload teams.
Influence internal roadmaps and external partners, including silicon, switch, optical, interconnect, ODM/OEM, and open-source ecosystems; resolve cross-team gaps and ambiguous ownership.
Communicate product status, architectural decisions, risks, tradeoffs, and executive asks clearly while mentoring engineers and raising the quality of end-to-end systems engineering.
Qualifications
Required Qualifications
Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience
OR equivalent experience
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements in