Principal System Software Architect, AI/GPU Platforms
Advanced Micro Devices
Austin, TX · Posted June 9, 2026
Just laid off? Start here: a plan for the first weeks
Want recruiters in Data & Analytics to be able to find you?
Roles at this level, like this one at Advanced Micro Devices, are often filled through recruiters.
See every open role at Advanced Micro Devices
More in Texas job market · Technology & Software · Data & Analytics jobs
More roles at Advanced Micro Devices
- Director of Debug · Seattle, WA
- Memory PHY Principal Design Engineer · Santa Clara, CA
- Principal Distributed Systems Software Engineer, Collectives · San Jose, CA
- Principal Competitive CPU Performance Forecaster & Data Scientist
- Director, Product Planning-ASIC/SoC · San Jose, CA
- Principal FPGA Design Engineer · Santa Clara, CA
Similar jobs
- Principal Software Engineer Lead - High Energy Laser (HEL) Beam Director Product Owner · RTX · mckinney, TX
- Principal BIOS Embedded Software Engineer · Hewlett Packard Enterprise · Spring, TX
- Software Engineer, AI & Developer Experience (Principal - Advisor - Sr Advisor) · Halliburton · Houston, TX
- US Houston: Software Developer (Senior - Principal - Advisor) Landmark - 212035 · Halliburton · Houston, TX
- Director, Technical Lead Forward Deployed Engineer · KPMG · Austin, TX
- Principal Site Reliability Engineer - Oracle Health (US REMOTE) · Oracle · TX
Where Austin, TX ranks
Where Austin, TX placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Best cities for professional services pay after cost of living$168k · of 25
- #1Cities with the most jobs that do not need a four-year degree in the Southwest493 jobs · of 38
- #1Best cities for pay after cost of living in the Southwest$168k · of 15
- #1Best cities for pay after cost of living in Texas$168k · of 8
- #1Best cities for software and engineering jobs in the Southwest1,931 openings · of 33
- #1Best all-round cities for mid-career professionals in the Southwest92 / 100 · of 15
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,713 openings)
- Best cities for data and analytics pay after cost of living #1 Foster ($232k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (711 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
How AI is used in this kind of work
Among software developers, AI is already used for some of the tasks. Measured exposure for software developers: 29% (some).
Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.
Skills this job asks for
Say which you have and which you want to build. We use it to match you to jobs like this one.
About the job
WHAT YOU DO AT AMD CHANGES EVERYTHING
At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create something extraordinary. When you join AMD, you’ll discover the real differentiator is our culture. We push the limits of innovation to solve the world’s most important challenges—striving for execution excellence, while being direct, humble, collaborative, and inclusive of diverse perspectives. Join us as we shape the future of AI and beyond. Together, we advance your career.
THE ROLE
You will join the system software architecture team behind AMD Instinct™ accelerators, the GPUs powering some of the world's largest AI and HPC deployments. This role is focused on next-generation, rack-scale AI platforms in the MI400 class spanning the GPU, the node, and the scale-up/scale-out fabric that binds thousands of accelerators into a single training and inference system.
THE PERSON
As a Systems Software Architect, you sit at the intersection of silicon, firmware, driver, runtime, and framework. You define how the software stack exposes and orchestrates the hardware so that AMD's largest customers can extract maximum performance, reliability, and utilization from their infrastructure.
KEY RESPONSIBILITIES
Own the end-to-end system software architecture for one or more MI400-class subsystems for example GPU memory management, scheduling and queuing, RAS and serviceability, virtualization/partitioning (SR-IOV), or the scale-up/scale-out interconnect software model.
Drive architecture across the stack: kernel-mode driver (amdgpu/KFD), user-mode runtime (ROCr/HSA), firmware interfaces, and the ROCm software platform, ensuring the layers compose cleanly and perform.
Partner with silicon and SoC architects during pre-silicon definition to shape hardware/software interfaces, programming models, and register/firmware contracts before tape-out.
Define the software strategy for multi-GPU and rack-scale topologies, including Infinity Fabric / UALink-style interconnect, collective communication (RCCL), memory coherence, and address translation across the platform.
Establish architecture for reliability, availability, and serviceability at scale, error detection, containment, telemetry, recovery, and graceful degradation across large clusters.
Set direction on performance: identify bottlenecks in the launch path, memory subsystem, and communication path, and define the software mechanisms to close them.
Produce architecture specifications, reference designs, and design reviews that align firmware, driver, runtime, and framework teams onto a shared plan.
Act as a technical anchor across AMD and with strategic hyperscale and AI customers — translating their workload requirements into architectural direction and representing AMD in deep technical engagements.
PREFERRED EXPERIENCE
Linux Memory Management and Heterogeneous Memory Management (HMM).
GPU / DRM driver development.
Cache coherence and memory consistency protocols.
GPU Networking technologies including including scale up transport, NVLink, UALink, RDMA, and peer-direct.
Scale-up and scale-out networking, and communication collectives (e.g., RCCL/NCCL), MPI, or SHMEM.
Data-center fabrics such as Infinity Fabric, UALink, Ultra Ethernet, InfiniBand, and RoCE, with topology-aware software.
DESIRABLE EXPERIENCE
Direct experience with the ROCm stack, AMD Instinct, CUDA, or comparable GPU compute ecosystems.
Hands-on experience developing or optimizing GPU compute kernels (HIP, CUDA, Triton, or assembly-level tuning).
Experience with deep learning frameworks like PyTorch and TensorFlow in particular including framework integration, custom operators, and performance tuning on GPU backends.
Familiarity with the broader ML framework and compiler ecosystem (PyTorch, JAX, TensorFlow, ONNX, MLIR/compiler stacks).
Hands-on experience with GPU compute technologies such as OpenCL and Vulkan.
Familiarity with AI/ML training and inference workloads (transformers, large-scale distributed training, KV-cache and memory pressure, inference serving).
Background in virtualization, multi-tenancy, confidential computing, or cloud GPU provisioning.
Contributions to open-source kernel, driver, or runtime projects.
ACADEMIC CREDENTIALS:
Bachelor ’ s or Master ’ s in Electrical Engineer, Computer Engineering, Computer Science, or a closely related field
LOCATION:
Austin, TX
Santa Clara, CA
This role is not eligible for visa sponsorship.
#LI-BW2
Benefits offered are described: AMD benefits at a glance .
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
THE ROLE
You will join the system software architecture team behind AMD Instinct™ accelerators, the GPUs powering some of the world's largest AI and HPC deployments. This role is focused on next-generation, rack-scale AI platforms in the MI400 class spanning the GPU, the node, and the scale-up/scale-out fabric that binds thousands of accelerators into a single training and inference system.
THE PERSON
As a Systems Software Architect, you sit at the intersection of silicon, firmware, driver, runtime, and framework. You define how the software stack exposes and orchestrates the hardware so that AMD's largest customers can extract maximum performance, reliability, and utilization from their infrastructure.
KEY RESPONSIBILITIES
Own the end-to-end system software architecture for one or more MI400-class subsystems for example GPU memory management, scheduling and queuing, RAS and serviceability, virtualization/partitioning (SR-IOV), or the scale-up/scale-out interconnect software model.
Drive architecture across the stack: kernel-mode driver (amdgpu/KFD), user-mode runtime (ROCr/HSA), firmware interfaces, and the ROCm software platform, ensuring the layers compose cleanly and perform.
Partner with silicon and SoC architects during pre-silicon definition to shape hardware/software interfaces, programming models, and register/firmware contracts before tape-out.
Define the software strategy for multi-GPU and rack-scale topologies, including Infinity Fabric / UALink-style interconnect, collective communication (RCCL), memory coherence, and address translation across the platform.
Establish architecture for reliability, availability, and serviceability at scale, error detection, containment, telemetry, recovery, and graceful degradation across large clusters.
Set direction on performance: identify bottlenecks in the launch path, memory subsystem, and communication path, and define the software mechanisms to close them.
Produce architecture specifications, reference designs, and design reviews that align firmware, driver, runtime, and framework teams onto a shared plan.
Act as a technical anchor across AMD and with strategic hyperscale and AI customers — translating their workload requirements into architectural direction and representing AMD in deep technical engagements.
PREFERRED EXPERIENCE
Linux Memory Management and Heterogeneous Memory Management (HMM).
GPU / DRM driver development.
Cache coherence and memory consistency protocols.
GPU Networking technologies including including scale up transport, NVLink, UALink, RDMA, and peer-direct.
Scale-up and scale-out networking, and communication collectives (e.g., RCCL/NCCL), MPI, or SHMEM.
Data-center fabrics such as Infinity Fabric, UALink, Ultra Ethernet, InfiniBand, and RoCE, with topology-aware software.
DESIRABLE EXPERIENCE
Direct experience with the ROCm stack, AMD Instinct, CUDA, or comparable GPU compute ecosystems.
Hands-on experience developing or optimizing GPU compute kernels (HIP, CUDA, Triton, or assembly-level tuning).
Experience with deep learning frameworks like PyTorch and TensorFlow in particular including framework integration, custom operators, and performance tuning on GPU backends.
Familiarity with the broader ML framework and compiler ecosystem (PyTorch, JAX, TensorFlow, ONNX, MLIR/compiler stacks).
Hands-on experience with GPU compute technologies such as OpenCL and Vulkan.
Familiarity with AI/ML training and inference workloads (transformers, large-scale distributed training, KV-cache and memory pressure, inference serving).
Background in virtualization, multi-tenancy, confidential computing, or cloud GPU provisioning.
Contributions to open-source kernel, driver, or runtime projects.
ACADEMIC CREDENTIALS:
Bachelor ’ s or Master ’ s in Electrical Engineer, Computer Engineering, Computer Science, or a closely related field
LOCATION:
Austin, TX
Santa Clara, CA
This role is not eligible for visa sponsorship.
#LI-BW2
Benefits offered are described: AMD benefits at a glance .
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.