Director of Infrastructure Engineering - AI
JPMorgan Chase
Listing collected from JPMorgan Chase's career site. NextChapter is independent of JPMorgan Chase.
New York, NY · Posted November 9, 2026
Will your résumé get you an interview here?
Drop your résumé and see in seconds how well it matches what JPMorgan Chase asks for. Free, no account needed.
Just laid off? Start here: a plan for the first weeks
See every open role at JPMorgan Chase
More in New York job market · Financial Services & Banking · Data & Analytics jobs
Similar jobs
- AI Product Specialist · Simulmedia · New York, NY
- AI Engineer · Patlytics · NY
- AI Engineer · Prospect Capital · New York, NY
- AI Product Engineer · Town · New York, NY
- AI Enablement Engineer · Socure · Hub, NY
- Senior AI Engineer · Socure · New York, NY
Where New York, NY ranks
Where New York, NY placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #1Cities hosting the most legal services conferences8 conferences · of 18
- #1Cities hosting the most advertising, marketing & pr conferences9 conferences · of 13
- #1Cities hosting the most data & analytics conferences8 conferences · of 16
- #1Cities with the most professional job openings21,263 openings · of 100
- #1Best cities for software and engineering jobs in the Northeast2,921 openings · of 51
- #1Best cities for software and engineering jobs in the Mid-Atlantic2,921 openings · of 68
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,904 openings)
- Best cities for data and analytics pay after cost of living #1 San Mateo ($184k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (606 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
How AI is used in this kind of work
Among computer and information research scientists, AI is already used for a large share of the tasks. Measured exposure for computer and information research scientists: 34% (high).
Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.
JPMorgan Chase has filed one layoff notice in the last twelve months, covering 244 workers, most recently June 2026. These are public filings with state labor departments, and an open role can sit alongside them. See the filings
Skills this job asks for
Say which you have and which you want to build. We use it to match you to jobs like this one.
About the job
At a world-renowned company like JPMorganChase, you can take the lead in shaping the future of technology, unleashing your full potential, and making your mark on the industry.
As a Director of Infrastructure Engineering at JPMorganChase within the Core Engineering Solutions and Architecture group, you manage one large area or multiple smaller ones with advanced technical knowledge to resolve complex issues. Exercise independent judgement within general guidelines and parameters to determine appropriate actions.
Job responsibilities
Manages technical area(s) within infrastructure engineering, collaborates with others across different technical areas and anticipates the needs of multiple disciplines within the function
Sets the multi-year strategy and roadmap for AI infrastructure across Consumer & Community Banking, aligned to business priorities and the firm's technology direction
Sets reuse-first expectations for enterprise-authorized AI adoption within the work environment across the function to accelerate delivery and improve decision quality, with human-in-the-loop validation and appropriate handling of sensitive data
Manages and implements corporate and divisional operational plans, develops and executes the function objectives, and provides broad direction to teams, team leads, and supervisors with accountability for outcomes, including building, leading, and growing a high-performing organization of engineers and engineering managers through hiring, coaching, performance management, and succession planning
Manages key senior stakeholders and ensures teams deliver in accordance with compliance standards, risk and security, service level agreements, and business requirements, including partnering with business and product leaders to translate AI use cases into infrastructure requirements prioritized against value and risk
Represents the business's needs to firm-wide technology and platform teams, shaping roadmaps, negotiating priorities and timelines, and escalating when commitments slip
Drives multiple large complex projects, processes and initiatives through to delivered outcomes — use cases in production, measurable cost savings, and improved reliability
Responsible for staffing, budget, and relevant profit and loss, including managing and developing budgets
Establishes governance standards for AI-assisted workflows used in delivery and operational routines, ensuring traceability/auditability and alignment to resiliency, security, and risk expectations
Required qualifications, capabilities, and skills
Formal training or certification on infrastructure engineering concepts and 10+ years applied experience
Experience managing cross-functional teams of infrastructure engineers, with a demonstrated track record of setting technical strategy and delivering it against measurable outcomes
Demonstrated experience leading teams in the safe use of enterprise-authorized AI capabilities within the work environment for infrastructure engineering workflows, including validation habits and awareness of data sensitivity
Ability to define review and approval expectations for AI-assisted recommendations and ensure outcomes align to resiliency, security, and auditability expectations
Experience hiring, developing, and recognizing talent, and creating a culture of ownership and engineering excellence
Extensive knowledge of hardware aligned to infrastructure engineering, including deep background in cloud infrastructure, platform, or site reliability engineering with hands-on depth on at least one major cloud provider (AWS: compute, networking, IAM, managed Kubernetes, observability)
Experience turning business needs into technical roadmaps and influencing central or shared technology teams not directly managed, with strong cross-team collaboration across engineering, product, security, risk, and finance
Excellent stakeholder management and executive communication, written and verbal, including presenting to senior leadership, together with budget and vendor management experience and comfort making investment and cost trade-off decisions
Experience running ML or GenAI workloads in production, such as hosted model APIs (Amazon Bedrock, Azure OpenAI, Google Vertex AI or similar) behind API gateways, with authentication, rate limiting, and resilience, as well as building AI skills, plugins, and agents
Experience with Kubernetes, including GPU scheduling and auto-scaling, infrastructure as code with Terraform (or equivalent), and CI/CD for infrastructure
Python and automation fluency to convert manual efforts into automated solutions, paired with observability expertise using tools such as Splunk, Datadog, Prometheus/Grafana, or OpenTelemetry
Preferred qualifications, capabilities, and skills
Experience with GPU compute – orchestration, scheduling, reclaim policies
Model serving and optimization: AI Gateways, vLLM, Triton, TensorRT, batching, quantization, latency and throughput
Distributed training: PyTorch FSDP, DeepSpeed, Megatron-LM; high-speed GPU interconnects (NVLink, InfiniBand)
RAG and vector databases (OpenSearch, pgvector, Pinecone or similar); agent frameworks (LangChain, LlamaIndex or similar)
GPU capacity planning and FinOps for AI workloads: cost allocation, chargeback, reserved capacity
Experience leading an LLM gateway, AI platform, or ML platform organization
Leadership experience in the financial services industry, including working with risk, compliance, and audit teams
Chase is a leading financial services firm, helping nearly half of America’s households and small businesses achieve their financial goals through a broad range of financial products. Our mission is to create engaged, lifelong relationships and put our customers at the heart of everything we do. We also help small businesses, nonprofits and cities grow, delivering solutions to solve all their financial needs.
We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
Equal Opportunity Employer/Disability/Veterans