Lead Data Engineer - Google Cloud & Azure Databricks (Kansas City)
Burns & McDonnell
Kansas City, MO · Posted October 26, 2026
Just laid off? Start here: a plan for the first weeks
See every open role at Burns & McDonnell
More in Missouri job market · All Lead Data Engineer jobs (62) · Manufacturing & Industrial · Data & Analytics jobs
More roles at Burns & McDonnell
- Environmental Services Technology & Innovation Manager (Kansas City) · Kansas City, MO
- Staff Acquisition Specialist - Land Services - (Tucson/Phoenix, AZ) · Tucson, AZ
- Construction Quality Manager - Food & Beverage · Kansas City, MO
- Staff Civil Engineer - Transportation (Austin)
- Senior Solution Architect – Geospatial – 1898 & Co. · Kansas City, MO
- Senior Underground Engineer (Northeast Region)
Similar jobs
- Sr. Data Enterprise Engineer · BJC HealthCare · Saint Louis, MO
- Senior Data Engineer · Gravie
- Senior Data Engineer - Snowflake · First Citizens Bank · Raleigh, NC
- Data Engineer · CACI · Oklahoma City, OK
- Infrastructure Solutions Architect - End-User Computing · SMBC Americas · Charlotte, NC
- Senior Data Engineer · Metriport · San Francisco, CA
Where Kansas City, MO ranks
Where Kansas City, MO placed in our monthly rankings, month by month. Each month stays online at its own address.
November 2026
- #4Best all-round cities for new graduates in the Midwest56 / 100 · of 18
- #5Best all-round cities for remote workers in the Midwest64 / 100 · of 18
- #5Cities hosting the most government & public sector conferences5 conferences · of 27
- #6Best cities for pay after cost of living in the Midwest$122k · of 18
- #6Best all-round cities for mid-career professionals in the Midwest62 / 100 · of 18
- #6Cities hosting the most business conferences in the Midwest12 conferences · of 14
Rankings about data & analytics jobs
- Best cities for data and analytics jobs #1 New York (1,883 openings)
- Best cities for data and analytics pay after cost of living #1 San Mateo ($233k)
- Most requested AI skills in data and analytics jobs #1 Machine learning engineering (17.1%)
- AI tools named most often in data and analytics jobs #1 Databricks (7.6%)
- Employers with the most data and analytics jobs #1 Amazon (606 roles)
Data & Analytics jobs · Top Data & Analytics employers · All rankings
How AI is used in this kind of work
Among database architects, AI is already used for a large share of the tasks. Measured exposure for database architects: 58% (high).
Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.
Skills this job asks for
Say which you have and which you want to build. We use it to match you to jobs like this one.
About the job
Overview\:
We're looking for a senior engineer who combines an architecture mindset with deep hands-on experience — someone who can design scalable systems and personally build and ship them into production. As our lead data engineer, you will own pipelines end-to-end across Google Cloud and Azure Databricks, from whiteboard to running code, while setting the technical direction for our enterprise data products, mentoring the team, and serving as the bridge between business stakeholders and engineering to turn strategic goals into robust, secure data solutions.
Responsibilities\:
Architect, build, and ship scalable batch and streaming data pipelines into production using BigQuery Dataform, Google Cloud Dataflow, Confluent Kafka, and Pub/Sub.
Design and build data pipelines on Azure Databricks using Apache Spark, Delta Lake, and Unity Catalog, keeping engineering patterns consistent with our Google Cloud platform.
Manage the end-to-end data product lifecycle, serving as the technical owner for critical data assets and establishing clear service level objectives.
Provide technical leadership and mentorship to junior and senior engineers, conducting code reviews and fostering a culture of technical excellence.
Lead the engineering team across Google Cloud and Azure Databricks environments, setting multi-cloud architecture standards for data movement, interoperability, security, and cost management.
Partner with product managers, business analysts, and leadership to define data product requirements, align roadmaps, and manage engineering delivery schedules.
Define, document, and enforce data engineering standards, including CI/CD practices, robust testing frameworks, and comprehensive technical documentation.
Own the monitoring, cost optimization, and troubleshooting of production pipelines to maintain reliable business operations.
Evaluate emerging technologies, particularly generative AI integrations and advanced governance tools, to continuously improve data platform capabilities.
Overview\:
We're looking for a senior engineer who combines an architecture mindset with deep hands-on experience — someone who can design scalable systems and personally build and ship them into production. As our lead data engineer, you will own pipelines end-to-end across Google Cloud and Azure Databricks, from whiteboard to running code, while setting the technical direction for our enterprise data products, mentoring the team, and serving as the bridge between business stakeholders and engineering to turn strategic goals into robust, secure data solutions.
Responsibilities\:
Architect, build, and ship scalable batch and streaming data pipelines into production using BigQuery Dataform, Google Cloud Dataflow, Confluent Kafka, and Pub/Sub.
Design and build data pipelines on Azure Databricks using Apache Spark, Delta Lake, and Unity Catalog, keeping engineering patterns consistent with our Google Cloud platform.
Manage the end-to-end data product lifecycle, serving as the technical owner for critical data assets and establishing clear service level objectives.
Provide technical leadership and mentorship to junior and senior engineers, conducting code reviews and fostering a culture of technical excellence.
Lead the engineering team across Google Cloud and Azure Databricks environments, setting multi-cloud architecture standards for data movement, interoperability, security, and cost management.
Partner with product managers, business analysts, and leadership to define data product requirements, align roadmaps, and manage engineering delivery schedules.
Define, document, and enforce data engineering standards, including CI/CD practices, robust testing frameworks, and comprehensive technical documentation.
Own the monitoring, cost optimization, and troubleshooting of production pipelines to maintain reliable business operations.
Evaluate emerging technologies, particularly generative AI integrations and advanced governance tools, to continuously improve data platform capabilities.
Required\:
Bachelor Degree in Computer Science, Management Information Systems, Engineering or related field and 8 years Required
Expert knowledge in programming languages and coding principles and procedures.
Expert in web development framework.
Strong attention to detail, facilitation, team building, collaboration, organization, and problem-solving skills.
Excellent verbal and written communication skills.
Ability to work methodically and analytically in a quantitative problem-solving environment.
Demonstrated critical thinking skills.
Expert in Microsoft Office Suite (Word, Excel, and PPT).
Strong attention to detail, facilitation, team building and collaboration.
Ability to obtain applicable certifications.
Strongly Preferred\:
Ten or more years of experience in data engineering, data warehousing, or data architecture, with at least five years in a technical leadership, mentoring, or consulting role.
Deep technical expertise with Google Cloud, BigQuery, Dataflow, and related cloud data services.
Hands-on production experience with Azure Databricks, including Apache Spark (PySpark), Delta Lake, and Unity Catalog.
Proven experience architecting and leading delivery on multi-cloud data platforms, ideally spanning Google Cloud and Azure.
Production experience designing and deploying real-time streaming architectures using messaging platforms like Confluent Kafka or Google Pub/Sub.
Strong expertise in workflow orchestration using scheduling tools like Airflow.
Advanced SQL skills and extensive experience with transformation frameworks like Dataform or dbt.
Production experience with at least one transactional database, such as Oracle, SQL Server, or PostgreSQL.
Strong hands-on coding skills in Python or Java, with a track record of personally shipping production-grade data pipelines.
Demonstrated experience managing data product delivery, defining schemas, and establishing data quality baselines.
Strong communication skills with a proven track record of collaborating with cross-functional stakeholders and translating business needs into technical specifications.
Strong problem-solving abilities and experience leading engineering teams in fast-paced environments.
Experience coding with agentic tooling as part of generative AI workflows.
Direct experience implementing data mesh principles, managing data products, and using tools like Knowledge Catalog (Dataplex) or Entropy Data for contract management.
Advanced knowledge of data security, compliance, and governance tooling such as Immuta and native BigQuery security controls.
Experience operating across hybrid or multi-data platform environments, including Palantir.
Google Cloud Professional Data Engineer or Professional Cloud Architect certification.
Databricks Certified Data Engineer Professional or Microsoft Azure data certifications, plus certifications in supporting technologies such as Power BI.
Required\:
Bachelor Degree in Computer Science, Management Information Systems, Engineering or related field and 8 years Required
Expert knowledge in programming languages and coding principles and procedures.
Expert in web development framework.
Strong attention to detail, facilitation, team building, collaboration, organization, and problem-solving skills.
Excellent verbal and written communication skills.
Ability to work methodically and analytically in a quantitative problem-solving environment.
Demonstrated critical thinking skills.
Expert in Microsoft Office Suite (Word, Excel, and PPT).
Strong attention to detail, facilitation, team building and collaboration.
Ability to obtain applicable certifications.
Strongly Preferred\:
Ten or more years of experience in data engineering, data warehousing, or data architecture, with at least five years in a technical leadership, mentoring, or consulting role.
Deep technical expertise with Google Cloud, BigQuery, Dataflow, and related cloud data services.
Hands-on production experience with Azure Databricks, including Apache Spark (PySpark), Delta Lake, and Unity Catalog.
Proven experience architecting and leading delivery on multi-cloud data platforms, ideally spanning Google Cloud and Azure.
Production experience designing and deploying real-time streaming architectures using messaging platforms like Confluent Kafka or Google Pub/Sub.
Strong expertise in workflow orchestration using scheduling tools like Airflow.
Advanced SQL skills and extensive experience with transformation frameworks like Dataform or dbt.
Production experience with at least one transactional database, such as Oracle, SQL Server, or PostgreSQL.
Strong hands-on coding skills in Python or Java, with a track record of personally shipping production-grade data pipelines.
Demonstrated experience managing data product delivery, defining schemas, and establishing data quality baselines.
Strong communication skills with a proven track record of collaborating with cross-functional stakeholders and translating business needs into technical specifications.
Strong problem-solving abilities and experience leading engineering teams in fast-paced environments.
Experience coding with agentic tooling as part of generative AI workflows.
Direct experience implementing data mesh principles, managing data products, and using tools like Knowledge Catalog (Dataplex) or Entropy Data for contract management.
Advanced knowledge of data security, compliance, and governance tooling such as Immuta and native BigQuery security controls.
Experience operating across hybrid or multi-data platform environments, including Palantir.
Google Cloud Professional Data Engineer or Professional Cloud Architect certification.
Databricks Certified Data Engineer Professional or Microsoft Azure data certifications, plus certifications in supporting technologies such as Power BI.
Burns & McDonnell is making the world a better place every day. When we take on some of the world’s toughest challenges, we’re putting the industry’s best thinking to work, striving to create amazing success for our clients and amazing careers for our employee-owners. Our staff of more than 7,000 engineers, architects, construction professionals, scientists, consultants and business professionals is constantly growing.
We have offices and projects across the U.S. and around the globe. We are proud to rank among FORTUNE magazine’s 100 Best Companies to Work For. Our culture, powered by 100% employee ownership, plays a major role in getting us there. Each employee brings a high level of commitment to every project. Clients have shown their appreciation of this dedication, rewarding us with a 90% repeat business rate and decades-long partnerships. That’s pretty cool for a firm that started as a small engineering consulting shop back in 1898.
At Burns & McDonnell, you’ll have the opportunity to make a difference while fulfilling your personal and professional ambitions. Our entrepreneurial culture lets you guide your destiny and shape the path your career travels. And with hundreds of service specialties, your career and development options are endless.
Are you ready to create amazing?
Burns & McDonnell is an Equal Opportunity Employer Minorities/Females/Disabled/Veterans