← Search all jobs

Data Engineer, Sr

Insight Global

Listing collected from Insight Global's career site. NextChapter is independent of Insight Global.

Atlanta, GA · Posted November 12, 2026

Just laid off? Start here: a plan for the first weeks

See every open role at Insight Global

More in Georgia job market · Data Engineer jobs in Atlanta, GA (10) · All Data Engineer jobs (423) · Professional Services & Consulting · Data & Analytics jobs

More roles at Insight Global

Similar jobs

Where Atlanta, GA ranks

Where Atlanta, GA placed in our monthly rankings, month by month. Each month stays online at its own address.

Pay compared with the market

This listing does not state pay. Across 111 open data engineer listings that state pay, the middle half runs $117,500 to $162,500 and the median is $140,500.

Listed pay is what employers advertise, not what people are paid.

Data Engineer salaries by state · Check your own pay

How AI is used in this kind of work

Among database architects, AI is already used for a large share of the tasks. Measured exposure for database architects: 58% (high).

Share of this job’s tasks that AI is already used for at work, from real usage. It is not a forecast of job loss, and a low number means no use seen yet. Source: Anthropic Economic Index.

Check how this applies to your own job

Skills this job asks for

Say which you have and which you want to build. We use it to match you to jobs like this one.

  • Python
  • Agile
  • SQL
  • Azure
  • CI/CD

About the job

Overview

The Data & Insights organization at Insight Global is responsible for delivering Trusted Data & Verified Insights to drive business decisions across the company. As a Senior Data Engineer , you will be part of the Data Engineering & Operations team responsible for enhancing and maintaining scalable data pipelines, supporting and improving platform operations processes, and enabling analytics, data science, and AI use cases.

This is a hands-on role reporting to the Data Operations Manager with direct impact on Insight Global’s ability to deliver high-quality, actionable data to the business.

Responsibilities

Design, develop, and enhance scalable data pipelines supporting analytics, reporting, AI/ML, and operational business processes.

Own the reliability and stability of enterprise data platforms by proactively monitoring pipelines, troubleshooting production issues, and ensuring adherence to SLAs and operational standards.

Lead root cause analysis and incident resolution efforts, driving permanent fixes, automation opportunities, and preventative controls to reduce recurring issues.

Develop and maintain data solutions using Databricks, Azure Data Factory, SQL, and PySpark, following enterprise architecture and engineering standards.

Drive DataOps best practices, including CI/CD implementation, automated testing, code reviews, deployment automation, release management, and environment governance.

Improve data quality, performance, observability, and operational efficiency through monitoring, alerting, lineage tracking, logging, and automation initiatives.

Work with structured, semi-structured, and streaming data, building scalable ingestion and transformation frameworks.

Collaborate with business stakeholders, analytics teams, architects, product owners, and application teams to deliver reliable and business-aligned data solutions.

Identify opportunities for continuous improvement in processes, architecture, governance, security, cost optimization, and platform scalability.

Qualifications

Required Skills

5-7 years of experience in Data Engineering, DataOps, Analytics Engineering, or Enterprise Data Platforms.

Strong expertise in advanced SQL development, query optimization, data analysis, and troubleshooting.

Proficiency in Python and PySpark for large-scale data transformation, pipeline development, and automation.

Hands-on experience with Databricks, Delta Lake, Azure Data Factory, and Azure data services.

Experience designing and supporting batch, near real-time, and streaming data solutions.

Strong understanding of CI/CD pipelines, Git-based source control, pipeline testing, and DevOps/DataOps practices.

Experience with monitoring, observability, logging, alerting, and production support processes.

Knowledge of data modeling, data warehousing concepts, and dimensional design principles

Preferred Skills

Experience with Databricks Unity Catalog.

Knowledge of data governance, data quality frameworks, security, and compliance requirements.

Proven experience managing production incidents, performing root cause analysis, and driving long-term remediation plans.

Ability to prioritize operational stability while balancing enhancement and project delivery commitments.

Experience working in Agile, Scrum, or Scrumban environments.

This Role Is Ideal If You:

Are excited to be part of a data team supporting data pipelines in Databricks.

Thrive in Agile environments and enjoy working across disciplines.

Take ownership of operational responsibilities and ability to fix data issues.

Are passionate about delivering reliable, high-quality data solutions.

Embody Insight Global’s shared values and contribute to a collaborative, high-performance culture.

Design, develop, and enhance scalable data pipelines supporting analytics, reporting, AI/ML, and operational business processes.

Own the reliability and stability of enterprise data platforms by proactively monitoring pipelines, troubleshooting production issues, and ensuring adherence to SLAs and operational standards.

Lead root cause analysis and incident resolution efforts, driving permanent fixes, automation opportunities, and preventative controls to reduce recurring issues.

Develop and maintain data solutions using Databricks, Azure Data Factory, SQL, and PySpark, following enterprise architecture and engineering standards.

Drive DataOps best practices, including CI/CD implementation, automated testing, code reviews, deployment automation, release management, and environment governance.

Improve data quality, performance, observability, and operational efficiency through monitoring, alerting, lineage tracking, logging, and automation initiatives.

Work with structured, semi-structured, and streaming data, building scalable ingestion and transformation frameworks.

Collaborate with business stakeholders, analytics teams, architects, product owners, and application teams to deliver reliable and business-aligned data solutions.

Identify opportunities for continuous improvement in processes, architecture, governance, security, cost optimization, and platform scalability.

Required Skills

5-7 years of experience in Data Engineering, DataOps, Analytics Engineering, or Enterprise Data Platforms.

Strong expertise in advanced SQL development, query optimization, data analysis, and troubleshooting.

Proficiency in Python and PySpark for large-scale data transformation, pipeline development, and automation.

Hands-on experience with Databricks, Delta Lake, Azure Data Factory, and Azure data services.

Experience designing and supporting batch, near real-time, and streaming data solutions.

Strong understanding of CI/CD pipelines, Git-based source control, pipeline testing, and DevOps/DataOps practices.

Experience with monitoring, observability, logging, alerting, and production support processes.

Knowledge of data modeling, data warehousing concepts, and dimensional design principles

Preferred Skills

Experience with Databricks Unity Catalog.

Knowledge of data governance, data quality frameworks, security, and compliance requirements.

Proven experience managing production incidents, performing root cause analysis, and driving long-term remediation plans.

Ability to prioritize operational stability while balancing enhancement and project delivery commitments.

Experience working in Agile, Scrum, or Scrumban environments.

This Role Is Ideal If You:

Are excited to be part of a data team supporting data pipelines in Databricks.

Thrive in Agile environments and enjoy working across disciplines.

Take ownership of operational responsibilities and ability to fix data issues.

Are passionate about delivering reliable, high-quality data solutions.

Embody Insight Global’s shared values and contribute to a collaborative, high-performance culture.