Snowflake Data Engineer

We are seeking a highly skilled Snowflake Data Engineer with deep expertise in Snowflake's modern AI and data platform capabilities. The ideal candidate goes beyond traditional data engineering — they are proficient in Snowflake Cortex AI, building intelligent agents, developing Streamlit-based data applications, and leveraging Snowpark for advanced analytics. This role is central to our healthcare data modernization strategy and requires someone who can architect, build, and scale next-generation data and AI solutions on Snowflake.

Snowflake AI & Cortex (Core Focus)

Design and deploy AI-powered solutions using Snowflake Cortex, including LLM-based functions (COMPLETE, SUMMARIZE, SENTIMENT, TRANSLATE, CLASSIFY) for healthcare data use cases.

Build and orchestrate multi-step AI agents using Snowflake Cortex Agents and Cortex Analyst to automate data workflows and enable natural language querying of structured healthcare datasets.

Leverage Cortex Search for semantic and hybrid search capabilities across unstructured clinical and operational data.

Implement RAG (Retrieval-Augmented Generation) pipelines using Snowflake's native vector embeddings and VECTOR data type for domain-specific LLM grounding.

Use Arctic Embed and other Snowflake-native embedding models to build scalable, cost-effective AI features within the Snowflake perimeter.

Streamlit & Application Development

Build interactive, production-grade data applications and internal tools using Streamlit in Snowflake (SiS) for business stakeholders and data consumers.

Develop self-service analytics dashboards and AI-assisted exploration tools embedded directly in the Snowflake environment.

Create Streamlit-based front-ends for Cortex-powered features — enabling clinical users and analysts to interact with AI outputs without leaving the Snowflake ecosystem.

Snowpark & Data Engineering

Develop complex data transformations, feature engineering pipelines, and ML preprocessing workflows using Snowpark for Python.

Build and manage scalable ELT pipelines leveraging Snowflake Streams, Tasks, Dynamic Tables, and Snowpipe for real-time and batch ingestion.

Optimize Snowflake performance through micro-partition pruning, clustering keys, materialized views, search optimization, and warehouse right-sizing.

Design and implement Data Vault or Medallion architecture patterns for healthcare data platforms.

Integrate Snowflake with upstream healthcare data sources and downstream BI platforms.

Data Governance & Security

Implement Snowflake-native governance including row-level security, column masking policies, object tagging, and data classification.

Ensure HIPAA compliance and PHI data handling best practices across all Snowflake data assets.

Manage data lineage, cataloging, and access control in alignment with organizational governance frameworks.

Collaboration & Platform Ownership

Partner with data scientists, ML engineers, clinical analysts, and business stakeholders to translate requirements into robust Snowflake-native solutions.

Act as a Snowflake subject matter expert and internal champion — driving best practices, onboarding teams, and evangelizing new platform capabilities.

Participate in platform roadmap planning and contribute to Snowflake feature adoption strategy.

5+ years of data engineering experience, with at least 3+ years of hands-on Snowflake expertise.

Proven experience with Snowflake Cortex AI features: LLM functions, Cortex Analyst, Cortex Search, and AI agent orchestration.

Hands-on experience building Streamlit in Snowflake applications deployed in production environments.

Proficiency in Snowpark for Python — including custom UDFs/UDTFs, stored procedures, and DataFrame API usage.

Strong SQL skills with deep understanding of Snowflake's execution engine, query profiling, and optimization techniques.

Experience with Snowflake data sharing, Marketplace, and cross-cloud/cross-region replication.

Familiarity with vector search, embeddings, and RAG architecture patterns within or integrated into Snowflake.

Good to have experience with cloud platforms: Azure, and GCP — and connecting Snowflake to cloud-native services.

Strong understanding of data modeling for analytics (star schema, Data Vault, Medallion/Lakehouse patterns).

Knowledge of Medicare Stars Patient Safety is a strong plus.