Senior Data Engineering Lead

Full TimeRemote

Location

United States

Posted

1 day ago

Salary

Not specified

No structured requirement data.

Job Description

This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

This role involves serving as a senior technical leader responsible for shaping and managing the modern data ecosystem. Your contributions will directly impact our mission to enhance healthcare by delivering high-quality data products that support clinical and operational outcomes.

  • Design and evolve a scalable, secure, cloud-native lakehouse platform leveraging Databricks and Microsoft Fabric.
  • Define modeling patterns and governance frameworks across the data lifecycle.
  • Lead design reviews and guide teams in adopting scalable architectures.
  • Drive long-term platform strategy and evaluate emerging technologies.
  • Design and implement batch and streaming data pipelines for healthcare data sources.
  • Develop frameworks for ingestion, quality, lineage, metadata, and observability.
  • Produce clean, analytics-ready datasets for BI and machine learning.
  • Implement HIPAA-aligned access patterns and secure handling of PHI.
  • Architect Databricks workloads for reliability and efficiency.
  • Integrate Databricks and Microsoft Fabric with Azure services and enterprise systems.

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 7+ years of experience in data engineering.
  • 2+ years operating in a senior or staff level engineering role.
  • Proficiency with Databricks, Spark, Delta Lake, dbt, and Python.
  • Experience designing large-scale cloud data platforms (Azure preferred).
  • Familiarity with Data Engineering, Data Factory, and Lakehouse.
  • Advanced expertise in data platform architecture.
  • Ability to create modular, extensible frameworks for enterprise solutions.
  • Strong command of distributed data processing techniques.
  • Experience in HIPAA regulated environments and handling PHI.
  • Fluency in healthcare data compliance standards.
  • Technical leadership and mentorship capabilities.
  • Excellent communication skills with technical and clinical stakeholders.

Benefits

  • 100% remote work (ET or CT work hours preferred).
  • Collaborative and inclusive work environment.
  • Opportunities for professional growth and development.
  • Mission-driven culture focused on improving healthcare.
  • Diversity, equity, and inclusion in recruitment practices.
  • Access to cutting-edge technology and resources.

Job Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 7+ years of experience in data engineering.
  • 2+ years operating in a senior or staff level engineering role.
  • Proficiency with Databricks, Spark, Delta Lake, dbt, and Python.
  • Experience designing large-scale cloud data platforms (Azure preferred).
  • Familiarity with Data Engineering, Data Factory, and Lakehouse.
  • Advanced expertise in data platform architecture.
  • Ability to create modular, extensible frameworks for enterprise solutions.
  • Strong command of distributed data processing techniques.
  • Experience in HIPAA regulated environments and handling PHI.
  • Fluency in healthcare data compliance standards.
  • Technical leadership and mentorship capabilities.
  • Excellent communication skills with technical and clinical stakeholders.

Benefits

  • 100% remote work (ET or CT work hours preferred).
  • Collaborative and inclusive work environment.
  • Opportunities for professional growth and development.
  • Mission-driven culture focused on improving healthcare.
  • Diversity, equity, and inclusion in recruitment practices.
  • Access to cutting-edge technology and resources.

Related Categories

Related Job Pages