Senior Data Engineering Lead
Full TimeRemote
Location
United States
Posted
1 day ago
Salary
Not specified
No structured requirement data.
Job Description
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.
Role Description
This role involves serving as a senior technical leader responsible for shaping and managing the modern data ecosystem. Your contributions will directly impact our mission to enhance healthcare by delivering high-quality data products that support clinical and operational outcomes.
- Design and evolve a scalable, secure, cloud-native lakehouse platform leveraging Databricks and Microsoft Fabric.
- Define modeling patterns and governance frameworks across the data lifecycle.
- Lead design reviews and guide teams in adopting scalable architectures.
- Drive long-term platform strategy and evaluate emerging technologies.
- Design and implement batch and streaming data pipelines for healthcare data sources.
- Develop frameworks for ingestion, quality, lineage, metadata, and observability.
- Produce clean, analytics-ready datasets for BI and machine learning.
- Implement HIPAA-aligned access patterns and secure handling of PHI.
- Architect Databricks workloads for reliability and efficiency.
- Integrate Databricks and Microsoft Fabric with Azure services and enterprise systems.
Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 7+ years of experience in data engineering.
- 2+ years operating in a senior or staff level engineering role.
- Proficiency with Databricks, Spark, Delta Lake, dbt, and Python.
- Experience designing large-scale cloud data platforms (Azure preferred).
- Familiarity with Data Engineering, Data Factory, and Lakehouse.
- Advanced expertise in data platform architecture.
- Ability to create modular, extensible frameworks for enterprise solutions.
- Strong command of distributed data processing techniques.
- Experience in HIPAA regulated environments and handling PHI.
- Fluency in healthcare data compliance standards.
- Technical leadership and mentorship capabilities.
- Excellent communication skills with technical and clinical stakeholders.
Benefits
- 100% remote work (ET or CT work hours preferred).
- Collaborative and inclusive work environment.
- Opportunities for professional growth and development.
- Mission-driven culture focused on improving healthcare.
- Diversity, equity, and inclusion in recruitment practices.
- Access to cutting-edge technology and resources.
Job Requirements
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 7+ years of experience in data engineering.
- 2+ years operating in a senior or staff level engineering role.
- Proficiency with Databricks, Spark, Delta Lake, dbt, and Python.
- Experience designing large-scale cloud data platforms (Azure preferred).
- Familiarity with Data Engineering, Data Factory, and Lakehouse.
- Advanced expertise in data platform architecture.
- Ability to create modular, extensible frameworks for enterprise solutions.
- Strong command of distributed data processing techniques.
- Experience in HIPAA regulated environments and handling PHI.
- Fluency in healthcare data compliance standards.
- Technical leadership and mentorship capabilities.
- Excellent communication skills with technical and clinical stakeholders.
Benefits
- 100% remote work (ET or CT work hours preferred).
- Collaborative and inclusive work environment.
- Opportunities for professional growth and development.
- Mission-driven culture focused on improving healthcare.
- Diversity, equity, and inclusion in recruitment practices.
- Access to cutting-edge technology and resources.