This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more.

Role Description

As the Sr. Principal Data Engineer, you will be the primary architect of Digital Remedy’s next-generation data platform. You won't just move data; you will design the blueprints for how we handle massive-scale AdTech telemetry. You will bridge the gap between business priorities and technical execution, ensuring our "Partner" integrations are scalable, cost-efficient, and resilient.

• Architectural Leadership: Design and oversee the migration/optimization of our data lakehouse architecture using Databricks.
• Production Excellence: Serve as the escalation point for the platform, leveraging a proven record of handling production issues to ensure 24/7 reliability of mission-critical pipelines.
• Strategic Capacity Planning: Work directly with the SVP of Tech to translate product roadmaps into technical requirements, multitasking across various high-priority workstreams without losing sight of architectural integrity.
• Infrastructure as Code: Drive the adoption of Databricks Asset Bundles (DABs) to standardize deployments across dev, staging, and production.
• Mentorship & Governance: Provide high-level guidance to engineering squads in India and the US, defining schemas and governance models for BigQuery and Databricks.

Qualifications

• Minimum 4+ years of hands-on experience specifically within the Databricks ecosystem (Delta Lake, Unity Catalog, Photon).
• Deep proficiency in Spark (PySpark/Scala), Python, and SQL. Experience with GCP (BigQuery) is a major plus.
• Proven experience managing petabyte-scale datasets and high-concurrency pipelines (AdTech experience preferred).
• Must be a self-starter capable of taking a high-level concept from the SVP and driving it to completion with minimal supervision.
• 10+ years in Data Engineering, with at least 3 years in a Principal or Architect capacity.

Requirements

• A history of successfully diagnosing and resolving complex, large-scale production bottlenecks and data outages.
• A demonstrated ability to multi-task, balancing long-term architectural R&D with immediate business requests and partner integrations.
• Strong understanding of optimizing Databricks/BigQuery costs and the ability to communicate technical trade-offs to non-technical stakeholders.

Benefits

• Base salary compensation range for this role is $131,250 to $175,000.
• Final compensation will be determined by various factors such as a candidate’s relevant work experience, skills, certifications, and geographic location.
• Full-time positions are eligible for benefits that include participation in a retirement plan, quarterly and annual incentive plan bonuses, life and disability insurance, health, dental and vision plans, flexible spending accounts, 15 paid vacation days, 2 paid personal days, 9 paid holidays, 40 hours of paid sick leave, parental leave, and employee stock purchase plan.