Databricks Senior Data Engineer

Business Development RepBusiness Development RepFull TimeRemote

Location

United States

Posted

15 days ago

Salary

Not specified

No structured requirement data.

Job Description

The Databricks Senior Data Engineer will play a critical role in designing, implementing, and optimizing enterprise-scale data platforms using the Databricks Lakehouse architecture. This role combines architecture leadership with hands-on engineering, focusing on building scalable, secure, and high-performance data pipelines and platforms. Architect and design scalable, reliable data platforms and complex ETL/ELT and streaming workflows for the Databricks Lakehouse Platform (Delta Lake, Spark). Write, test, and optimize code in Python, PySpark, and SQL for data ingestion, transformation, and processing. Implement CI/CD, monitoring, and automation (e.g., with Azure DevOps, DBX) for data pipelines. Work with BI developers, analysts, and business users to define requirements and deliver data-driven solutions. Tune delta tables, Spark jobs, and SQL queries for maximum efficiency and scalability. Experience in GenAI application development is a big plus.

Job Requirements

  • Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
  • Experience designing enterprise-scale data platforms and modern data architectures.
  • Experience with data integration tools such as Azure Data Factory or similar platforms.
  • Familiarity with cloud data warehouses such as Databricks, Snowflake, or Azure Fabric.
  • Experience supporting analytics, reporting, or AI/ML workloads is highly desirable.
  • Databricks, Azure, or cloud certifications are preferred.
  • Strong problem-solving, communication, and technical leadership skills.
  • 8+ years of experience in data engineering, with strong hands-on expertise in Databricks and Apache Spark.
  • Proven experience designing and implementing scalable ETL/ELT pipelines in cloud environments.
  • Strong programming skills in Python and SQL; experience with PySpark required.
  • Hands-on experience with Databricks Lakehouse, Delta Lake, and distributed data processing.
  • Experience working with cloud platforms such as Microsoft Azure, AWS, or GCP (Azure preferred).
  • Experience with CI/CD pipelines, Git, and DevOps practices for data engineering.
  • Strong understanding of data architecture, data modeling, and performance optimization.
  • Experience working with cross-functional teams to deliver enterprise data solutions.
  • Tackles complex data challenges, ensuring data quality and reliable delivery.

Benefits

  • Competitive compensation and a comprehensive benefits package.
  • Remote work options to create a continuum between work and life.
  • A culture that supports growth and development.

Related Categories

Related Job Pages

More Business Development Rep Jobs

Full TimeRemote

The Commonwealth of Pennsylvania is seeking a Senior Dynamics 365 Developer / Technical Lead with 5–7 years of experience to support, enhance, and modernize its Dynamics 365 Customer Engagement (CE) platform. This role combines hands-on development with technical leadership, requ...

United States

Partnership Support Engineer

Wheelhouse

Wheelhouse is a fintech platform for the $500B+ flex rental space. We enable short and mid-length stay providers — with 1 to 100,000+ listings — to earn 20%+ more from their rental properties. In 2021, our target customer segment voted our platform “Innovation of the Year” at the Data & Revenue Management conference. In 2022, we closed a significant funding round with participation from leading tech, travel, and real estate investors. We enjoy low churn, rapidly growing ARPU, and a long runway. As a team, we ship products our customers love, on time or ahead of schedule, while maintaining a healthy work-life balance. We’re transparent, collaborative, and deeply committed to setting our teammates up for success — both professionally and personally. We’re a remote-first, work-anywhere company that believes healthy hustle is the key to good growth.

Business Development Rep15 days ago
Full TimeRemoteTeam 11-50

This role involves ensuring the reliability and scalability of external integrations, including APIs and partner platforms. Investigate integration issues and debug complex cross-system behavior Collaborate directly with partner technical teams Resolve problems or triage effectiv...

United States

API Integration Specialist

MERGE

At MERGE, we are a marketing and technology agency purpose-built for the intersection of health and wellness—where human impact matters most. By weaving storytelling through technology, we move beyond traditional engagement to Whole Human Marketing. This approach recognizes that humans are multidimensional and complex, and uses AI to ensure every brand interaction feels natural, contextual, and relevant. We are united by our North Star: to unite people and brands to empower healthier, happier lives. At MERGE, we strive to create a superior work experience where talented and ambitious people grow, encouraging them to think higher and feel deeper. MERGE believes in transparency and equity. In accordance with state regulations, we’re proud to include salary ranges in our job postings to ensure fair compensation practices. The salary range for this role is $86,000 - $104,000, based on the individual’s skills, experience, qualifications, location, and other relevant factors. The salary pay range is subject to change and may be modified at any time. MERGE is proud to invest in benefits that include meaningful Medical, Dental, Vision, Life Insurance, 401K, Lifestyle Spending Account, Employer Paid Life & Disability Insurance, Flexible Time off & Holidays plus many other benefits and rewards. MERGE is proud to be an Equal Opportunity Employer and welcomes and celebrates diversity regardless of race, religion, color, national origin, gender, sexual orientation, veteran status or people with abilities. We believe that the more diverse we are, the more creative our work will be!

Business Development Rep15 days ago
Full TimeRemoteTeam 501-1,000

As an API Integration Specialist you will: Develop and maintain API-driven integration flows using Adobe Workfront Fusion, automating manual processes for enhanced efficiency. Monitor API performance to troubleshoot issues and ensure system reliability. Create comprehensive docum...

United States

Regional Director, Enterprise

Jobgether

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1 We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Business Development Rep15 days ago
Full TimeRemote

This role provides an exciting opportunity to lead and scale a high-performing Enterprise Sales team across strategic accounts in the region. You will be responsible for driving new business and expansion opportunities, coaching senior Account Executives, and fostering a culture ...

United States