Risepoint

Reach new heights

Senior Data Engineer – Databricks

Data EngineerData EngineerFull TimeRemoteTeam 1,001-5,000Since 2007Company SiteLinkedIn

Location

United States

Posted

4 days ago

Salary

Not specified

Bachelor Degree5 yrs expEnglishApacheAWSAzureCloudETLPy SparkPythonSparkSQLTerraformUnity

Job Description

• Build reliable, scalable data pipelines on Databricks • Turn requirements into production-grade ELT/ETL jobs, Delta Lake tables, and reusable components • Implement and improve reference patterns, optimize Spark for performance and cost • Apply best practices with Unity Catalog and workflow orchestration • Ship high-quality code others can build on • Partner directly with the customer’s data engineering team to design and deliver scalable, cloud-based data solutions • Execute complex ad-hoc queries using Databricks SQL • Develop robust data transformation workflows using PySpark and SQL • Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks • Build ETL/ELT workflows with AWS and Azure Services • Optimize Spark jobs for performance and cost • Collaborate with data scientists, ML engineers, and business analysts • Contribute to the development of AI-powered solutions • Implement CI/CD pipelines for Databricks jobs

Job Requirements

  • Bachelor's degree in computer science, Engineering, or a related field
  • 5+ years of experience in software/data engineering, including at least 2 years working with Databricks and Apache Spark
  • Strong proficiency in Python, SQL, and PySpark
  • Deep understanding of AWS and Azure Cloud service
  • Experience with Databricks Data LakeHouse, Databricks Workflows, and Databricks SQL, dbt
  • Solid grasp of data Lakehouse and warehousing architecture
  • Prior experience supporting AI/ML workflows, including training data pipelines and model deployment support
  • Familiarity with infrastructure-as-code tools like Terraform or CloudFormation
  • Strong analytical and troubleshooting skills in a fast-paced, agile environment
  • Excellent collaboration skills for interfacing with both technical and non-technical customer stakeholders
  • Clear communicator with strong documentation habits
  • Comfortable leading discussions, offering strategic input, and mentoring others

Benefits

  • Health insurance
  • Flexible work arrangements
  • Professional development opportunities

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Management

Millennium Health

An accredited specialty laboratory with over 15 years of experience

Data Engineer4 days ago
Full TimeRemoteTeam 501-1,000Since 2007H1B No Sponsor

Millennium Health LLC is an accredited specialty laboratory with more than a decade of experience in medication monitoring and drug testing services, helping clinicians monitor the use and misuse of prescription medications and illicit drugs. The testi...

Data ManagementAnalyticsQuality AssuranceHIPAA ComplianceReportingSalesforce
California
Full TimeRemoteTeam 1,001-5,000Since 1998H1B Sponsor

Senior Data Engineer designing and building data infrastructure at Constant Contact

AirflowApacheBigQueryCloudETLKafkaPythonSparkSQLTerraform
United States
$108.4K - $135.5K / year
Data Engineer4 days ago
Full TimeRemoteTeam 501-1,000H1B No Sponsor

The role involves leading the design, optimization, and scalability of high-performance OLAP systems, specifically architecting and optimizing distributed analytical databases like ClickHouse to handle multi-terabyte datasets. Additionally, the engineer will mentor teams on best practices for data modeling, query optimization, and ensuring system reliability for advanced AI workloads.

ClickHouseOLAPdistributed systemsdata modelingquery optimizationETLreal-time analyticsmulti-terabyte datasets
United States + 2 moreAll locations: United States, Colombia, Costa Rica

Data Engineer Intern (Internship)

Abacus Insights

Improving people’s lives by harnessing the healthcare data explosion through an intelligent data integration platform.

Data Engineer4 days ago
InternshipRemoteTeam 51-200H1B Sponsor

The intern will partner with customers and internal teams to extract data from the core platform, guiding client adoption of data management offerings. Day-to-day tasks involve understanding data distribution requirements, performing data analysis and mapping, building extracts and scripts, and optimizing their performance.

SQLData AnalysisData MappingPerformance TuningHealthcare DataClaims DataMembership DataProvider Data
United States