Quantiphi

Pioneering AI-first solutions, solving complex business challenges through expertise, cloud, data engineering, and AI.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 1,001-5,000Since 2013H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

88 days ago

Salary

Not specified

Bachelor Degree8 yrs expEnglishAWSAzureCloudGoogle Cloud PlatformPy SparkSQLUnity

Job Description

• Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks • Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows • Implement data models optimized for analytics, performance, and operational excellence • Build and manage data systems across AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency • Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices • Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions • Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness

Job Requirements

  • 8+ years of experience in data engineering or a related field
  • Strong expertise in PySpark, SQL, and data modeling for high-volume datasets
  • Hands-on experience building and optimizing data pipelines in AWS or GCP environments
  • Track record of working with complex source systems and developing accurate extraction and transformation logic
  • Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions
  • Solid understanding of distributed computing, data partitioning, and performance tuning
  • Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework (nice to haves)
  • Familiarity with Delta Lake, orchestration tools, or Unity Catalog (nice to haves)
  • Experience with CI/CD for data pipelines and automated testing frameworks (nice to haves)

Benefits

  • Join a high-growth, AI-first digital engineering and transformation company
  • Work with Fortune 500 clients and cutting-edge market disruptors
  • Collaborate with a talented, dynamic, and driven team
  • Gain exposure to the latest technologies in AI, ML, cloud, and data engineering

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer – Media Buying Engineering Team

Channel Factory

We help brands find the right content, context and audience on YouTube at the right price.

Data Engineer88 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

Senior Data Engineer building scalable data infrastructure for video marketing solutions

ApacheAWSDistributed SystemsEC2PySparkPythonRabbitMQRDBMSSQL
United States

Senior Data Warehouse Developer

UR Ventures

Ensuring University of Rochester innovations enrich our community, improve our society, and make the world ever better

Data Engineer88 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Sr. Data Warehouse Developer designing and supporting enterprise data warehouse solutions

CloudETLInformaticaOracle
New York
$86.5K - $129.7K / year

Senior Staff Data Engineer

NBCUniversal

Here you can create the extraordinary. Join us.

Data Engineer89 days ago
Full TimeRemoteTeam 10,001+Since 2004H1B Sponsor

Senior Staff Data Engineer building data pipelines at NBCUniversal

AWSETLLinuxPandasPythonScalaSparkSQLTableau
New York
$150K - $185K / year
Data Engineer89 days ago
Full TimeRemoteTeam 51-200Since 2020H1B No Sponsor

Analytics Data Engineer transforming data into insights for a digital banking startup

Amazon RedshiftAWSAzureBigQueryCloudETLGoogle Cloud PlatformPythonSQLTableau
New York