Quantiphi
Pioneering AI-first solutions, solving complex business challenges through expertise, cloud, data engineering, and AI.
Senior Data Engineer
Location
United States
Posted
88 days ago
Salary
Not specified
Bachelor Degree8 yrs expEnglishAWSAzureCloudGoogle Cloud PlatformPy SparkSQLUnity
Job Description
• Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks
• Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows
• Implement data models optimized for analytics, performance, and operational excellence
• Build and manage data systems across AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency
• Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices
• Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions
• Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness
Job Requirements
- 8+ years of experience in data engineering or a related field
- Strong expertise in PySpark, SQL, and data modeling for high-volume datasets
- Hands-on experience building and optimizing data pipelines in AWS or GCP environments
- Track record of working with complex source systems and developing accurate extraction and transformation logic
- Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions
- Solid understanding of distributed computing, data partitioning, and performance tuning
- Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework (nice to haves)
- Familiarity with Delta Lake, orchestration tools, or Unity Catalog (nice to haves)
- Experience with CI/CD for data pipelines and automated testing frameworks (nice to haves)
Benefits
- Join a high-growth, AI-first digital engineering and transformation company
- Work with Fortune 500 clients and cutting-edge market disruptors
- Collaborate with a talented, dynamic, and driven team
- Gain exposure to the latest technologies in AI, ML, cloud, and data engineering
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer – Media Buying Engineering Team
Channel FactoryWe help brands find the right content, context and audience on YouTube at the right price.
Data Engineer88 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor
Senior Data Engineer building scalable data infrastructure for video marketing solutions
ApacheAWSDistributed SystemsEC2PySparkPythonRabbitMQRDBMSSQL
United States
Senior Data Warehouse Developer
UR VenturesEnsuring University of Rochester innovations enrich our community, improve our society, and make the world ever better
Data Engineer88 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor
Sr. Data Warehouse Developer designing and supporting enterprise data warehouse solutions
CloudETLInformaticaOracle
Data Engineer89 days ago
Full TimeRemoteTeam 10,001+Since 2004H1B Sponsor
Senior Staff Data Engineer building data pipelines at NBCUniversal
AWSETLLinuxPandasPythonScalaSparkSQLTableau
Data Engineer89 days ago
Full TimeRemoteTeam 51-200Since 2020H1B No Sponsor
Analytics Data Engineer transforming data into insights for a digital banking startup
Amazon RedshiftAWSAzureBigQueryCloudETLGoogle Cloud PlatformPythonSQLTableau
New York