People Data Labs

People and Company Intelligence

Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 51-200Since 2015Company SiteLinkedIn

Location

United States

Posted

58 days ago

Salary

$160K - $180K / year

Bachelor Degree4 yrs expEnglishAirflowAmazon RedshiftApacheAWSAzureBig QueryCloudGoogle Cloud PlatformJavaPythonScalaSparkSQL

Job Description

• Build infrastructure for ingestion, transformation, and loading an exponentially increasing volume of data from a variety of sources using Spark, SQL, AWS, and Databricks • Building an organic entity resolution framework capable of correctly merging hundreds of billions of individual entities into a number of clean, consumable datasets. • Developing CI/CD pipelines and anomaly detection systems capable of continuously improving the quality of data we're pushing into production. • Dreaming up solutions to largely undefined data engineering and data science problems.

Job Requirements

  • 4-6+ years of industry experience with clear examples of strategic technical problem-solving and implementation
  • Strong software development fundamentals.
  • Experience with Python
  • Expertise with Apache Spark (Java, Scala, and/or Python-based)
  • Experience with SQL
  • Experience building scalable data processing systems (e.g., cleaning, transformation) from the ground up.
  • Experience using developer-oriented data pipeline and workflow orchestration (e.g., Airflow (preferred), dbt, dagster or similar)
  • Knowledge of modern data design and storage patterns (e.g., incremental updating, partitioning and segmentation, rebuilds and backfills)
  • Experience working in Databricks (including delta live tables, data lakehouse patterns, etc.)
  • Experience with cloud computing services (AWS (preferred), GCP, Azure or similar)
  • Experience with data warehousing (e.g., Databricks, Snowflake, Redshift, BigQuery, or similar)
  • Understanding of modern data storage formats and tools (e.g., parquet, ORC, Avro, Delta Lake)

Benefits

  • Stock
  • Competitive Salaries
  • Unlimited paid time off
  • Medical, dental, & vision insurance
  • Health, fitness, and office stipends
  • The permanent ability to work wherever and however you want

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer

MO Studio

Join our team | https://jobs.lever.co/MOstudio

Data Engineer58 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Senior Data Engineer designing scalable data infrastructure for the VA.

AzureOraclePythonSQL
Arizona + 20 moreAll locations: Arizona, California, Colorado, Connecticut, District of Columbia, Florida, Illinois, Kansas, Maine, Nevada, New Jersey, New York, North Carolina, Oregon, Maryland, Massachusetts, Pennsylvania, Texas, Virginia, Washington, Wisconsin
$135K - $165K / year

Staff Data Engineer, Data Platform

Postscript

SMS marketing platform for ecommerce companies. Helping Shopify stores drive 30x ROI with text message marketing.

Data Engineer58 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor

Staff Data Engineer leading data architecture at eCommerce SMS marketing platform

ApacheAWSCloudDistributed SystemsJavaKotlinNoSQLPostgresScalaSparkGo
United States
$200K - $235K / year

Data Engineer

ComPsych

The World’s Largest Provider of Mental Health Services and GuidanceResources® for Life.

Data Engineer58 days ago
Full TimeRemoteTeam 1,001-5,000Since 1984H1B Sponsor

Data Engineer designing new data platforms and ETL pipelines at ComPsych

AzureETLNoSQLPythonSDLCSQL
United States
$115K - $135K / year
Data Engineer58 days ago
Full TimeRemoteTeam 1-10Since 2025H1B No Sponsor

Senior Data Engineering & Architecture Consultant supporting analytics and platform initiatives at Phizenix

United States
$70K - $80K / year