People Data Labs
People and Company Intelligence
Data Engineer
Location
United States
Posted
58 days ago
Salary
$160K - $180K / year
Bachelor Degree4 yrs expEnglishAirflowAmazon RedshiftApacheAWSAzureBig QueryCloudGoogle Cloud PlatformJavaPythonScalaSparkSQL
Job Description
• Build infrastructure for ingestion, transformation, and loading an exponentially increasing volume of data from a variety of sources using Spark, SQL, AWS, and Databricks
• Building an organic entity resolution framework capable of correctly merging hundreds of billions of individual entities into a number of clean, consumable datasets.
• Developing CI/CD pipelines and anomaly detection systems capable of continuously improving the quality of data we're pushing into production.
• Dreaming up solutions to largely undefined data engineering and data science problems.
Job Requirements
- 4-6+ years of industry experience with clear examples of strategic technical problem-solving and implementation
- Strong software development fundamentals.
- Experience with Python
- Expertise with Apache Spark (Java, Scala, and/or Python-based)
- Experience with SQL
- Experience building scalable data processing systems (e.g., cleaning, transformation) from the ground up.
- Experience using developer-oriented data pipeline and workflow orchestration (e.g., Airflow (preferred), dbt, dagster or similar)
- Knowledge of modern data design and storage patterns (e.g., incremental updating, partitioning and segmentation, rebuilds and backfills)
- Experience working in Databricks (including delta live tables, data lakehouse patterns, etc.)
- Experience with cloud computing services (AWS (preferred), GCP, Azure or similar)
- Experience with data warehousing (e.g., Databricks, Snowflake, Redshift, BigQuery, or similar)
- Understanding of modern data storage formats and tools (e.g., parquet, ORC, Avro, Delta Lake)
Benefits
- Stock
- Competitive Salaries
- Unlimited paid time off
- Medical, dental, & vision insurance
- Health, fitness, and office stipends
- The permanent ability to work wherever and however you want
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer59 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor
Senior Data Engineer designing scalable data infrastructure for the VA.
AzureOraclePythonSQL
Arizona + 20 moreAll locations: Arizona, California, Colorado, Connecticut, District of Columbia, Florida, Illinois, Kansas, Maine, Nevada, New Jersey, New York, North Carolina, Oregon, Maryland, Massachusetts, Pennsylvania, Texas, Virginia, Washington, Wisconsin
$135K - $165K / year
Staff Data Engineer, Data Platform
PostscriptSMS marketing platform for ecommerce companies. Helping Shopify stores drive 30x ROI with text message marketing.
Data Engineer59 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor
Staff Data Engineer leading data architecture at eCommerce SMS marketing platform
ApacheAWSCloudDistributed SystemsJavaKotlinNoSQLPostgresScalaSparkGo
Data Engineer
ComPsychThe World’s Largest Provider of Mental Health Services and GuidanceResources® for Life.
Data Engineer59 days ago
Full TimeRemoteTeam 1,001-5,000Since 1984H1B Sponsor
Data Engineer designing new data platforms and ETL pipelines at ComPsych
AzureETLNoSQLPythonSDLCSQL
Data Engineer59 days ago
Full TimeRemoteTeam 1-10Since 2025H1B No Sponsor
Senior Data Engineering & Architecture Consultant supporting analytics and platform initiatives at Phizenix