CompuGain

Deliver game-changing modern applications with Unisys

Lead Data Engineer, Databricks – Manufacturing/MES

Data EngineerData EngineerContractRemoteTeam 201-500H1B SponsorCompany SiteLinkedIn

Location

California

Posted

4 days ago

Salary

Not specified

EnglishAzureCloudERPIo TPy SparkSparkSQL

Job Description

• Design, build, and optimize scalable data pipelines using Azure Databricks (PySpark, Spark SQL, Delta Lake)• Integrate and process MES data, shop-floor data, IoT/sensor data, and ERP systems• Architect modern data solutions supporting manufacturing analytics and operational reporting• Lead data engineering best practices including performance tuning, optimization, and governance• Work closely with manufacturing stakeholders to translate MES data requirements into scalable data models• Ensure high data quality, reliability, and production-grade deployments.

Job Requirements

  • Strong hands-on expertise in Azure Databricks (Delta Lake, PySpark, Spark architecture)
  • Proven experience in Manufacturing domain, especially working with MES systems and production data
  • Experience building real-time or near-real-time data pipelines
  • Strong SQL and data modeling skills
  • Experience with cloud platforms (Azure preferred)
  • Ability to function as both technical architect and hands-on developer
  • Excellent communication skills and ability to work in PST time zone
  • Preferred: Experience with IoT data ingestion and streaming technologies
  • Exposure to data warehousing and BI integration
  • Experience leading small data engineering team

Benefits

  • All your information will be kept confidential according to EEO guidelines.

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Engineer4 days ago
Full TimeRemote

The Python Developer is tasked with designing, developing, and implementing Python-based automation for the reconciliation process, which includes building robust, scalable ETL data pipelines to integrate data from various sources. This role involves developing, testing, and deploying Python automation scripts and workflows while collaborating with technical leads to ensure solution maintainability and performance enhancement.

PythonSQLETLDatabricksApache AirflowAWSAWS LambdaAmazon S3
United States
$110K - $125K / year
Full TimeRemote

The developer will design, build, and maintain PowerApps solutions and Power BI dashboards integrating operational and financial data to provide actionable insights for stakeholders. Key duties include developing PowerApps applications for workflow automation and building/optimizing dashboards using visualization tools like Power BI.

PowerAppsPower BITableauQlikExcelPower AutomateSharePoint
United States
$120K - $130K / year

B2B Data Engineering Lead

dentsu Austria

Champions of meaningful progress.

Data Engineer4 days ago
Full TimeRemoteTeam 51-200Since 1900H1B No Sponsor

Data Engineering Lead for B2B Data Products designing and scaling data solutions

CloudPythonSQL
North Carolina
$94K - $121K / year

Data Engineer

CACI International Inc

Expertise and Technology for National Security

Data Engineer4 days ago
Full TimeRemoteTeam 10,001+Since 1962H1B No Sponsor

Data Engineer designing and maintaining scalable data pipelines at CACI

ApachePythonSparkSQL
United States
$63.3K - $129.7K / year