Architecting intelligent IT solutions in Enterprise Security, Modern Infrastructure & Platform Engineering.

Senior Data Engineer

Data EngineerData EngineerContractRemoteTeam 201-500H1B No SponsorCompany Site LinkedIn

Location

New York

Posted

38 days ago

Salary

Not specified

EnglishAWSCloudEC2Py SparkSQLTerraformUnity

Job Description

• Design and implement declarative data pipelines using Lakeflow and Databricks Asset Bundles (DABs) • Build efficient, scalable ingestion patterns using AutoLoader and Change Data Capture (CDC) • Manage metadata, lineage, and access control through Unity Catalog • Develop and maintain complex workflows using Databricks Jobs and orchestration tools • Utilize Terraform to manage AWS resources (S3, EC2) and Databricks workspaces

Job Requirements

Deep mastery of PySpark and advanced SQL
Extensive experience in the Databricks environment (Workflows, Delta Lake)
Familiarity with AWS infrastructure and cloud-native data patterns

Related Categories

Data Engineer

Related Job Pages

Data Engineer Jobs in New York More US Remote Jobs

More Data Engineer Jobs

Data Engineer – GCP, Junior/Senior

Keyrus

#MakeDataMatter #HumanizingTheFuture

Data Engineer38 days ago

Full TimeRemoteTeam 1,001-5,000Since 1996H1B Sponsor

Company Site LinkedIn

Data Engineer designing scalable data pipelines in GCP environments

BigQueryCloudGoogle Cloud PlatformPythonSparkSQLVault

View details: Data Engineer – GCP, Junior/Senior

United States

Apply

Data Architect

Quantiphi

Pioneering AI-first solutions, solving complex business challenges through expertise, cloud, data engineering, and AI.

Data Engineer38 days ago

Full TimeRemoteTeam 1,001-5,000Since 2013H1B Sponsor

Company Site LinkedIn

Data Architect designing scalable data platforms using Alibaba Cloud at Quantiphi

AWSAzureCloudDistributed SystemsDockerETLGoogle Cloud PlatformJavaKubernetesMongoDBMySQLNoSQLPostgresPythonScalaSQL

View details: Data Architect

United States

Apply

Oracle Data Integration Developer

CGI

Data Engineer38 days ago

Full TimeRemoteTeam 10,001+Since 1976H1B Sponsor

Company Site LinkedIn

We are seeking an Oracle Data Integration Developer who is responsible for developing, maintaining, and supporting data integration (ETL/ELT) solutions using Oracle Data Integrator (ODI). This role focuses on implementing data pipelines that load and transform data from multiple ...

Oracle Data IntegratorODISQLPL/SQLdata warehousingETLELTchange data captureOracle Cloud Infrastructure

View details: Oracle Data Integration Developer

United States

Apply