Sharecare

All Together Better.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 1,001-5,000Since 2010H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

35 days ago

Salary

Not specified

Bachelor Degree10 yrs expEnglishAirflowAmazon RedshiftApacheAWSAzureCloudDistributed SystemsETLFlaskGoogle Cloud PlatformPandasPythonSparkSQL.net

Job Description

• Design, build, and maintain scalable data pipelines using Python, Apache Airflow, and Apache Spark • Analyze business and technical requirements and translate them into reliable, future-proof data solutions • Develop, validate, deploy, and support complex ETL/ELT pipelines at scale • Build clean, secure, and maintainable REST APIs following company standards • Implement real-time and batch processing solutions for diverse data sources • Develop reusable data engineering and AI frameworks for enterprise-wide adoption • Define and manage domain-based “source of truth” data models, ensuring scalability and end-to-end data lineage • Implement data governance practices, automate data quality checks, and enable pipeline testing • Optimize data infrastructure for performance, cost efficiency, and reliability • Manage source control, CI/CD pipelines, and production deployments • Partner with data scientists and analysts to support AI/ML initiatives

Job Requirements

  • Bachelor’s degree (or higher) in Computer Science, Data Engineering, or a related field
  • 10+ years of experience in data engineering or related roles
  • Strong proficiency in Python and related libraries (Pandas, SQLAlchemy, Boto3, Paramiko, Flask, FastAPI)
  • Advanced SQL skills with experience analyzing healthcare datasets (e.g., claims, provider directories)
  • Hands-on experience with orchestration tools such as Apache Airflow and Databricks Workflows
  • Strong experience with Apache Spark; exposure to Apache Flink is a plus
  • Experience integrating with .NET applications and working with SQL Server
  • Cloud platform experience (AWS, Azure, or GCP required)
  • Experience with data warehousing solutions such as Amazon Redshift or Vertica
  • Solid understanding of distributed systems and functional programming concepts
  • Proficiency with Git and modern CI/CD practices
  • Exposure to streaming technologies, containerization, and ML pipelines preferred
  • Familiarity with AI tools and large language models is a plus

Benefits

  • Equal Opportunity Employer
  • E-Verify user
  • Work-life balance

Related Categories

Related Job Pages

More Data Engineer Jobs

Staff Data Engineer – Science

Exact Sciences

Changing the way we think about detecting and treating cancer.

Data Engineer35 days ago
Full TimeRemoteTeam 5,001-10,000Since 1995H1B Sponsor

Staff Data Engineer developing software applications for cancer detection

AWSCloudETLNoSQLPythonScalaSparkSQLTableau
California + 1 moreAll locations: California, Wisconsin
$154.4K - $231.6K / year

Data Architect – MS Fabric

EXL

We make sense of data to drive your business forward. #MakeSenseofData #DriveYourBusinessForward #PartnerYourWay

Data Engineer36 days ago
Full TimeRemoteTeam 10,001+H1B No Sponsor

Lead operational analytics strategy in US-based company

New Jersey

Snowflake Data Architect

Datavail

We help clients turn data into decisions no matter where it lives-in apps, on-prem, in a hybrid model, or in the cloud.

Data Engineer36 days ago
Full TimeRemoteTeam 1,001-5,000Since 2007H1B Sponsor

Snowflake Architect building healthcare data ecosystems for Datavail

Cloud
United States

Verint Reports Engineer

Five9

Helping Companies Bring Joy to CX.

Data Engineer36 days ago
Full TimeRemoteTeam 1,001-5,000Since 2001H1B Sponsor

As a Verint Reports Engineer, you will support the development and deployment of custom Verint and Five9 VO reporting solutions for our clients. You will work under the guidance of senior engineers to collect requirements, build and test SQL-based reports, and ensure successful i...

SQLVerint WFOFive9 VOQuery Tuning
United States
$82.3K - $228.8K / year