Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 10,001+Since 1919H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

2 days ago

Salary

$76.8K - $115.2K / year

Bachelor Degree5 yrs expEnglishApacheAWSAzureCloudETLPythonScalaSparkSQLUnity

Job Description

• Streamlining Data Integration You’ll design and automate scalable systems to ingest and transform data from diverse sources, ensuring seamless and efficient data flow across the organization. • Safeguarding Data Quality By implementing robust monitoring frameworks, you’ll proactively detect and resolve data integrity issues, maintaining trust in analytics and reporting. • Establishing Data Governance You’ll lead the development of governance processes to manage metadata, access, and retention, ensuring compliance and secure data usage for internal and external stakeholders. • Building Scalable Data Pipelines You’ll architect reliable and high-performance ETL/ELT pipelines with built-in monitoring and alerts, enabling timely and accurate data delivery for business needs. • Optimizing Database Design and Performance Through thoughtful physical data modeling and indexing strategies, you’ll enhance database efficiency and scalability for large-scale operations. • Modernizing Data Infrastructure You’ll develop and operate advanced storage and processing solutions using distributed and cloud platforms, supporting big data initiatives and analytics. • Automating Data Workflows By leveraging modern tools and techniques, you’ll reduce manual data preparation tasks, boosting productivity and minimizing errors. • Mentoring and Agile Collaboration You’ll coach junior team members and contribute to agile practices like DevOps and Scrum, accelerating delivery of critical analytics projects and fostering team growth.

Job Requirements

  • Minimum of 5 years of hands-on experience in data engineering with expertise in Azure Databricks and programming in Scala or Python.
  • Proven experience in building and maintaining structured streaming pipelines using Spark.
  • Strong knowledge of big data technologies, including Delta Lake, Apache Spark, Structured Streaming, and SQL.
  • Experience with Git for version control and CI/CD pipeline management.
  • Nice to Have (Preferences): Data Engineering Certification (e.g., Databricks Certified Data Engineer, Apache Spark Professional Data Engineer, or equivalent).
  • Exposure to real-time data ingestion frameworks and cloud-native data services (e.g., Azure Event Hub, Azure Data Lake, AWS SQS, etc).
  • Familiarity with data governance, access control (e.g., Unity Catalog or Immuta), and performance monitoring tools in cloud environments.

Related Categories

Related Job Pages

More Data Engineer Jobs

Principal Data Architect

Unqork

Using CaaS (Codeless-as-a-Service) to accelerate time-to-market & eliminate legacy code for the enterprise 🚀

Data Engineer2 days ago
Full TimeRemoteTeam 201-500Since 2017H1B Sponsor

We're seeking an experienced, visionary Principal Data Architect and Leader to drive the strategy, design, and operations of our enterprise-grade data architecture and infrastructure. This critical role leads our data functions, ensuring our platform provides a robust, scalable, ...

United States
$215.1K - $286.2K / year

Senior Data Engineer

ActBlue

ActBlue is a nonprofit tech organization working to help Democratic campaigns, progressive organizations, and nonprofits build campaigns fueled by small-dollar donors. Our tools make it possible for anyone to build a grassroots campaign or movement and give donors an easy and secure way to support their favorite candidates and causes.

Data Engineer2 days ago
Full TimeRemoteTeam 201-500Since 2004H1B No Sponsor

Senior Data Engineer II building data products at ActBlue

Amazon RedshiftDistributed SystemsETLPostgreSQLPythonSQL
Arizona + 27 moreAll locations: Arizona, California, Colorado, Connecticut, Florida, Hawaii, Illinois, New Hampshire, New Jersey, New York, North Carolina, North Dakota, Ohio, Oregon, Maryland, Massachusetts, Michigan, Minnesota, Missouri, Pennsylvania, Rhode Island, South Carolina, Texas, Utah, Vermont, Virginia, Washington, Wisconsin
$173.7K - $210.7K / year

Databricks Architect

Stitch

We help marketers get more from their tech stacks — with a focus on driving success with Braze and Segment.

Data Engineer2 days ago
Full TimeRemoteTeam 11-50H1B Sponsor

Stitch is the global leader in helping brands drive CRM performance through Braze and Databricks. We work with Fortune 1000 brands to design and execute martech-driven solutions and lifecycle marketing strategies that drive meaningful outcomes—producin...

United States

Senior Data Engineer

Highmark Health

Creating remarkable health experiences, freeing people to be their best.

Data Engineer2 days ago
Full TimeRemoteTeam 10,001+Since 1852H1B Sponsor

The Senior FHIR Interoperability Engineer will design, develop, and maintain robust data processes and solutions for the efficient movement and transformation of complex healthcare data using FHIR standards. This includes developing data models, collaborating with stakeholders to gather requirements, and implementing data governance practices to ensure quality and compliance.

United States
$78.9K - $147K / year