Bridgeway Benefit Technologies

Leader in technology solutions for the Taft-Hartley industry.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 201-500H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

42 days ago

Salary

Not specified

Bachelor Degree5 yrs expEnglishAirflowAzureKafkaPythonSparkSQLTableauTerraformUnity

Job Description

• Design, develop, and maintain a scalable data warehouse/lakehouse environment. • Design and implement ELT pipelines to ingest, transform, and deliver high-quality data for analytics and reporting, incorporating current best practices, such as “pipelines as code”. • Ensure data security and compliance, including role-based access controls for security, encryption, masking, and governance best practices to ensure compliant handling of sensitive information. • Optimize performance of data workflows and storage for cost efficiency and speed. • Partner with engineers, analysts, and stakeholders to meet data needs; balance cost, performance, simplicity, and time-to-value while mentoring teams and documenting standards. • Define and implement robust testing frameworks, enforce data contracts, and establish observability practices including lineage tracking, SLAs/SLOs, and incident response runbooks to maintain data integrity and trustworthiness. • Monitor, troubleshoot, and resolve data & automation issues. • Collaborate within an Agile-Scrum framework and develop comprehensive technical design documentation to ensure efficient and successful delivery. • Serve as a trusted expert on organizational data domains, processes, and best practices.

Job Requirements

  • 5+ years of experience in data engineering and ELT with a focus on large-scale data platforms
  • 3+ years of experience with Databricks
  • Advanced proficiency in analytical SQL, including ANSI SQL, T-SQL, and Spark SQL
  • Strong Python skills for data engineering
  • Expertise in data modeling
  • Hands-on experience with data quality and observability practices (tests, contracts, lineage tracking, alerts)
  • Practical knowledge of orchestration tools and CI/CD concepts for data workflows
  • Excellent communication and a track record of technical leadership and mentoring
  • Strong understanding of integrating data solutions with AI and machine learning models
  • Strong problem-solving skills and attention to detail.
  • Experience with version control systems like Git preferred
  • Strong understanding of data governance and best practices in data management, with hands-on experience using Unity Catalog
  • Hands-on experience in designing and managing data pipelines using Delta Live Tables (DLT) on Databricks
  • Streaming and ingestion tools, such as Kafka, Kinesis, Event Hubs, Debezium, or Fivetran
  • DAX, LookML, dbt; Airflow/Dagster/Prefect, Terraform; Azure DevOps; Power BI/Looker/Tableau; GitHub CoPilot knowledge is a plus
  • Bachelor’s degree in Computer Science, Information Technology, or a related field. Master’s degree preferred

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Engineer42 days ago
Full TimeRemoteTeam 10,001+Since 1969H1B No Sponsor

Retail Big Data Modeling Architect designing and implementing robust data models.

HadoopNoSQLSparkSQL
California + 1 moreAll locations: California, Texas

Senior Azure Data Engineer

Smartbridge

Simplifying business transformation through thought leadership and innovation. Bring your digital agenda to reality.

Data Engineer42 days ago
ContractRemoteTeam 51-200H1B Sponsor

Senior Azure Data Engineer designing and building Azure data platforms for Smartbridge

AzureETLPySparkPythonSQLVault
United States

Senior Data Engineer

CARE

We work to fight poverty and achieve social justice by empowering women and girls. www.CARE.org

Data Engineer42 days ago
Full TimeRemoteTeam 5,001-10,000Since 1945H1B Sponsor

Senior Data Engineer responsible for data pipelines at Care Access

AirflowAzureCloudPythonSQL
United States
$120K - $160K / year
Full TimeRemote

As a Data Operations Engineer, you will manage data acquisition, ensure data compliance, maintain data storage security, and collaborate with various teams to support operations.

Data Processing
District Of Columbia
$56K - $63K / year