Abnormal Security

Abnormally-Precise, Cloud-Native Email Security

Senior Software Engineer – Data Engineering

Data EngineerData EngineerFull TimeRemoteTeam 501-1,000H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

96 days ago

Salary

$176K - $207K / year

Bachelor Degree6 yrs expEnglishAirflowAWSDistributed SystemsPy SparkPythonSparkSQL

Job Description

• Own mission-critical pipeline reliability: Take end-to-end ownership of our production data pipelines processing billions of messages weekly, ensuring 99.9% uptime for revenue-critical pipelines that directly enable sales and customer-facing AI products • Build self-healing pipelines: Design and implement automated monitoring, testing, and recovery systems for data pipelines that eliminate manual intervention and reduce MTTR from hours to minutes • Accelerate development velocity: Deploy CI/CD pipelines and self-service platforms that reduce deployment time from 3-5 days to under 2 hours, enabling Data Scientists to safely deploy models without engineering bottlenecks • Architect for scale: Optimize data pipelines handling exponential annual growth, implementing cost-effective solutions that support regional expansion and compliance requirements (GDPR, FedRAMP, SOC2) • Bridge technical and business domains: Partner with Sales, Finance, and Product teams to ensure data infrastructure aligns with business needs, making critical trade-off decisions when pipelines impact revenue • Establish data engineering excellence: Define best practices for dbt, Airflow, Spark usage, PII anonymization, and cross-divisional data sharing while mentoring embedded Data Guild team members on these. • Enable AI and accessible data consumption: Design and maintain an accessible semantic layer that provides consistent, trustworthy definitions and abstractions, making it easy for stakeholders to consume data and incorporate AI-driven insights into their workflows.

Job Requirements

  • 6+ years of software engineering experience in backend, distributed systems, or data-focused roles.
  • Proven experience designing and running large-scale, production-grade data pipelines.
  • Proficiency in our stack: Python, Spark/PySpark, Airflow, SQL, dbt, Databricks, Snowflake, AWS.
  • Proven track record of driving pipeline reliability to 99%+ uptime, including SLAs, observability tooling, and automated recovery patterns.
  • Strong systems-thinking skills with the ability to debug complex distributed systems, optimize for performance and cost, and make architectural decisions balancing short-term needs with long-term scalability.
  • Demonstrated ownership mindset and ability to drive projects from conception to production independently, including on-call responsibilities for critical systems.
  • Experience collaborating with Data Science, Analytics, Product, Finance, Marketing, and Sales, along with the ability to communicate technical decisions clearly to non-technical stakeholders and executives.
  • Bachelor’s degree in Computer Science, Applied Sciences, Information Systems or other related quantitative fields.

Benefits

  • Bonus
  • Restricted stock units (RSUs)

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Architect

Dynatron Software, Inc.

Dealership Fixed-Ops profit maximizing solutions that integrate Technology, Data Analysis, and Coaching Expertise

Data Engineer96 days ago
Full TimeRemoteTeam 51-200Since 1999H1B No Sponsor

Experienced Data Architect designing enterprise data architecture for a SaaS company

Amazon RedshiftAWSAzureBigQueryCloudDistributed SystemsGoogle Cloud PlatformKafkaPulsarPythonScalaSQLVault
United States
$140K - $180K / year

Chief Data Architect

OSC Edge

We Engineer Solutions! IT, Cyber, Cloud.

Data Engineer100 days ago
Full TimeRemoteTeam 51-200Since 2008H1B No Sponsor

Chief Data Architect leading data strategy and architecture for OSC Edge

TypeScript
United States

Senior Data Architect, Strategist

Gugu Robotics

The Future is Now; Beyond Boundaries, Beyond Imagination

Data Engineer101 days ago
Full TimeRemoteTeam 51-200Since 2016H1B No Sponsor

Senior Data Architect/Strategist blending data knowledge with business problem solving.

AWSAzureCloudGoogle Cloud PlatformPythonPyTorchScikit-LearnTensorflow
United States

Data Operations Engineer Intern – Spring/Summer 2026

AccuWeather

The world’s largest and fastest-growing weather and digital media company.

Data Engineer101 days ago
InternshipRemoteTeam 501-1,000Since 1962H1B Sponsor

Intern supporting data operations and automation processes at AccuWeather

PythonSQL
Pennsylvania