Abnormal Security
Abnormally-Precise, Cloud-Native Email Security
Senior Software Engineer – Data Engineering
Location
United States
Posted
96 days ago
Salary
$176K - $207K / year
Bachelor Degree6 yrs expEnglishAirflowAWSDistributed SystemsPy SparkPythonSparkSQL
Job Description
• Own mission-critical pipeline reliability: Take end-to-end ownership of our production data pipelines processing billions of messages weekly, ensuring 99.9% uptime for revenue-critical pipelines that directly enable sales and customer-facing AI products
• Build self-healing pipelines: Design and implement automated monitoring, testing, and recovery systems for data pipelines that eliminate manual intervention and reduce MTTR from hours to minutes
• Accelerate development velocity: Deploy CI/CD pipelines and self-service platforms that reduce deployment time from 3-5 days to under 2 hours, enabling Data Scientists to safely deploy models without engineering bottlenecks
• Architect for scale: Optimize data pipelines handling exponential annual growth, implementing cost-effective solutions that support regional expansion and compliance requirements (GDPR, FedRAMP, SOC2)
• Bridge technical and business domains: Partner with Sales, Finance, and Product teams to ensure data infrastructure aligns with business needs, making critical trade-off decisions when pipelines impact revenue
• Establish data engineering excellence: Define best practices for dbt, Airflow, Spark usage, PII anonymization, and cross-divisional data sharing while mentoring embedded Data Guild team members on these.
• Enable AI and accessible data consumption: Design and maintain an accessible semantic layer that provides consistent, trustworthy definitions and abstractions, making it easy for stakeholders to consume data and incorporate AI-driven insights into their workflows.
Job Requirements
- 6+ years of software engineering experience in backend, distributed systems, or data-focused roles.
- Proven experience designing and running large-scale, production-grade data pipelines.
- Proficiency in our stack: Python, Spark/PySpark, Airflow, SQL, dbt, Databricks, Snowflake, AWS.
- Proven track record of driving pipeline reliability to 99%+ uptime, including SLAs, observability tooling, and automated recovery patterns.
- Strong systems-thinking skills with the ability to debug complex distributed systems, optimize for performance and cost, and make architectural decisions balancing short-term needs with long-term scalability.
- Demonstrated ownership mindset and ability to drive projects from conception to production independently, including on-call responsibilities for critical systems.
- Experience collaborating with Data Science, Analytics, Product, Finance, Marketing, and Sales, along with the ability to communicate technical decisions clearly to non-technical stakeholders and executives.
- Bachelor’s degree in Computer Science, Applied Sciences, Information Systems or other related quantitative fields.
Benefits
- Bonus
- Restricted stock units (RSUs)
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Architect
Dynatron Software, Inc.Dealership Fixed-Ops profit maximizing solutions that integrate Technology, Data Analysis, and Coaching Expertise
Data Engineer96 days ago
Full TimeRemoteTeam 51-200Since 1999H1B No Sponsor
Experienced Data Architect designing enterprise data architecture for a SaaS company
Amazon RedshiftAWSAzureBigQueryCloudDistributed SystemsGoogle Cloud PlatformKafkaPulsarPythonScalaSQLVault
Data Engineer100 days ago
Full TimeRemoteTeam 51-200Since 2008H1B No Sponsor
Chief Data Architect leading data strategy and architecture for OSC Edge
TypeScript
United States
Senior Data Architect, Strategist
Gugu RoboticsThe Future is Now; Beyond Boundaries, Beyond Imagination
Data Engineer101 days ago
Full TimeRemoteTeam 51-200Since 2016H1B No Sponsor
Senior Data Architect/Strategist blending data knowledge with business problem solving.
AWSAzureCloudGoogle Cloud PlatformPythonPyTorchScikit-LearnTensorflow
United States
Data Operations Engineer Intern – Spring/Summer 2026
AccuWeatherThe world’s largest and fastest-growing weather and digital media company.
Data Engineer101 days ago
InternshipRemoteTeam 501-1,000Since 1962H1B Sponsor
Intern supporting data operations and automation processes at AccuWeather
PythonSQL
Pennsylvania