Agility Robotics
We build robots made for work, engineered to work in nearly any environment, alongside people.
Senior Data Engineer
Location
United States
Posted
114 days ago
Salary
Not specified
Bachelor Degree5 yrs expEnglishAirflowApacheAWSCloudETLJavaPythonScalaSpark
Job Description
• Collaborate with robot software and hardware teams to define, collect, and curate data needed for analytics and debugging.
• Develop and maintain ETL pipelines that transform raw robot logs and telemetry into structured datasets using Spark, Airflow (or equivalent orchestration tools), and AWS data services.
• Contribute to on-robot data production workflows to ensure high-fidelity, well-structured data capture.
• Design derived datasets and transformations across Avro, Parquet, and other sensor data formats to power fleet operations, reliability analysis, and business metrics.
• Implement data quality checks, schema evolution, and metadata management practices using our internal Data Registry and cataloging systems.
• Work closely with the ingestion and storage services that move robot data into the cloud (S3-based data lake).
• Collaborate with internal consumers — reliability, analytics, and ML teams — to design efficient data models for their workflows.
• Occasionally contribute to shared libraries or APIs in Python, Java, or C++ to support data capture and consumption.
Job Requirements
- 5+ years of experience as a Data Engineer or similar role building and maintaining production data pipelines.
- Strong proficiency in Apache Spark or equivalent distributed data processing frameworks.
- Experience with Airflow, Dagster, Prefect, or other data orchestration systems.
- Proficiency with data formats such as Avro, Parquet, and structured/numeric datasets.
- Solid understanding of data modeling, schema evolution, and data quality best practices.
- Good intuitions of how to model datasets logically and partition them physically for optimal query performance.
- Strong programming skills in Python, Java and/or Scala.
- Experience with AWS data stack (S3, Glue, Athena, EMR, etc.) or similar cloud infrastructure.
- Experience working with vision data pipelines (e.g. Images, video, depth) and building derived datasets from them.
- Comfort working cross-functionally with software, hardware, and analytics teams in a fast-paced environment.
Benefits
- 401(k) Plan: Includes a 6% company match.
- Equity: Company stock options.
- Insurance Coverage: 100% company-paid medical, dental, vision, and short/long-term disability insurance for employees.
- Benefit Start Date: Eligible for benefits on your first day of employment.
- Well-Being Support: Employee Assistance Program (EAP).
- Time Off: Flexible, unlimited PTO and 10 company holidays, including a winter shutdown.
- On-Site Perks: Catered lunches four times a week and a variety of healthy snacks and refreshments at our Salem and Pittsburgh locations.
- Parental Leave: Generous paid parental leave programs.
- Work Environment: A culture that supports flexible work arrangements.
- Growth Opportunities: Professional development and tuition reimbursement programs.
- Relocation Assistance: Provided for eligible roles.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer, Infrastructure, Compliance
Sidekick HealthImproving health the fun way -- seriously!
Data Engineer114 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor
Senior Data Engineer focusing on data infrastructure at Sidekick Health
AWSBigQueryCloudETLKubernetesNoSQLPythonSQLTerraform
Minnesota
Staff Data Engineer
TonalMeet the Ultimate Strength Studio. Tonal's expert coaching and advanced digital weight allow you to #BeYourStrongest.
Data Engineer114 days ago
Full TimeRemoteTeam 501-1,000H1B Sponsor
Staff Data Engineer shaping Tonal’s data platform and systems
AirflowAmazon RedshiftPythonSparkSQL
Data Engineer115 days ago
Full TimeRemoteTeam 501-1,000Since 2015H1B Sponsor
Senior Data Engineer focusing on advertising products and data infrastructure
ETLPythonSQL
Data Engineer115 days ago
Full TimeRemoteTeam 5,001-10,000Since 1998H1B No Sponsor
Senior Big Data Engineer specializing in scalable batch data processing at Rackspace Technology
AirflowApacheCloudDistributed SystemsGoogle Cloud PlatformHadoopHBaseJavaMapReducePythonRedisSparkSQLTerraform