Agility Robotics

We build robots made for work, engineered to work in nearly any environment, alongside people.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 201-500Since 2017H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

115 days ago

Salary

Not specified

Bachelor Degree5 yrs expEnglishAirflowApacheAWSCloudETLJavaPythonScalaSpark

Job Description

• Collaborate with robot software and hardware teams to define, collect, and curate data needed for analytics and debugging. • Develop and maintain ETL pipelines that transform raw robot logs and telemetry into structured datasets using Spark, Airflow (or equivalent orchestration tools), and AWS data services. • Contribute to on-robot data production workflows to ensure high-fidelity, well-structured data capture. • Design derived datasets and transformations across Avro, Parquet, and other sensor data formats to power fleet operations, reliability analysis, and business metrics. • Implement data quality checks, schema evolution, and metadata management practices using our internal Data Registry and cataloging systems. • Work closely with the ingestion and storage services that move robot data into the cloud (S3-based data lake). • Collaborate with internal consumers — reliability, analytics, and ML teams — to design efficient data models for their workflows. • Occasionally contribute to shared libraries or APIs in Python, Java, or C++ to support data capture and consumption.

Job Requirements

  • 5+ years of experience as a Data Engineer or similar role building and maintaining production data pipelines.
  • Strong proficiency in Apache Spark or equivalent distributed data processing frameworks.
  • Experience with Airflow, Dagster, Prefect, or other data orchestration systems.
  • Proficiency with data formats such as Avro, Parquet, and structured/numeric datasets.
  • Solid understanding of data modeling, schema evolution, and data quality best practices.
  • Good intuitions of how to model datasets logically and partition them physically for optimal query performance.
  • Strong programming skills in Python, Java and/or Scala.
  • Experience with AWS data stack (S3, Glue, Athena, EMR, etc.) or similar cloud infrastructure.
  • Experience working with vision data pipelines (e.g. Images, video, depth) and building derived datasets from them.
  • Comfort working cross-functionally with software, hardware, and analytics teams in a fast-paced environment.

Benefits

  • 401(k) Plan: Includes a 6% company match.
  • Equity: Company stock options.
  • Insurance Coverage: 100% company-paid medical, dental, vision, and short/long-term disability insurance for employees.
  • Benefit Start Date: Eligible for benefits on your first day of employment.
  • Well-Being Support: Employee Assistance Program (EAP).
  • Time Off: Flexible, unlimited PTO and 10 company holidays, including a winter shutdown.
  • On-Site Perks: Catered lunches four times a week and a variety of healthy snacks and refreshments at our Salem and Pittsburgh locations.
  • Parental Leave: Generous paid parental leave programs.
  • Work Environment: A culture that supports flexible work arrangements.
  • Growth Opportunities: Professional development and tuition reimbursement programs.
  • Relocation Assistance: Provided for eligible roles.

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer, Infrastructure, Compliance

Sidekick Health

Improving health the fun way -- seriously!

Data Engineer115 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor

Senior Data Engineer focusing on data infrastructure at Sidekick Health

AWSBigQueryCloudETLKubernetesNoSQLPythonSQLTerraform
Minnesota

Staff Data Engineer

Tonal

Meet the Ultimate Strength Studio. Tonal's expert coaching and advanced digital weight allow you to #BeYourStrongest.

Data Engineer115 days ago
Full TimeRemoteTeam 501-1,000H1B Sponsor

Staff Data Engineer shaping Tonal’s data platform and systems

AirflowAmazon RedshiftPythonSparkSQL
California
$200K - $235K / year
Data Engineer115 days ago
Full TimeRemoteTeam 501-1,000Since 2015H1B Sponsor

Senior Data Engineer focusing on advertising products and data infrastructure

ETLPythonSQL
California
$248K - $279K / year
Data Engineer115 days ago
Full TimeRemoteTeam 5,001-10,000Since 1998H1B No Sponsor

Senior Big Data Engineer specializing in scalable batch data processing at Rackspace Technology

AirflowApacheCloudDistributed SystemsGoogle Cloud PlatformHadoopHBaseJavaMapReducePythonRedisSparkSQLTerraform
United States
$116.1K - $198.4K / year