Abnormal Security logo
Abnormal Security

Abnormally-Precise, Cloud-Native Email Security

Senior Software Engineer – Data Engineering

Data EngineerData EngineerFull TimeRemoteSeniorTeam 501-1,000H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

100 days ago

Salary

$176K - $207K / year

Seniority

Senior

Bachelor Degree6 yrs expEnglishAirflowAWSDistributed SystemsPySparkPythonSparkSQL

Job Description

• Own mission-critical pipeline reliability: Take end-to-end ownership of our production data pipelines processing billions of messages weekly, ensuring 99.9% uptime for revenue-critical pipelines that directly enable sales and customer-facing AI products • Build self-healing pipelines: Design and implement automated monitoring, testing, and recovery systems for data pipelines that eliminate manual intervention and reduce MTTR from hours to minutes • Accelerate development velocity: Deploy CI/CD pipelines and self-service platforms that reduce deployment time from 3-5 days to under 2 hours, enabling Data Scientists to safely deploy models without engineering bottlenecks • Architect for scale: Optimize data pipelines handling exponential annual growth, implementing cost-effective solutions that support regional expansion and compliance requirements (GDPR, FedRAMP, SOC2) • Bridge technical and business domains: Partner with Sales, Finance, and Product teams to ensure data infrastructure aligns with business needs, making critical trade-off decisions when pipelines impact revenue • Establish data engineering excellence: Define best practices for dbt, Airflow, Spark usage, PII anonymization, and cross-divisional data sharing while mentoring embedded Data Guild team members on these. • Enable AI and accessible data consumption: Design and maintain an accessible semantic layer that provides consistent, trustworthy definitions and abstractions, making it easy for stakeholders to consume data and incorporate AI-driven insights into their workflows.

Job Requirements

  • 6+ years of software engineering experience in backend, distributed systems, or data-focused roles.
  • Proven experience designing and running large-scale, production-grade data pipelines.
  • Proficiency in our stack: Python, Spark/PySpark, Airflow, SQL, dbt, Databricks, Snowflake, AWS.
  • Proven track record of driving pipeline reliability to 99%+ uptime, including SLAs, observability tooling, and automated recovery patterns.
  • Strong systems-thinking skills with the ability to debug complex distributed systems, optimize for performance and cost, and make architectural decisions balancing short-term needs with long-term scalability.
  • Demonstrated ownership mindset and ability to drive projects from conception to production independently, including on-call responsibilities for critical systems.
  • Experience collaborating with Data Science, Analytics, Product, Finance, Marketing, and Sales, along with the ability to communicate technical decisions clearly to non-technical stakeholders and executives.
  • Bachelor’s degree in Computer Science, Applied Sciences, Information Systems or other related quantitative fields.

Benefits

  • Bonus
  • Restricted stock units (RSUs)

Related Categories

Related Job Pages

More Data Engineer Jobs

Dynatron Software, Inc. logo

Data Architect

Dynatron Software, Inc.

Dealership Fixed-Ops profit maximizing solutions that integrate Technology, Data Analysis, and Coaching Expertise

Data Engineer100 days ago
Full TimeRemoteTeam 51-200Since 1999H1B No Sponsor

Experienced Data Architect designing enterprise data architecture for a SaaS company

Amazon RedshiftAWSAzureBigQueryCloudDistributed SystemsGoogle Cloud PlatformKafkaPulsarPythonScalaSQLVault
United States
$140K - $180K / year
OSC Edge logo

Chief Data Architect

OSC Edge

We Engineer Solutions! IT, Cyber, Cloud.

Data Engineer104 days ago
Full TimeRemoteTeam 51-200Since 2008H1B No Sponsor

Chief Data Architect leading data strategy and architecture for OSC Edge

TypeScript
United States
Gugu Robotics logo

Senior Data Architect, Strategist

Gugu Robotics

The Future is Now; Beyond Boundaries, Beyond Imagination

Data Engineer105 days ago
Full TimeRemoteTeam 51-200Since 2016H1B No Sponsor

Senior Data Architect/Strategist blending data knowledge with business problem solving.

AWSAzureCloudGoogle Cloud PlatformPythonPyTorchScikit-LearnTensorflow
United States
AccuWeather logo

Data Operations Engineer Intern – Spring/Summer 2026

AccuWeather

The world’s largest and fastest-growing weather and digital media company.

Data Engineer105 days ago
InternshipRemoteTeam 501-1,000Since 1962H1B Sponsor

Intern supporting data operations and automation processes at AccuWeather

PythonSQL
Pennsylvania