Kunai

20% of fortune 500 fintech trust Kunai for engineering talent.

Senior Data Engineer, AWS

Data EngineerData EngineerFull TimeRemoteTeam 51-200Since 2001H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

12 days ago

Salary

Not specified

Bachelor Degree8 yrs expExperience acceptedEnglishApacheAWSETLGoogle Cloud PlatformPythonScalaSpark

Job Description

• Own the technical strategy and execution of migrating large-scale data workloads from GCP to AWS, ensuring continuity, data integrity, and minimal disruption. • Design migration playbooks and serve as the go-to expert for decisions across compute, storage, and orchestration layers during the transition. • Architect and implement scalable batch and streaming data pipelines using Apache Spark, Delta Lake, and the medallion architecture. • Establish standards for pipeline design, data quality, and observability that the broader engineering organization can build on. • Take accountability for the reliability, performance, and cost-efficiency of production ETL jobs running on AWS (EMR, Glue) against terabyte-scale datasets. • Proactively identify and address bottlenecks, technical debt, and opportunities to improve throughput and resilience.

Job Requirements

  • Strong, hands-on Scala expertise with solid Python proficiency
  • Deep experience with Apache Spark for both streaming and batch data processing at scale
  • Proven track record running production ETL workloads on AWS (EMR, Glue) against terabytes of data
  • Experience designing and operating data architectures using Delta Lake and the medallion (Bronze / Silver / Gold) pattern
  • 8+ years of data engineering experience, with a track record of owning critical infrastructure end-to-end.

Benefits

  • Competitive compensation
  • Professional development opportunities
  • Flexible work arrangements

Related Categories

Related Job Pages

More Data Engineer Jobs

Architect, GCP Data Engineer

Think Future Technologies

Software Development and Testing Company

Data Engineer12 days ago
Full TimeRemoteTeam 201-500Since 2006H1B No Sponsor

GCP Data Engineer designing and building data platforms on Google Cloud

AirflowApacheBigQueryCloudGoogle Cloud PlatformPythonSQL
United States

Forward Deployed Data Engineer

Qventus, Inc

Your AI teammates to automate hospital operations.

Data Engineer12 days ago
Full TimeRemoteTeam 51-200Since 2012

Forward Deployed Data Engineer collaborating with clients to solve data challenges at Qventus

AirflowAmazon RedshiftAWSAzureCloudGoogle Cloud PlatformMongoDBMySQLPostgreSQLPythonSQL
United States
$140K - $220K / year

Senior Data Engineer – New Solutions

Qventus, Inc

Your AI teammates to automate hospital operations.

Data Engineer12 days ago
Full TimeRemoteTeam 51-200Since 2012

Senior Data Engineer developing data solutions for healthcare transformation

AWSCloudTableau
United States
$150K - $180K / year

Senior Data Engineer – Healthcare/Lifescience

SunnyData

With a strong Data Engineering backbone, we deliver Databricks projects from concept to production.

Data Engineer12 days ago
Full TimeRemoteTeam 51-200

Senior Data Engineer supporting clients with data engineering needs in healthcare.

AWSAzureCloudGoogle Cloud PlatformHadoopKafkaPandasScikit-LearnSparkSQL
United States