Kunai
20% of fortune 500 fintech trust Kunai for engineering talent.
Senior Data Engineer, AWS
Location
United States
Posted
12 days ago
Salary
Not specified
Bachelor Degree8 yrs expExperience acceptedEnglishApacheAWSETLGoogle Cloud PlatformPythonScalaSpark
Job Description
• Own the technical strategy and execution of migrating large-scale data workloads from GCP to AWS, ensuring continuity, data integrity, and minimal disruption.
• Design migration playbooks and serve as the go-to expert for decisions across compute, storage, and orchestration layers during the transition.
• Architect and implement scalable batch and streaming data pipelines using Apache Spark, Delta Lake, and the medallion architecture.
• Establish standards for pipeline design, data quality, and observability that the broader engineering organization can build on.
• Take accountability for the reliability, performance, and cost-efficiency of production ETL jobs running on AWS (EMR, Glue) against terabyte-scale datasets.
• Proactively identify and address bottlenecks, technical debt, and opportunities to improve throughput and resilience.
Job Requirements
- Strong, hands-on Scala expertise with solid Python proficiency
- Deep experience with Apache Spark for both streaming and batch data processing at scale
- Proven track record running production ETL workloads on AWS (EMR, Glue) against terabytes of data
- Experience designing and operating data architectures using Delta Lake and the medallion (Bronze / Silver / Gold) pattern
- 8+ years of data engineering experience, with a track record of owning critical infrastructure end-to-end.
Benefits
- Competitive compensation
- Professional development opportunities
- Flexible work arrangements
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer12 days ago
Full TimeRemoteTeam 201-500Since 2006H1B No Sponsor
GCP Data Engineer designing and building data platforms on Google Cloud
AirflowApacheBigQueryCloudGoogle Cloud PlatformPythonSQL
United States
Data Engineer12 days ago
Full TimeRemoteTeam 51-200Since 2012
Forward Deployed Data Engineer collaborating with clients to solve data challenges at Qventus
AirflowAmazon RedshiftAWSAzureCloudGoogle Cloud PlatformMongoDBMySQLPostgreSQLPythonSQL
Data Engineer12 days ago
Full TimeRemoteTeam 51-200Since 2012
Senior Data Engineer developing data solutions for healthcare transformation
AWSCloudTableau
Senior Data Engineer – Healthcare/Lifescience
SunnyDataWith a strong Data Engineering backbone, we deliver Databricks projects from concept to production.
Data Engineer12 days ago
Full TimeRemoteTeam 51-200
Senior Data Engineer supporting clients with data engineering needs in healthcare.
AWSAzureCloudGoogle Cloud PlatformHadoopKafkaPandasScikit-LearnSparkSQL
United States