AWS Data Engineer
Location
United States
Posted
42 days ago
Salary
Not specified
Postgraduate Degree10 yrs expEnglishAmazon RedshiftAWSCloudETLPythonTableau
Job Description
• Lead and support the delivery of data platform modernization projects.
• Design and develop robust and scalable data pipelines leveraging AWS native services.
• Optimize ETL processes, ensuring efficient data transformation.
• Migrate workflows from on-premise to AWS cloud, ensuring data quality and consistency.
• Design automations and integrations to resolve data inconsistencies and quality issues
• Perform system testing and validation to ensure successful integration and functionality.
• Implement security and compliance controls in the cloud environment.
• Ensure data quality pre- and post-migration through validation checks and addressing issues regarding completeness, consistency, and accuracy of data sets.
• Collaborate with data architects and lead developers to identify and document manual data movement workflows and design automation strategies.
Job Requirements
- 10+ years’ experience with a core data engineering skillset leveraging AWS native technologies (AWS Glue, Python, Snowflake, S3, Redshift).
- Experience in the design and development of robust and scalable data pipelines leveraging AWS native services.
- Proficiency in leveraging Snowflake for data transformations, optimization of ETL pipelines, and scalable data processing.
- Experience with streaming and batch data pipeline/engineering architectures.
- Familiarity with DataOps concepts and tooling for source control and setting up CI/CD pipelines on AWS.
- Hands-on experience with Databricks and a willingness to grow capabilities.
- Experience with data engineering and storage solutions (AWS Glue, EMR, Lambda, Redshift, S3).
- Strong problem-solving and analytical skills.
- Knowledge of Dataiku is needed
- Graduate/Post-Graduate degree in Computer Science or a related field.
- AWS S3 (data storage, export, recall)
- Athena (querying data lakes)
- Data pipelines (batch & near-real-time)
- Integration with external systems (FHIR)
- Secure data handling (KMS, Macie)
- Cloud-native analytics
- Multi-account, multi-region data architecture
- BI integrations: Power BI, Tableau, QuickSight
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer42 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor
Senior Data Engineer utilizing Databricks for data processing and analytics
AWSAzureBigQueryCloudETLGoogle Cloud PlatformPythonScalaSQLUnity
Member of Technical Staff – Reporting & Statements, Data Engineer
Anchorage DigitalTrusted institutional partner in crypto and first federally chartered crypto bank
Data Engineer42 days ago
Full TimeRemoteTeam 201-500Since 2017H1B Sponsor
Founding engineer on Reporting & Statements team at Anchorage Digital
AirflowBigQueryCloudPandasPythonSQL
United States
SAP Data Migration Specialist
Enterprise Horizon Consulting GroupEnterprise Horizon solves complex IT and business challenges for the DoD, Federal, and Private sectors.
Data Engineer42 days ago
ContractRemoteTeam 11-50Since 2005H1B No Sponsor
SAP Data Migration Specialist supporting SAP S/4 HANA transformation programs
ETLSQL
Alabama
Data Engineer43 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor
Manager of Data Engineering leading a team in data product development
PythonSQLTableau