AWS Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 11-50H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

42 days ago

Salary

Not specified

Postgraduate Degree10 yrs expEnglishAmazon RedshiftAWSCloudETLPythonTableau

Job Description

• Lead and support the delivery of data platform modernization projects. • Design and develop robust and scalable data pipelines leveraging AWS native services. • Optimize ETL processes, ensuring efficient data transformation. • Migrate workflows from on-premise to AWS cloud, ensuring data quality and consistency. • Design automations and integrations to resolve data inconsistencies and quality issues • Perform system testing and validation to ensure successful integration and functionality. • Implement security and compliance controls in the cloud environment. • Ensure data quality pre- and post-migration through validation checks and addressing issues regarding completeness, consistency, and accuracy of data sets. • Collaborate with data architects and lead developers to identify and document manual data movement workflows and design automation strategies.

Job Requirements

  • 10+ years’ experience with a core data engineering skillset leveraging AWS native technologies (AWS Glue, Python, Snowflake, S3, Redshift).
  • Experience in the design and development of robust and scalable data pipelines leveraging AWS native services.
  • Proficiency in leveraging Snowflake for data transformations, optimization of ETL pipelines, and scalable data processing.
  • Experience with streaming and batch data pipeline/engineering architectures.
  • Familiarity with DataOps concepts and tooling for source control and setting up CI/CD pipelines on AWS.
  • Hands-on experience with Databricks and a willingness to grow capabilities.
  • Experience with data engineering and storage solutions (AWS Glue, EMR, Lambda, Redshift, S3).
  • Strong problem-solving and analytical skills.
  • Knowledge of Dataiku is needed
  • Graduate/Post-Graduate degree in Computer Science or a related field.
  • AWS S3 (data storage, export, recall)
  • Athena (querying data lakes)
  • Data pipelines (batch & near-real-time)
  • Integration with external systems (FHIR)
  • Secure data handling (KMS, Macie)
  • Cloud-native analytics
  • Multi-account, multi-region data architecture
  • BI integrations: Power BI, Tableau, QuickSight

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 11-50H1B No Sponsor

Senior Data Engineer utilizing Databricks for data processing and analytics

AWSAzureBigQueryCloudETLGoogle Cloud PlatformPythonScalaSQLUnity
California + 2 moreAll locations: California, Pennsylvania, Texas
$100.7K - $155.1K / year

Member of Technical Staff – Reporting & Statements, Data Engineer

Anchorage Digital

Trusted institutional partner in crypto and first federally chartered crypto bank

Data Engineer42 days ago
Full TimeRemoteTeam 201-500Since 2017H1B Sponsor

Founding engineer on Reporting & Statements team at Anchorage Digital

AirflowBigQueryCloudPandasPythonSQL
United States

SAP Data Migration Specialist

Enterprise Horizon Consulting Group

Enterprise Horizon solves complex IT and business challenges for the DoD, Federal, and Private sectors.

Data Engineer42 days ago
ContractRemoteTeam 11-50Since 2005H1B No Sponsor

SAP Data Migration Specialist supporting SAP S/4 HANA transformation programs

ETLSQL
Alabama

Manager, Data Engineering

DDi

Clinical, Regulatory & Automation Solutions

Data Engineer43 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor

Manager of Data Engineering leading a team in data product development

PythonSQLTableau
United States
$124.1K - $179.7K / year