eSimplicity

An engineering firm that delivers high-quality Healthcare IT, Cybersecurity, and Telecommunication solutions.

ETL Pipeline Developer, Data Engineer

Data EngineerData EngineerPart TimeRemoteTeam 51-200Since 2016H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

38 days ago

Salary

$110 / hour

Bachelor Degree8 yrs expEnglishApacheAzureCloudETLPy SparkPythonSparkSQL

Job Description

• Work collaboratively with Product Managers, Designers, and Engineers to set up, develop, and maintain critical back-end integrations for data and analytics platform. • Create and maintain new and existing data pipelines, Extract, Transform, and Load (ETL) processes, and ETL features using Azure cloud services. • Build, expand, and optimize data and data pipeline architectures. • Optimize data flow and collection for cross functional teams of database architects, data analysts, and data scientists. • Operate large-scale data processing pipelines and resolve business and technical issues pertaining to the processing and data quality. • Assemble large, complex sets of data that meet non-functional and functional business requirements. • Identify, design, and implement internal process improvements including re-designing data infrastructure for greater scalability, optimizing data delivery, and automating manual processes. • Develop and document standard operating procedures (SOPs) for new and existing data pipelines. • Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition. • Write unit and integration tests for all data processing code. • Read data specifications and translate them into code and design documents.

Job Requirements

  • All candidates must pass public trust clearance through the U.S. Federal Government.
  • Bachelor's degree in Computer Science, Software Engineering, Data Science, Statistics, or related technical field.
  • 8+ years of experience in software/data engineering, including data pipelines, data modeling, data integration, and data management.
  • Expertise in data lakes, data warehouses, data meshes, data modeling and data schemas (star, snowflake…).
  • Extensive experience with Azure cloud-native data services, including Synapse, Data Factory, DevOps, KeyVault, etc.
  • Expertise in SQL, T-SQL, and Python with applied experience in Apache Spark and large-scale processing using PySpark.
  • Proficiency with data formats: parquet, distributed snappy parquet, and .csv.
  • Understanding of common connection protocols, such as SFTP.
  • Proven ability to work with incomplete or ambiguous data infrastructure and design integration strategies.
  • Excellent analytical, organizational, and problem-solving skills.
  • Strong communication skills, with the ability to translate complex concepts across technical and business teams.
  • Proven experience working with petabyte-level data systems.

Benefits

  • Highly competitive salary
  • Full healthcare benefits

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Engineer38 days ago
Full TimeRemoteTeam 51-200Since 2016H1B Sponsor

At Hugging Face, we’re on a journey to democratize good AI. We are building the fastest growing platform for AI builders with over 5 million users & 100k organizations who collectively shared over 1M models, 300k datasets & 300k apps. O...

New York
Data Engineer38 days ago
Full TimeRemoteTeam 1,001-5,000Since 2023H1B No Sponsor

Senior Cloud Data Architect delivering data solutions for healthcare.

AirflowAmazon RedshiftAWSCloudDjangoDockerEC2ETLOraclePostgresPythonSQLTableauTerraform
United States
$128K - $160.9K / year
Full TimeRemoteTeam 10,001+Since 1860H1B No Sponsor

Senior Architect ensuring robust data systems within S&P Global's financial services.

AWSAzureCloudGoogle Cloud Platform
New York
$177.0K - $266K / year

Texting Intern (Spring 2026)

Middle Seat Digital

Middle Seat is a digital consulting firm that works with progressive campaigns, nonprofits, advocacy organizations.

Data Engineer38 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Salary: $23/hourLocation: Remote or Washington, D.C.Content creation, texting production, and reportingWant to break into digital for political campaigns and advocacy groups? Get your start with us. Middle Seat is a digital consulting firm that works w...

District Of Columbia