Sharecare

All Together Better.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 1,001-5,000Since 2010H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

33 days ago

Salary

Not specified

Bachelor Degree10 yrs expEnglishAirflowAmazon RedshiftApacheAWSAzureCloudDistributed SystemsETLFlaskGoogle Cloud PlatformPandasPythonSparkSQL.net

Job Description

• Design, build, and maintain scalable data pipelines using Python, Apache Airflow, and Apache Spark • Analyze business and technical requirements and translate them into reliable, future-proof data solutions • Develop, validate, deploy, and support complex ETL/ELT pipelines at scale • Build clean, secure, and maintainable REST APIs following company standards • Implement real-time and batch processing solutions for diverse data sources • Develop reusable data engineering and AI frameworks for enterprise-wide adoption • Define and manage domain-based “source of truth” data models, ensuring scalability and end-to-end data lineage • Implement data governance practices, automate data quality checks, and enable pipeline testing • Optimize data infrastructure for performance, cost efficiency, and reliability • Manage source control, CI/CD pipelines, and production deployments • Partner with data scientists and analysts to support AI/ML initiatives

Job Requirements

  • Bachelor’s degree (or higher) in Computer Science, Data Engineering, or a related field
  • 10+ years of experience in data engineering or related roles
  • Strong proficiency in Python and related libraries (Pandas, SQLAlchemy, Boto3, Paramiko, Flask, FastAPI)
  • Advanced SQL skills with experience analyzing healthcare datasets (e.g., claims, provider directories)
  • Hands-on experience with orchestration tools such as Apache Airflow and Databricks Workflows
  • Strong experience with Apache Spark; exposure to Apache Flink is a plus
  • Experience integrating with .NET applications and working with SQL Server
  • Cloud platform experience (AWS, Azure, or GCP required)
  • Experience with data warehousing solutions such as Amazon Redshift or Vertica
  • Solid understanding of distributed systems and functional programming concepts
  • Proficiency with Git and modern CI/CD practices
  • Exposure to streaming technologies, containerization, and ML pipelines preferred
  • Familiarity with AI tools and large language models is a plus

Benefits

  • Equal Opportunity Employer
  • E-Verify user
  • Work-life balance

Related Categories

Related Job Pages

More Data Engineer Jobs

Staff Data Engineer – Science

Exact Sciences

Changing the way we think about detecting and treating cancer.

Data Engineer33 days ago
Full TimeRemoteTeam 5,001-10,000Since 1995H1B Sponsor

Staff Data Engineer developing software applications for cancer detection

AWSCloudETLNoSQLPythonScalaSparkSQLTableau
California + 1 moreAll locations: California, Wisconsin
$154.4K - $231.6K / year

Data Architect – MS Fabric

EXL

We make sense of data to drive your business forward. #MakeSenseofData #DriveYourBusinessForward #PartnerYourWay

Data Engineer34 days ago
Full TimeRemoteTeam 10,001+H1B No Sponsor

Lead operational analytics strategy in US-based company

New Jersey

Snowflake Data Architect

Datavail

We help clients turn data into decisions no matter where it lives-in apps, on-prem, in a hybrid model, or in the cloud.

Data Engineer34 days ago
Full TimeRemoteTeam 1,001-5,000Since 2007H1B Sponsor

Snowflake Architect building healthcare data ecosystems for Datavail

Cloud
United States
Full TimeRemoteTeam 1-10H1B No Sponsor

Senior Data Engineering & Analytics Lead driving data strategy for PM2CM, Inc.

ETLSQL
California