1upHealth, Inc.

Healthcare's most complete FHIR® data platform.

Senior Data Engineer, Core Data Platform

Data EngineerData EngineerFull TimeRemoteTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

2 days ago

Salary

Not specified

Bachelor Degree5 yrs expEnglishAirflowAmazon RedshiftApacheAWSCloudDockerDynamo DBETLJenkinsKafkaKerasKubernetesPythonPy TorchScalaSparkSQLTensorflowTerraform

Job Description

• Design, develop, and implement robust ETL/ELT data pipelines for large-scale data ingestion, transformation, and storage. • Ensure data quality, integrity, and governance by implementing validation techniques, data monitoring, and automated testing. • Collaborate with cross-functional teams, including data scientists, analysts, platform engineers, and business stakeholders, to develop scalable and reusable data solutions. • Automate deployments and testing using CI/CD pipelines with Git, Terraform, GitHub Actions, or Jenkins. • Design and build custom data tools and abstractions to support analytics, machine learning, and real-time data processing. • Work with DevOps and platform teams to establish efficient deployment and monitoring processes for internal and external data products. • Develop and implement alerting, monitoring, and observability frameworks for data pipelines to ensure reliability and proactive issue resolution. • Contribute to the data architecture and strategy, driving improvements in scalability, performance, and cost optimization. • Stay up to date with emerging technologies and industry best practices to continuously enhance data engineering capabilities.

Job Requirements

  • 5+ years of hands-on experience in data engineering, with expertise in distributed data processing and big data frameworks (e.g., Apache Spark, Apache Iceberg, Trino, Apache Airflow, dbt, Dagster).
  • Advanced programming skills in Scala or Python for data transformation and automation.
  • Experience with real-time data streaming technologies such as Apache Flink, Spark Streaming, or Kafka.
  • Strong experience in performance tuning for Spark and optimizing large-scale data workflows.
  • Proficiency in SQL and database management, with hands-on experience in Massively Parallel Processing (MPP) databases such as Amazon Redshift, Snowflake, Teradata.
  • Familiarity with cloud-based data services (AWS, RDS, DynamoDB) and containerized infrastructure (EKS, Docker, Kubernetes).
  • Hands-on experience integrating DevOps and CI/CD practices in data engineering using GitHub Actions, Jenkins, or Terraform.
  • Proven ability to build monitoring, alerting, and observability tools for data pipelines to ensure high availability and reliability.
  • Experience in data mapping, validation, and testing frameworks to ensure accuracy and consistency.
  • Exposure in machine learning/deep learning using PyTorch, Tensorflow, or Keras (PyTorch preferred)
  • Exposure to machine learning workflows and familiarity with MLOps tools for model deployment and lifecycle management.
  • Self-starter with strong problem-solving skills who thrives in a fast-paced, agile environment.

Benefits

  • 100% Paid BCBS Medical and Dental Insurance for Employees
  • Vision Insurance
  • Flexible PTO
  • Equity for All Employees
  • 401(k)
  • Home Office Stipend
  • Lifestyle Savings Account
  • Parental Leave (6 weeks bonding leave for all new parents + 10 weeks for birthing parents)

Related Categories

Related Job Pages

More Data Engineer Jobs

Senior Data Engineer (Core Data Platform)

1upHealth

At 1upHealth, our mission is to unlock health data and improve industry outcomes. As leaders in FHIR® interoperability, our platform makes it easier for partners to access, integrate, aggregate, and share data across a variety of systems. 1upHealth is building a data ecosystem to promote the digital transformation of the industry and encourage insight-driven healthcare.

Data Engineer2 days ago
Full TimeRemoteTeam 51-200

The Senior Data Engineer will be responsible for designing, developing, and implementing robust ETL/ELT data pipelines for large-scale data ingestion, transformation, and storage while ensuring data quality and governance through validation and monitoring. This role also involves collaborating with cross-functional teams to build scalable data solutions, automating deployments, and contributing to the overall data architecture and strategy.

PythonScalaApache SparkApache AirflowApache KafkaAmazon RedshiftSnowflakeAWSDockerKubernetesSQLGitHub ActionsJenkinsTerraformApache FlinkApache IcebergTrinodbtDagsterPyTorch
United States

Lead Data Engineer

American Red Cross

We prevent and alleviate human suffering in the face of emergencies.

Data Engineer2 days ago
Full TimeRemoteTeam 10,001+H1B No Sponsor

Lead Data Engineer at American Red Cross transforming data reporting capabilities

Amazon RedshiftAWSCloudEC2ETLPythonSQL
Florida + 3 moreAll locations: Florida, Illinois, North Carolina, Texas
$140K - $150K / year

DataOps Engineer

Panopto

Stop Typing. Start Recording. Panopto is trusted by millions as the easiest way to record and share videos.

Data Engineer2 days ago
Full TimeRemoteTeam 51-200Since 2007H1B Sponsor

DataOps Engineer architecting the data infrastructure for Panopto’s learning platform

AWSEC2MS SQL ServerPythonSQL
United States
$140K - $150K / year

Data Engineering Lead

MediaRadar, Inc.

Sales enablement platforms customized for media, and ad tech companies that help you close more deals.

Data Engineer2 days ago
Full TimeRemoteTeam 201-500Since 2007H1B No Sponsor

Data Engineering Lead overseeing design and development of data platform at MediaRadar

AirflowApacheAzureETLKubernetesPostgreSQLPySparkSparkSQLTerraform
United States