Healthcare's most complete FHIR® data platform.
Senior Data Engineer, Core Data Platform
Location
United States
Posted
2 days ago
Salary
Not specified
Job Description
Job Requirements
- 5+ years of hands-on experience in data engineering, with expertise in distributed data processing and big data frameworks (e.g., Apache Spark, Apache Iceberg, Trino, Apache Airflow, dbt, Dagster).
- Advanced programming skills in Scala or Python for data transformation and automation.
- Experience with real-time data streaming technologies such as Apache Flink, Spark Streaming, or Kafka.
- Strong experience in performance tuning for Spark and optimizing large-scale data workflows.
- Proficiency in SQL and database management, with hands-on experience in Massively Parallel Processing (MPP) databases such as Amazon Redshift, Snowflake, Teradata.
- Familiarity with cloud-based data services (AWS, RDS, DynamoDB) and containerized infrastructure (EKS, Docker, Kubernetes).
- Hands-on experience integrating DevOps and CI/CD practices in data engineering using GitHub Actions, Jenkins, or Terraform.
- Proven ability to build monitoring, alerting, and observability tools for data pipelines to ensure high availability and reliability.
- Experience in data mapping, validation, and testing frameworks to ensure accuracy and consistency.
- Exposure in machine learning/deep learning using PyTorch, Tensorflow, or Keras (PyTorch preferred)
- Exposure to machine learning workflows and familiarity with MLOps tools for model deployment and lifecycle management.
- Self-starter with strong problem-solving skills who thrives in a fast-paced, agile environment.
Benefits
- 100% Paid BCBS Medical and Dental Insurance for Employees
- Vision Insurance
- Flexible PTO
- Equity for All Employees
- 401(k)
- Home Office Stipend
- Lifestyle Savings Account
- Parental Leave (6 weeks bonding leave for all new parents + 10 weeks for birthing parents)
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer (Core Data Platform)
1upHealthAt 1upHealth, our mission is to unlock health data and improve industry outcomes. As leaders in FHIR® interoperability, our platform makes it easier for partners to access, integrate, aggregate, and share data across a variety of systems. 1upHealth is building a data ecosystem to promote the digital transformation of the industry and encourage insight-driven healthcare.
The Senior Data Engineer will be responsible for designing, developing, and implementing robust ETL/ELT data pipelines for large-scale data ingestion, transformation, and storage while ensuring data quality and governance through validation and monitoring. This role also involves collaborating with cross-functional teams to build scalable data solutions, automating deployments, and contributing to the overall data architecture and strategy.
Lead Data Engineer
American Red CrossWe prevent and alleviate human suffering in the face of emergencies.
Lead Data Engineer at American Red Cross transforming data reporting capabilities
DataOps Engineer
PanoptoStop Typing. Start Recording. Panopto is trusted by millions as the easiest way to record and share videos.
DataOps Engineer architecting the data infrastructure for Panopto’s learning platform
Data Engineering Lead
MediaRadar, Inc.Sales enablement platforms customized for media, and ad tech companies that help you close more deals.
Data Engineering Lead overseeing design and development of data platform at MediaRadar