Senior Data Engineer

Location

United States

Posted

3 days ago

Salary

$143.1K - $199.8K / year

Seniority

Senior

Job Description

• Develop, optimize, and improve data systems such as ETL data, pipeline, storage, and entity resolution • Build infrastructure and data automation pipelines for the ingestion, processing, and loading of data from various sources • Automate and integrate new components into the data pipeline • Collaborate with stakeholders and data science teams to develop data products • Design, build, and maintain scalable data pipelines and infrastructure for machine learning workflows • Create unit and stress test components to monitor technical performance • Develop data analysis tools to provide data insights and capture key metrics • Follow best practices for data governance, quality, cleansing, and other ETL-related activities

Job Requirements

  • 7+ years of development experience in data engineering within a production environment (internships and academic settings excluded)
  • Proven experience working with large datasets exceeding 100M+ records or multiple terabytes
  • 2+ years of development experience in highly scalable, distributed systems and cluster architectures using AWS
  • 5+ years of hands-on programming experience with Python
  • 5+ years of professional experience working in big data ecosystems, Spark is required; PySpark is preferable
  • 3+ years of experience with SQL, schema design, and dimensional data modeling
  • 2+ years of professional experience working with dataflow orchestration tools, such as Airflow
  • 2+ years of experience with non-relational databases (e.g., DynamoDB, Elasticsearch, etc.)
  • A bachelor’s degree in Computer Science, Information Systems, Mathematics, or a related field is required.

Benefits

  • 100% medical/dental/vision coverage
  • Unlimited employee PTO
  • Bonus program
  • Equity plans
  • 401K matching for qualified roles
  • Discretionary, merit-based salary increases twice a year

Related Categories

Related Job Pages

More Data Engineer Jobs

OtherRemoteTeam 11-50H1B No Sponsor

Senior Managing Consultant (Data Engineering) driving data initiatives in a consulting environment

District Of Columbia + 4 moreAll locations: District Of Columbia, Florida, Illinois, New York, Massachusetts
Creai logo

Data Architect

Creai

Soluciones de Inteligencia Artificial a la medida

Data Engineer3 days ago
OtherRemoteTeam 51-200Since 2023

Data Architect defining and implementing enterprise data architectures at Creai.

United States
Atreides logo

Mission (Data) Engineer

Atreides

While meeting all of these criteria would be ideal, we understand that some candidates may meet most, but not all. If you're passionate, curious and ready to "work smart and get things done," we'd love to hear from you.

Data Engineer3 days ago
OtherRemoteTeam 11-50H1B No Sponsor

The role involves designing, implementing, and maintaining scalable solutions with a focus on data pipelines and automation within a cloud-native environment. Responsibilities include building intuitive user experiences for data querying and visualization, ensuring high availability for customer systems, and providing direct customer support.

United States
Atreides logo

Senior Data Engineer

Atreides

While meeting all of these criteria would be ideal, we understand that some candidates may meet most, but not all. If you're passionate, curious and ready to "work smart and get things done," we'd love to hear from you.

Data Engineer3 days ago
OtherRemoteTeam 11-50H1B No Sponsor

The Senior Data Engineer will lead the architecture and implementation of high-scale data systems processing vast quantities of geospatial and sensor data, focusing on building fault-tolerant pipelines and optimizing distributed workflows. Responsibilities also include setting engineering standards, mentoring junior developers, and collaborating with various teams to shape the platform roadmap.

United States