People Data Labs

People and Company Intelligence

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 51-200Since 2015Company SiteLinkedIn

Location

United States

Posted

109 days ago

Salary

$190K - $210K / year

Bachelor Degree5 yrs expEnglishAirflowAmazon RedshiftApacheAWSAzureBig QueryCloudGoogle Cloud PlatformJavaPythonScalaSparkSQL

Job Description

• Build infrastructure for ingestion, transformation, and loading an exponentially increasing volume of data from a variety of sources using Spark, SQL, AWS, and Databricks • Building an organic entity resolution framework capable of correctly merging hundreds of billions of individual entities into a number of clean, consumable datasets. • Developing CI/CD pipelines and anomaly detection systems capable of continuously improving the quality of data we're pushing into production. • Dreaming up solutions to largely undefined data engineering and data science problems.

Job Requirements

  • 5-7+ years of industry experience with clear examples of strategic technical problem-solving and implementation
  • Strong software development fundamentals.
  • Experience with Python
  • Expertise with Apache Spark (Java, Scala, and/or Python-based)
  • Experience with SQL
  • Experience building scalable data processing systems (e.g., cleaning, transformation) from the ground up.
  • Experience using developer-oriented data pipeline and workflow orchestration (e.g., Airflow (preferred), dbt, dagster or similar)
  • Knowledge of modern data design and storage patterns (e.g., incremental updating, partitioning and segmentation, rebuilds and backfills)
  • Experience working in Databricks (including delta live tables, data lakehouse patterns, etc.)
  • Experience with cloud computing services (AWS (preferred), GCP, Azure or similar)
  • Experience with data warehousing (e.g., Databricks, Snowflake, Redshift, BigQuery, or similar)
  • Understanding of modern data storage formats and tools (e.g., parquet, ORC, Avro, Delta Lake)

Benefits

  • Stock
  • Competitive Salaries
  • Unlimited paid time off
  • Medical, dental, & vision insurance
  • Health, fitness, and office stipends
  • The permanent ability to work wherever and however you want

Related Categories

Related Job Pages

More Data Engineer Jobs

Healthcare Technology Consulting – Data Migration Lead

Guidehouse

Solving big problems, building trust in society, and empowering our clients to shape the future.

Data Engineer109 days ago
Full TimeRemoteTeam 10,001+Since 2018H1B Sponsor

Data Migration Lead overseeing EHR implementation and data migration for healthcare technology.

CloudETLOracle
United States
$130K - $216K / year

Gen AI Data Engineer II

Dynatron Software, Inc.

Dealership Fixed-Ops profit maximizing solutions that integrate Technology, Data Analysis, and Coaching Expertise

Data Engineer109 days ago
Full TimeRemoteTeam 51-200Since 1999H1B No Sponsor

GenAI Data Engineer designing and scaling AI systems for Dynatron’s SaaS platform

AirflowAmazon RedshiftAWSCloudPythonSQL
United States
$110K - $135K / year

Senior Data Engineer

CrowdStrike

CrowdStrike has redefined security with the world’s most advanced cloud-native platform that protects and enables the people, processes and technologies that drive modern enterprise. Tested and proven, the world's largest organizations trust CrowdStrike to stop breaches with unparalleled protection against the most sophisticated cyberattacks. The CrowdStrike culture has been built upon our Core Values since the day we began. We are Fanatical About the Customer, Relentlessly Focused on Innovation and believe that our Limitless Passion drives Unlimited Potential for every CrowdStriker. As a purpose-built remote-first company, we believe cultivating a connected culture for every employee, no matter where they are in the world, is a key ingredient in building a high-performing, diverse team. We don’t have a mission statement. We’re on a mission—to stop breaches. Ready to join a mission that matters?

Data Engineer109 days ago
Full TimeRemoteTeam 5,001-10,000Since 2011H1B Sponsor

Senior Data Engineer designing scalable data integration components at CrowdStrike

AirflowAmazon RedshiftApacheCloudETLJenkinsPythonSFDCSQL
Texas
$125K - $180K / year

Principal Data Engineer

PointClickCare

Transforming Care Through Technology

Data Engineer109 days ago
Full TimeRemoteTeam 1,001-5,000H1B Sponsor

Principal Data Engineer at PointClickCare shaping healthcare data solutions

ApacheAWSAzureCloudDistributed SystemsGoogle Cloud PlatformKafkaSpark
United States
$166.5K - $185K / year