The Leaflet

An independent platform for cutting-edge, progressive, legal, and political opinion.

Staff Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 11-50H1B No SponsorCompany SiteLinkedIn

Location

Florida

Posted

25 days ago

Salary

Not specified

Bachelor Degree8 yrs expExperience acceptedEnglishAirflowAWSCassandraCloudDynamo DBGradleKafkaLinuxMavenMy SQLNo SQLNumpyPandasPythonRabbit MQScikit LearnSparkSQL

Job Description

• Be a strong technical person on our team who helps drive innovation • Be responsible for producing and maintaining critical data deliverables / pipelines • Be technically talented, able to contribute quality code • Be responsible for the quality, scope, and timeliness of all your deliverables • Drive technical skill and ownership over all aspects of your work

Job Requirements

  • Degree in computer science, a related field, or equivalent work experience (8+ years)
  • Strong communication and collaboration skills (both written and verbal)
  • Proven track record at using technology to automate data processes
  • Strong SQL skills, including Jinja templating / DBT
  • Experience with Snowflake and Airflow (Astronomer)
  • Experience with Python including exposure to data science packages (NumPy, Pandas, scikit-learn)
  • Experience manipulating, processing and extracting value from large, disconnected datasets (Spark)
  • An understanding of AWS Cloud technologies and how to create scalable applications
  • Exposure to and interest in the following technologies: AWS Serverless and serverless-supported languages
  • SQL and/or NoSQL experience (ex, MySql, Cassandra, DynamoDB, Snowflake)
  • Streaming technologies (Amazon Kinesis, Kafka)
  • Message Queues (SQS, RabbitMQ, ActiveMQ)
  • Comfort working within an agile development cycle and exposure to: Linux development
  • Git and versioning software
  • Build systems (Maven, SBT, Gradle, etc) and common build patterns
  • Experience automating data flows and reporting in a regulated environment a plus

Benefits

  • Competitive pay and benefits
  • Flexible vacation allowance
  • A hybrid / remote working environment
  • Startup culture backed by a secure, global brand

Related Categories

Related Job Pages

More Data Engineer Jobs

CMS Encounter Data Engineer

Clover Health

Clover is a healthcare technology company helping members live their healthiest lives with our Medicare Advantage plans.

Data Engineer25 days ago
Full TimeRemoteTeam 501-1,000H1B Sponsor

CMS Encounter Data Engineer managing healthcare data submissions

PythonSQL
United States
$108K - $132K / year

Data Engineer

Confluent

Set data in motion.

Data Engineer25 days ago
Full TimeRemoteTeam 1,001-5,000Since 2014H1B Sponsor

Data Engineer building data pipelines for Confluent's streaming platform

AWSAzureCloudGoogle Cloud PlatformPythonSQL
California
$66 - $85 / hour
Data Engineer25 days ago
Full TimeRemoteTeam 5,001-10,000Since 2007H1B No Sponsor

Design, build, and maintain large-scale data pipelines using Microsoft Fabric and Databricks. Develop data architectures, ensure data quality and governance, optimize processing and storage, integrate with ML and analytics, implement monitoring, and collaborate with Product and Engineering to prioritize data initiatives.

Microsoft FabricDatabricksPythonSQLScalaJavaApache SparkApache BeamAzure Data FactoryAzureAWSAzure Synapse AnalyticsAzure Data Lake StorageGit
New Mexico

Data Engineer

Amplify

A pioneer in K–12 education, Amplify partners with educators to make learning rigorous and riveting for every student.

Data Engineer25 days ago
Full TimeRemoteTeam 1,001-5,000Since 2000H1B Sponsor

Data Engineer creating infrastructure for K-12 education tech company

AirflowAWSETLPythonSQLTerraform
United States
$135K - $155K / year