An independent platform for cutting-edge, progressive, legal, and political opinion.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 11-50H1B No SponsorCompany Site LinkedIn

Location

Florida

Posted

70 days ago

Salary

Not specified

Bachelor Degree5 yrs expEnglishAirflowAWSCassandraCloudDynamo DBGradleJavaKafkaLinuxMavenMy SQLNo SQLNumpyPandasPythonRabbit MQScikit LearnSparkSQL

Job Description

• Be a strong technical person on our team who helps drive innovation • Be responsible for producing and maintaining critical data deliverables / pipelines • Be technically talented, able to contribute quality code • Be responsible for the quality, scope, and timeliness of all your deliverables • Operate with a startup mindset, relying on your technical skill, passion, and ownership

Job Requirements

Degree in computer science, a related field, or equivalent work experience (5+ years)
Strong communication and collaboration skills (both written and verbal)
Proven track record at using technology to automate data processes
Strong SQL skills, including Jinja templating / DBT
Experience with Snowflake and Airflow (Astronomer)
Experience with Java
Experience with Python including exposure to data science packages (NumPy, Pandas, scikit-learn)
Experience manipulating, processing and extracting value from large, disconnected datasets (Spark)
An understanding of AWS Cloud technologies and how to create scalable applications
Exposure to and interest in the following technologies: AWS Serverless and serverless-supported languages
SQL and/or NoSQL experience (ex, MySql, Cassandra, DynamoDB, Snowflake)
Streaming technologies (Amazon Kinesis, Kafka)
Message Queues (SQS, RabbitMQ, ActiveMQ)
Comfort working within an agile development cycle and exposure to: Linux development
Git and versioning software
Build systems (Maven, SBT, Gradle, etc) and common build patterns
Experience automating data flows and reporting in a regulated environment a plus