Channel Factory
We help brands find the right content, context and audience on YouTube at the right price.
Senior Data Engineer
Location
New York
Posted
136 days ago
Salary
Not specified
Bachelor Degree7 yrs expEnglishApacheAWSDistributed SystemsEC2ETLPostgresPy SparkPythonRabbit MQRDBMSSQL
Job Description
• Modernize core ETL processes by refactoring our existing Python / OpenSearch / SQL (PostgreSQL) based ETL systems to land data in our Data Lakehouse (Apache Iceberg)
• Collaborate with product managers and business stakeholders to understand complex business requirements to translate business needs into well-designed and maintainable solutions
• Ensure data quality and reliability by implementing robust data quality checks, monitoring, and alerting to ensure the accuracy and timeliness of all data pipelines
• Create data governance policies and develop data models and schemas optimized for analytical workloads
• Influence the direction for key infrastructure and framework choices for data pipelining and data management
• Manage complex initiatives by setting project priorities, deadlines, and deliverables
• Collaborate effectively with distributed team members across multiple time zones, including offshore development teams
• Build relationships and foster team cohesion across geographical and cultural boundaries
• All other tasks as required.
Job Requirements
- 7+ years of experience in data engineering or related roles, with a proven track record of building and maintaining scalable data pipelines in production
- Experience designing and developing large-scale, efficient batch and streaming data processing pipelines
- Strong SQL proficiency, with experience in both transactional RDBMS systems and distributed systems
- Expert-level proficiency in Python
- In-depth experience with distributed data technologies: RabbitMQ, Celery, Pyspark
- In-depth experience with AWS data services (ECS, EC2, Glue, OpenSearch, RDS)
- Experience with modern Data Lakehouse technologies such as: Apache Iceberg, S3 Tables, StarRocks
- Knowledge of digital advertising is a plus
- This role may involve occasional travel for in-person collaboration, meetings, trainings, etc.
Benefits
- Work with a leading startup in a high-demand industry, and you would be working with like-minded experts aiming to transform video ad operations
- Competitive salary
- Comprehensive medical benefits (Medical, Vision, Dental, and Life Insurance)
- Cell phone and Wifi Reimbursement
- Bill Spend Stipend
- Gym Stipend
- Work-life flexibility – we value your contributions above all
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Data Engineer, DoD Secret
RacknerDevSecOps and AI from Cloud to Mission Edge | Kubernetes Partner | Multicloud | 8(a) | HUBZone
Data Engineer137 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor
Data Engineer modernizing secure data infrastructure for military healthcare
AirflowApacheAWSETLPythonSparkSQL
United States
Data Engineer137 days ago
Full TimeRemoteTeam 501-1,000H1B No Sponsor
Senior Consultant - Data Engineering role at 3Cloud delivering technical solutions
AzureETLPythonSQLSSIS
Data Engineer137 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor
Data Engineer supporting federal government enterprise data programs
AWSETLPythonSparkSQL
Virginia
Software Engineer, Data Engineer
Fractal RiverWe help growth companies scale faster by building their customer operations, analytics and data engineering capabilities
Data Engineer137 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor
Software and Data Engineer at Fractal River enhancing technical infrastructures.
Amazon RedshiftAWSAzureBigQueryCloudDockerGoogle Cloud PlatformPythonSQLTerraform
United States