Channel Factory

We help brands find the right content, context and audience on YouTube at the right price.

Senior Data Engineer

Data EngineerData EngineerFull TimeRemoteTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

New York

Posted

136 days ago

Salary

Not specified

Bachelor Degree7 yrs expEnglishApacheAWSDistributed SystemsEC2ETLPostgresPy SparkPythonRabbit MQRDBMSSQL

Job Description

• Modernize core ETL processes by refactoring our existing Python / OpenSearch / SQL (PostgreSQL) based ETL systems to land data in our Data Lakehouse (Apache Iceberg) • Collaborate with product managers and business stakeholders to understand complex business requirements to translate business needs into well-designed and maintainable solutions • Ensure data quality and reliability by implementing robust data quality checks, monitoring, and alerting to ensure the accuracy and timeliness of all data pipelines • Create data governance policies and develop data models and schemas optimized for analytical workloads • Influence the direction for key infrastructure and framework choices for data pipelining and data management • Manage complex initiatives by setting project priorities, deadlines, and deliverables • Collaborate effectively with distributed team members across multiple time zones, including offshore development teams • Build relationships and foster team cohesion across geographical and cultural boundaries • All other tasks as required.

Job Requirements

  • 7+ years of experience in data engineering or related roles, with a proven track record of building and maintaining scalable data pipelines in production
  • Experience designing and developing large-scale, efficient batch and streaming data processing pipelines
  • Strong SQL proficiency, with experience in both transactional RDBMS systems and distributed systems
  • Expert-level proficiency in Python
  • In-depth experience with distributed data technologies: RabbitMQ, Celery, Pyspark
  • In-depth experience with AWS data services (ECS, EC2, Glue, OpenSearch, RDS)
  • Experience with modern Data Lakehouse technologies such as: Apache Iceberg, S3 Tables, StarRocks
  • Knowledge of digital advertising is a plus
  • This role may involve occasional travel for in-person collaboration, meetings, trainings, etc.

Benefits

  • Work with a leading startup in a high-demand industry, and you would be working with like-minded experts aiming to transform video ad operations
  • Competitive salary
  • Comprehensive medical benefits (Medical, Vision, Dental, and Life Insurance)
  • Cell phone and Wifi Reimbursement
  • Bill Spend Stipend
  • Gym Stipend
  • Work-life flexibility – we value your contributions above all

Related Categories

Related Job Pages

More Data Engineer Jobs

Data Engineer, DoD Secret

Rackner

DevSecOps and AI from Cloud to Mission Edge | Kubernetes Partner | Multicloud | 8(a) | HUBZone

Data Engineer137 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Data Engineer modernizing secure data infrastructure for military healthcare

AirflowApacheAWSETLPythonSparkSQL
United States

Senior Consultant – Data Engineering

3Cloud

Delivering the ultimate Microsoft Azure experience.

Data Engineer137 days ago
Full TimeRemoteTeam 501-1,000H1B No Sponsor

Senior Consultant - Data Engineering role at 3Cloud delivering technical solutions

AzureETLPythonSQLSSIS
United States
$108.2K - $156.9K / year

Data Engineer

Analytica

Data-driven consulting and technology services

Data Engineer137 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

Data Engineer supporting federal government enterprise data programs

AWSETLPythonSparkSQL
Virginia

Software Engineer, Data Engineer

Fractal River

We help growth companies scale faster by building their customer operations, analytics and data engineering capabilities

Data Engineer137 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Software and Data Engineer at Fractal River enhancing technical infrastructures.

Amazon RedshiftAWSAzureBigQueryCloudDockerGoogle Cloud PlatformPythonSQLTerraform
United States