An open-source collaborative and nonprofit dedicated to decoding animal communication.

Senior Infrastructure Engineer – Backend, Data Performance

Infrastructure EngineerInfrastructure EngineerFull TimeRemoteTeam 1-10Since 2018H1B SponsorCompany Site LinkedIn

Location

United States

Posted

44 days ago

Salary

$225.5K - $235.5K / year

5 yrs expEnglishApacheAWSAzureBig QueryCloudDistributed SystemsDockerGoogle Cloud PlatformKubernetesPythonPy TorchSparkTerraform

Job Description

• Design and optimize high-performance data pipelines for distributed training and storage (using tools like Arrow, DuckDB, LanceDB, BigQuery, vector databases). • Focus on low-level optimizations (latency, throughput, reliability, GPU usage). • Build monitoring and visualization tools for tracking data quality, pipeline performance, and experiments. • Optimize distributed AI workloads for reliability, latency, and efficiency. • Scope and supervise projects so that interns, PhD students, and post-docs can contribute and collaborate effectively. • Support recruiting efforts and help shape the growth of the infrastructure team.

Job Requirements

5+ years of backend or infrastructure engineering experience
Strong Python programming skills (bonus points for lower-level languages)
Experience with distributed systems and cloud platforms (AWS, GCP, Azure)
Hands-on experience with containerization (Docker, Kubernetes) and infrastructure as code (Terraform)
Experience building or supporting ML/AI infrastructure in production
Experience with high-performance data tools (DuckDB, Apache Spark, Delta Lake)
GPU orchestration and large-scale model training experience
Familiarity with ML platforms (SageMaker, Vertex AI) and frameworks (PyTorch, JAX)
Experience mentoring junior engineers, interns, or researchers and breaking down complex projects into manageable tasks
Experience participating in technical hiring processes and evaluating candidates

Benefits

Medical insurance, dental insurance, and vision insurance - ESP covers 100% of the premium
401k plan with match (if based in the United States)
2,000 USD home office stipend
Unlimited paid time off, with a recommended minimum of three weeks per year
Flexible working hours
Regular team retreats around the world