Senior Deep Learning Framework Engineer

CommunicationsCommunicationsFull TimeRemoteTeam 10,001+Since 1993H1B SponsorCompany Site LinkedIn

Location

California + 3 more

Posted

51 days ago

Salary

$152K - $241.5K / year

Bachelor Degree5 yrs expExperience acceptedEnglishPythonPy Torch

Job Description

• Integrate new communication libraries features in AI frameworks: from PoC to performance analysis to production • Perform deep analysis of AI workloads and frameworks to identify multi-GPU communication requirements and opportunities. • Collaborate hands-on with teams working on the latest AI models. • Improve AI compilers to hide communications or perform automatic fusion. • Conduct in-depth AI workload performance characterization on multi-GPU clusters. • Design fault-tolerant and elastic solutions for large-scale or dynamic AI workloads. • Author custom communication or fused compute-communication kernels to showcase ultimate performance on NV platforms. • Influence the roadmap of communication libraries - NCCL & NVSHMEM. • Collaborate with a very dynamic team across multiple time zones.

Job Requirements

B.S, M.S. or PHD in Computer Science, or related field (or equivalent experience) with 5+ software engineering and HPC/AI experience
Development or integration experience with Deep Learning Frameworks such PyTorch, JAX, and Inference Engines such as TRT-LLM, vLLM, SGLang
Rapid prototyping and development with Python, C++, CUDA or related DSLs (Triton, cuTe)
Solid grasp of AI models, parallelisms, and/or compiler technologies (e.g. torch.compile)
Experience conducting performance benchmarking on AI clusters.
Familiarity with at least one performance profiler toolchain (PyTorch profiler, NVIDIA Nsight Systems)
Understanding of HPC/AI communication concepts (1-sided v 2-sided communication, elasticity, resiliency, topology discovery, etc)
Adaptability and passion to learn new areas and tools
Flexibility to work and communicate effectively across different teams and timezones