We power commerce through conversation by enabling brands to sell, market, and engage their customers—all via text.

Staff Data Engineer, PySpark

Data EngineerData EngineerFull TimeRemoteTeam 51-200H1B SponsorCompany Site LinkedIn

Location

United States

Posted

63 days ago

Salary

$208K - $235K / year

Bachelor Degree5 yrs expEnglishCassandraCloudDynamo DBMongo DBMy SQLNo SQLPostgresPythonSpark

Job Description

• Design and evolve scalable, distributed data infrastructure across cloud platforms • Build and maintain real time and batch data processing pipelines supporting analytics and AI/ML workloads • Develop and manage integrations with third party e-commerce platforms to expand our data ecosystem • Ensure data availability, reliability and quality through monitoring and automated auditing • Partner with engineering, AI and product teams on data solutions for business critical needs • Mentor and support data engineers, establishing best practices and code quality standards

Job Requirements

5+ years of software development and data engineering experience with demonstrated ownership of production grade data infrastructure
Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
Deep expertise scaling Spark in production (Databricks, EMR, etc)
Strong understanding of distributed computing and modern data modeling for scalable systems
Proficient in Python with experience implementing software engineering best practices
Hands-on experience with both relational (MySQL / PostgreSQL) and NoSQL (MongoDB, DynamoDB, Cassandra) databases
Strong communicator with experience influencing cross functional stakeholders