Capital Rx
Affordable Pharmacy Benefits, Powered by Modern Infrastructure.
Senior Scalability Engineer – Streaming & Realtime Systems
Location
United States
Posted
37 days ago
Salary
$160K - $200K / year
Bachelor Degree10 yrs expEnglishAmazon RedshiftAWSDistributed SystemsFlaskKafkaPostgresPython
Job Description
• Own streaming infrastructure: Design, implement, and expand WAL-based replication systems that process database changes through Kinesis to Snowflake and Redshift, handling millions of records while maintaining strict ordering and delivery guarantees.
• Build CDC systems: Architect and implement change data capture infrastructure for cross-platform data synchronization, enabling realtime analytics and event-driven workflows across the organization.
• Develop shared libraries: Create reusable Kinesis/SNS consumer patterns and libraries used across multiple teams, establishing best practices for event processing, error handling, and observability.
• Partner with product teams: Work directly with teams to design and implement realtime data processing solutions tailored to their business needs, providing technical guidance and hands-on support.
• Ensure data reliability: Implement exactly-once processing semantics, dead letter queues, retry strategies, and monitoring to guarantee data integrity across streaming pipelines.
• Build observability: Develop monitoring, alerting, and dashboards for streaming pipelines to track throughput, lag, data quality issues, and system health using the LGTM stack.
• Demonstrate technical leadership: Mentor engineers on streaming architecture patterns, lead design reviews for event-driven systems, and represent the Scalability team in cross-functional planning.
• Make strong architectural choices through careful evaluation and prior experience with distributed systems.
• Responsible for adherence to the Capital Rx Code of Conduct, including reporting of noncompliance.
Job Requirements
- 10+ years of software engineering experience with demonstrated progression into technical leadership roles.
- 3+ years of experience leading technical initiatives, architecting distributed systems, or serving as a subject matter expert on streaming infrastructure.
- Strong expertise in Python (Flask/SQLAlchemy) for production applications.
- Deep PostgreSQL knowledge: Understanding of write-ahead logs, replication, logical decoding, and change data capture mechanisms.
- Production streaming experience: Proven track record building and operating high-throughput streaming systems using Kinesis, Kafka, or similar event streaming platforms.
- Distributed systems expertise: Strong understanding of ordering guarantees, exactly-once semantics, partition strategies, backpressure handling, and fault tolerance patterns.
- AWS experience: Production experience with Kinesis, S3, SNS/SQS, Lambda, ECS, and data pipeline orchestration.
- Data warehouse knowledge: Experience loading data into Redshift, Snowflake, or similar analytical databases.
- Systems thinking: Ability to design resilient, observable streaming architectures that balance throughput, latency, and reliability.
- Collaboration and communication: Strong written and verbal communication skills with ability to work autonomously while driving proactive collaboration in a remote environment.
Benefits
- Health insurance
- 401(k) matching
- Flexible work hours
- Paid time off
- Remote work options
Related Guides
Related Categories
Related Job Pages
More Engineer Jobs
Engineer37 days ago
Full TimeRemoteTeam 11-50Since 2002H1B Sponsor
Process Engineer overseeing CMO relationships at Praxis Precision Medicines
Civil Development Engineer, 7+ years experience
Intersect PowerEnabling new pathways between clean electricity and the broader economy
Engineer37 days ago
Full TimeRemoteTeam 51-200Since 2016H1B Sponsor
Civil Development Engineer providing design guidance for grid-scale solar and data center sites
Engineer37 days ago
Full TimeRemoteTeam 10,001+Since 2020H1B No Sponsor
Engineer supporting obsolescence management for Raytheon systems
Engineer37 days ago
Full TimeRemoteTeam 10,001+Since 1993H1B Sponsor
Senior Formal Verification Engineer at NVIDIA verifying ASICs using formal verification tools
Python
California + 4 moreAll locations: California, Florida, Oregon, Texas, Washington
$196K - $310.5K / year