Expertise and Technology for National Security

Kafka Engineer

EngineerEngineerFull TimeRemoteTeam 10,001+Since 1962H1B No SponsorCompany Site LinkedIn

Location

Virginia

Posted

130 days ago

Salary

$90.3K - $189.6K / year

Bachelor Degree7 yrs expExperience acceptedEnglishApacheDistributed SystemsGrafanaJavaKafkaNo SQLPrometheusSDLCSpark

Job Description

• Serve as an Agile Scrum team member providing software development support and maintenance for the delivery of releasable software in short sprint cycles • Responsible for activities associated with delivery of software solutions • Design, develop, and deploy high-performance Kafka producers, consumers, and stream processing applications • Collaborate with architects and other engineering teams to define and evolve our event-driven architecture • Implement and manage components of the Kafka ecosystem • Monitor, troubleshoot, and optimize Kafka clusters and Kafka-dependent applications • Build and maintain robust and resilient data pipelines for real-time ingestion, transformation, and distribution of data • Provide operational support for Kafka-based systems • Enforce data contract definitions and schema evolution strategies using Schema Registry • Implement comprehensive testing strategies for Kafka applications • Create and maintain detailed technical documentation • Act as a subject matter expert and mentor junior engineers

Job Requirements

Must be a U.S. Citizen with the ability to pass CBP background investigation
Extensive hands-on experience designing, developing, and deploying applications using Apache Kafka
Deep understanding of Kafka's internal architecture, guarantees (at-least-once, exactly-once), offset management, and delivery semantics
Experience with Kafka Streams API or other stream processing frameworks (e.g., Flink, Spark Streaming with Kafka)
High-level proficiency in at least one modern backend programming language (Java strongly preferred)
Strong understanding of distributed systems principles, concurrency, fault tolerance, and resilience patterns
Experience with data serialization formats such as Avro, Protobuf, or JSON Schema
Solid understanding of relational and/or NoSQL databases, and experience integrating them with Kafka
Excellent analytical, debugging, and problem-solving skills
Strong verbal and written communication skills
Knowledge of monitoring and observability tools for Kafka and streaming applications (e.g., Prometheus, Grafana, ELK stack, Datadog)
Working knowledge of Git and collaborative development workflows
Understanding of all elements of the software development life cycle
At least seven (7) years related technical experience
College degree (B.S.) in Computer Science, Software Engineering, Information Management Systems or a related discipline