Visibility. Analytics. Context. Secure

Product Engineering Specialist – Kafka

Full-stack EngineerSoftware EngineerFull TimeRemoteTeam 1-10H1B No SponsorCompany Site LinkedIn

Location

Virginia

Posted

76 days ago

Salary

Not specified

Bachelor Degree5 yrs expEnglishAWSAzureCloudCyber SecurityDistributed SystemsDockerGoogle Cloud PlatformKafkaKubernetes

Job Description

• Design, implement, and optimize Kafka-based data streaming architectures for cybersecurity data collection and processing. • Develop and maintain Kafka clusters to ensure high availability, fault tolerance, and scalability. • Configure and tune Kafka for optimal performance, including partitioning, replication, and consumer group strategies. • Collaborate with integration engineers to design and implement efficient data pipelines from data sources through Kafka into downstream platforms. • Participate in Agile ceremonies including backlog grooming, demos, and retrospectives. • Provide expertise on Kafka security features including encryption, authentication, and authorization. • Conduct capacity planning and performance testing for Kafka deployments. • Troubleshoot complex issues in Kafka systems. • Develop and maintain documentation for Kafka configurations, best practices, and troubleshooting procedures.

Job Requirements

5+ years of relevant experience
Strong experience with Kafka and other distributed, big data, or data streaming technologies
In-depth knowledge of Kafka functionality and operational workflows
Ability to install, maintain, and troubleshoot Kafka clusters
Understanding of data serialization formats and schema management
Ability to design secure configurations and access controls for shared Kafka deployments
Excellent troubleshooting, communication, and interpersonal skills
Proven ability to analyze complex requirements and translate them into clear, actionable tasks and processes through critical thinking
Ability to design, build, and maintain message configurations and flows in high-throughput, low-latency environments
Strong problem-solving skills with the ability to analyze issues in Kafka and other complex distributed systems
Experience documenting tests and presenting findings
Demonstrated ability to apply critical thinking to translate undefined tasks into actionable work streams
Experience deploying Kafka in cloud-based environments (AWS preferred; Azure and GCP also acceptable)
Proven ability to write documentation and communicate effectively with cross-functional teams
Familiarity with containerization and orchestration technologies such as Docker and Kubernetes
Experience operating and monitoring large-scale production clusters
Applicants must be a U.S. citizen in compliance with federal contract requirements