PhoenixTeam
Enabling homeownership through technology.
Kafka Engineer
Location
Virginia
Posted
32 days ago
Salary
$100K - $130K / year
Bachelor Degree3 yrs expEnglishApacheETLKafkaLinuxMicroservices
Job Description
• Design, build, administer, and maintain Kafka clusters across development, test, and production environments.
• Manage Kafka topics, partitions, brokers, replication, retention policies, and access controls.
• Monitor Kafka performance, availability, throughput, and latency; proactively identify and resolve issues.
• Perform capacity planning, tuning, upgrades, patching, and disaster recovery planning for Kafka environments.
• Implement and maintain high availability and fault-tolerant Kafka configurations.
• Develop and support event streaming pipelines using Kafka for real-time and near-real-time data processing.
• Integrate Kafka with API Gateway (APIGW)–based microservices and downstream backend systems.
• Design and implement Kafka producers, consumers, and connectors (e.g., Kafka Connect) to support system integrations and ETL/data movement needs.
• Collaborate with application teams to define event schemas, topics, and data contracts.
• Ensure reliable message delivery, data integrity, and error handling across streaming workflows.
• Implement Kafka security best practices, including authentication, authorization, encryption in transit, and auditing.
• Ensure Kafka implementations comply with CMS security, data governance, and operational standards.
• Support DevSecOps practices, CI/CD pipelines, and infrastructure-as-code approaches where applicable.
• Participate in incident response, root cause analysis, and operational readiness activities.
• Document Kafka architectures, configurations, operational procedures, and integration patterns.
• Provide technical guidance, troubleshooting support, and knowledge transfer to internal teams.
Job Requirements
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
- 3+ years of experience developing, administering, and supporting Apache Kafka in enterprise environments.
- Hands-on experience managing Kafka clusters, topics, partitions, and event streaming pipelines.
- Experience integrating Kafka with microservices, API Gateways (APIGW), and backend systems.
- Strong understanding of event-driven architectures, messaging patterns, and data streaming concepts.
- Experience with Linux-based environments and command-line administration.
- Strong troubleshooting and performance tuning skills.
- Ability to clearly communicate technical concepts to both technical and non-technical stakeholders.
Benefits
- Must be eligible to obtain a Public Trust clearance