PhoenixTeam

Enabling homeownership through technology.

Kafka Engineer

Full TimeRemoteTeam 51-200Since 2015H1B No SponsorCompany SiteLinkedIn

Location

Virginia

Posted

32 days ago

Salary

$100K - $130K / year

Bachelor Degree3 yrs expEnglishApacheETLKafkaLinuxMicroservices

Job Description

• Design, build, administer, and maintain Kafka clusters across development, test, and production environments. • Manage Kafka topics, partitions, brokers, replication, retention policies, and access controls. • Monitor Kafka performance, availability, throughput, and latency; proactively identify and resolve issues. • Perform capacity planning, tuning, upgrades, patching, and disaster recovery planning for Kafka environments. • Implement and maintain high availability and fault-tolerant Kafka configurations. • Develop and support event streaming pipelines using Kafka for real-time and near-real-time data processing. • Integrate Kafka with API Gateway (APIGW)–based microservices and downstream backend systems. • Design and implement Kafka producers, consumers, and connectors (e.g., Kafka Connect) to support system integrations and ETL/data movement needs. • Collaborate with application teams to define event schemas, topics, and data contracts. • Ensure reliable message delivery, data integrity, and error handling across streaming workflows. • Implement Kafka security best practices, including authentication, authorization, encryption in transit, and auditing. • Ensure Kafka implementations comply with CMS security, data governance, and operational standards. • Support DevSecOps practices, CI/CD pipelines, and infrastructure-as-code approaches where applicable. • Participate in incident response, root cause analysis, and operational readiness activities. • Document Kafka architectures, configurations, operational procedures, and integration patterns. • Provide technical guidance, troubleshooting support, and knowledge transfer to internal teams.

Job Requirements

  • Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
  • 3+ years of experience developing, administering, and supporting Apache Kafka in enterprise environments.
  • Hands-on experience managing Kafka clusters, topics, partitions, and event streaming pipelines.
  • Experience integrating Kafka with microservices, API Gateways (APIGW), and backend systems.
  • Strong understanding of event-driven architectures, messaging patterns, and data streaming concepts.
  • Experience with Linux-based environments and command-line administration.
  • Strong troubleshooting and performance tuning skills.
  • Ability to clearly communicate technical concepts to both technical and non-technical stakeholders.

Benefits

  • Must be eligible to obtain a Public Trust clearance

Related Categories

Related Job Pages