Job Details

NAVA Software solutions is looking for a Kafka Administrator

Details:

Kafka Administrator

Duration: 6-12 months

Location: Remote project

Job Summary:

The Apache Kafka Administrator is responsible for designing, implementing, and supporting the Apache Kafka platform within the organization. They will oversee the deployment, configuration, tuning, maintenance, and troubleshooting of Kafka clusters, ensuring optimal performance and availability. This role requires a deep understanding of Kafka architecture, strong analytical skills, and the ability to collaborate effectively with cross-functional teams.

Responsibilities and Duties:

• Design, deploy, and maintain Apache Kafka infrastructure, including clusters and topics.
• Configure and fine-tune Kafka brokers, producers, and consumers for optimal performance.
• Monitor and troubleshoot Kafka cluster issues, system alerts, and event-driven workflows.
• Collaborate with development teams to establish best practices for Kafka development and integration.
• Optimize Kafka cluster security, including access controls, authentication, and encryption.
• Implement disaster recovery and high availability strategies for Kafka deployments.
• Collaborate with infrastructure teams to plan and execute Kafka capacity planning and scaling.
• Install and configure Kafka connectors and other ecosystem tools.
• Automate routine administration tasks using scripting and automation tools.
• Stay up-to-date with the latest Kafka releases, patches, and security vulnerabilities.
• Develop and maintain documentation related to Kafka infrastructure, configurations, and processes.
• Conduct performance analysis and optimization of Kafka workloads and data pipelines.
• Provide technical guidance and support to internal teams for Kafka-related projects.
• Collaborate with vendor support teams to resolve complex Kafka-related issues.
• Ensure compliance with security and data governance policies for Kafka deployments.

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Kafka Administrator or similar role.
• Strong knowledge of Kafka architecture, design patterns, and best practices.
• Proficiency in Kafka installation, configuration, and management.
• Experience with Kafka security and authentication mechanisms, such as SSL and SASL.
• Solid understanding of Linux/Unix system administration and networking.
• Strong scripting and automation skills using Shell, Python, or similar languages.
• Experience with Kafka ecosystem tools, such as Kafka Connect, Kafka Streams, and Schema Registry.
• Familiarity with message queuing systems and event-driven architectures.
• Hands-on experience with monitoring tools like Prometheus, Grafana, and ELK stack.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and collaboration skills to work effectively with cross-functional teams.
• Ability to handle multiple tasks and prioritize projects in a fast-paced environment.
• Certification in Apache Kafka (e.g., Confluent Certified Developer/Administrator) is a plus.
• Strong knowledge of cloud platforms (AWS, Azure, GCP) and container technologies (Kubernetes) is desirable.