Search by job, company or skills

Datamatics Technologies

Confluent Kafka Tech Lead

This job is no longer accepting applications

new job description bg glownew job description bg glownew job description bg svg
  • Posted a month ago

Job Description

Job Title: Confluent Kafka Tech Lead
Location: Remote / Onsite (As per project requirement)
Experience:7+ Years
Employment Type: Full-Time

Role Overview

We are seeking a highly skilled Confluent Kafka Tech Lead with deep expertise in designing, implementing, and managing real-time data streaming solutions. The ideal candidate will lead Kafka-based architecture design, ensure best practices, and guide the development and operations teams in implementing scalable, resilient event-driven systems.

Key ResponsibilitiesKafka Architecture & Solution Design
  • Lead the design and architecture of end-to-end event streaming platforms using Confluent Kafka.

  • Define data streaming patterns, event models, schema registry usage, and partitioning strategies.

  • Drive adoption of Kafka-centric event-driven architectures across teams.

Development & Integration
  • Guide the development of Kafka producers and consumers using Java/Python.

  • Implement Confluent features including KSQL, Connect, REST Proxy, Schema Registry.

  • Oversee integration of Kafka with cloud platforms (Azure/AWS/GCP).

Performance, Scalability & Reliability
  • Ensure high availability, scalability, and resiliency of Kafka clusters.

  • Optimize throughput, partitions, replication, and retention settings.

  • Implement monitoring, alerting, and logging frameworks.

Leadership & Collaboration
  • Provide technical leadership to developers and DevOps teams.

  • Conduct design reviews, code reviews, and mentor junior engineers.

  • Work closely with Data Engineering, Platform, and Enterprise Architecture teams.

Security & Governance
  • Define Kafka security standards (ACLs, RBAC, encryption, certificates).

  • Ensure compliance with data governance and regulatory requirements.

Required Skills & Qualifications
  • 67 years of overall IT experience with 4+ years in Confluent Kafka.

  • Strong experience in Kafka architecture, cluster setup, design, and optimization.

  • Expertise in Kafka Connect, Schema Registry, KSQL, and Kafka Streams.

  • Strong programming experience in Java or Python.

  • Experience with cloud (AWS/Azure/GCP) and containerization (Kubernetes/Docker).

  • Understanding of event-driven architecture and distributed systems.

  • Excellent leadership, communication, and problem-solving capabilities.

Preferred Qualifications
  • Confluent Kafka Certification.

  • Experience in large-scale, high-throughput real-time systems.

  • CI/CD experience for streaming applications.

More Info

Job Type:
Industry:
Employment Type:

Job ID: 133649271